Abstracts
Résumé
L’approche réaliste gagne en popularité auprès des chercheurs en sciences sociales, notamment auprès de ceux dont les objets de recherche sont complexes : programmes, projets ou politiques publiques qui visent à améliorer une situation sociale. En effet, l’approche réaliste a été récemment adaptée à la pratique de l’évaluation de programmes et à celle de la revue systématique. Ces pratiques de recherche ancrées dans le réalisme critique semblent mieux adaptées aux exigences du mouvement de la prise de décision ou de l’action fondée sur les preuves scientifiques. Pourtant, l’approche réaliste est encore peu utilisée et connue, particulièrement parmi les étudiants et les chercheurs francophones en évaluation. Le premier objectif de cet article est donc de présenter, de manière didactique, les fondements épistémologiques et les concepts clés de l’approche réaliste pour l’évaluation de programmes et la revue systématique. Le deuxième objectif est d’illustrer, par une étude de cas – celui d’une revue réaliste –, les apprentissages conceptuels et méthodologiques pour la pratique de l’évaluation réaliste. Cette démarche réflexive s’inscrit dans un mouvement de partage de connaissances et de pratiques sur l’approche réaliste.
Mots-clés :
- évaluation de programmes,
- approche réaliste,
- revue systématique,
- complexité,
- méthode
Abstract
The realist approach is gaining popularity among social scientists, especially among those whose research objects are complex, such as programs, projects and public policies that seek to improve a social situation. Indeed, the realist approach has been adapted to the practice of program evaluation, and more recently of systematic review. Research methods rooted in critical realism seem better adapted to the demands of the movement for evidence-based decision- and policy-making. However, the realist approach is still rarely known and used, especially among francophone evaluation researchers and students. The first objective of this article is thus to introduce in a didactic way the epistemological foundations and key concepts of the realist approach to program evaluation and systematic review. The second objective is to illustrate, through a case study of a realistic review, the conceptual and methodological learning about the practice of realistic evaluation. This reflexive approach is part of a movement of sharing knowledge and best practices on the realist approach.
Keywords:
- program evaluation,
- realist approach,
- systematic review,
- complexity,
- method
Resumo
A abordagem realista está a ganhar popularidade entre os cientistas sociais, especialmente daqueles cujos objetos de investigação são complexos: programas, projetos e políticas públicas que visam a melhoria de uma situação social. Com efeito, a abordagem realista foi recentemente adaptada para a prática da avaliação de programas e da revisão sistemática. Estas práticas de investigação enraizadas no realismo crítico parecem mais adaptadas às exigências do movimento de tomada de decisão ou de ação baseada em evidências científicas. No entanto, a abordagem realista é ainda pouco utilizada e conhecida, especialmente entre estudantes e investigadores francófonos em avaliação. O primeiro objetivo deste artigo é apresentar, de forma didática, os fundamentos epistemológicos e os conceitos-chave da abordagem realista para a avaliação de programas e a revisão sistemática. O segundo objetivo é ilustrar, através de um estudo de caso - o de uma revisão realista –, as aprendizagens concetuais e metodológicas para a prática da avaliação realista. Esta abordagem reflexiva inscreve-se num movimento de partilha de conhecimentos e de práticas sobre a abordagem realista.
Palavras chaves:
- avaliação de programas,
- abordagem realista,
- revisão sistemática,
- complexidade,
- método
Appendices
Références
- Alkin, M. C., & Christie, C. A. (2004). An evaluation theory tree. In M. C. Alkin (Ed.), Evaluation Roots (p. 13-66). Thousand Oaks, CA: Sage Publications.
- Analyse et traitement information de la langue française (2005). Le Trésor de la Langue Française informatisé. Paris, France : CNRS.
- Astbury, B., & Leeuw, F. L. (2010). Unpacking Black Boxes: Mechanisms and Theory Building in Evaluation. American Journal of Evaluation, 31(3), 363-381. doi: 10.1177/1098214010371972
- Bégin, C., Joubert, P., & Turgeon, J. (1999). L’évaluation dans le domaine de la santé : Conceptions, courants de pensée et mise en oeuvre. In C. Bégin, P. Bergeron, P.-G. Forest, & V. Lemieux (Eds.), Le système de santé québécois : Un modèle en transformation (pp. 265-281). Montréal, Canada : Les Presses de l’Université de Montréal.
- Blaise, P., Marchal, B., Lefèvre, P., & Kegels, G. (2010). Au-delà des méthodes expérimentales, l’approche réaliste en évaluation. In L. Potvin, M.-J. Moquet, & C. M. Jones (Eds.), Guide d’aide à l’action : inégalités sociales de santé (pp. 285-296). Saint-Denis, France : INPES.
- Bruchon-Schweitzer, M. (2001). Le coping et les stratégies d’ajustement face au stress. Recherche en soins infirmiers, (67), 68-83.
- Byng, R., Norman, I., & Redfern, S. (2005). Using Realistic Evaluation to Evaluate a Practice-level Intervention to Improve Primary Healthcare for Patients with Long-term Mental Illness. Evaluation, 11(1), 69-93. doi: 10.1177/13563890050 53198
- Calnan, M., & Ferlie, E. (2003). Analysing process in healthcare: the methodological and theoretical challenges. Policy & Politics, 31(2), 185-193. doi: 10.1332/03055730 3765371672
- Carson, D. (2008). The abduction of Sherlock Holmes. International Journal of Police Science & Management, 11(2), 193-202. doi: 10.1350/ijps.2009.11.2.123
- Chelimsky, E. (2013). Balancing evaluation theory and practice in the real world. American Journal of Evaluation, 34(1), 91-98. doi: 10.1177/1098214012461559
- Chen, H.-T., & Rossi, P. H. (1980). The multi-goal, theory-driven approach to evaluation: A model linking basic and applied social science. Social Forces, 59(1), 106-122.
- Currie, D., & Wiesenberg, S. (2003). Promoting women’s health-seeking behavior: research and the empowerment of women. Health Care for Women International, 24(10), 880-899. doi: 10.1080/07399330390244257
- Davis, P. (2005). The limits of realist evaluation surfacing and exploring assumptions in assessing the best value performance regime. Evaluation, 11(3), 275-295. doi: 10.1177/1356389005058476
- Deslauriers, J.-P., & Kérisit, M. (1997). Le devis de recherche qualitative. In J. Poupart, J.-P. Deslauriers, L.-H. Groulx, A. Laperrière, R. Mayer, & A. P. Pires (Eds.), La recherche qualitative : Enjeux épistémologiques et méthodologiques (pp. 85-111). Montréal, Canada : Gaëtan Morin éditeur.
- Ensor, T., & Cooper, S. (2004). Overcoming barriers to health service access: Influencing the demand side. Health Policy and Planning, 19(2), 69-79. doi: 10.1093/heapol/czh009
- Greenhalgh, T., Wong, G., Westhorp, G., & Pawson, R. (2011, August). Protocol - realist and meta-narrative evidence synthesis: Evolving Standards (RAMESES). BMC Medical Research Methodology, 11, 115. doi: 10.1186/1471-2288-11-115
- Guba, E. G., & Lincoln, Y. S. (1994). Competing paradigms in qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (pp. 9105-9107). Thousand Oaks, CA: Sage Publications.
- Henry, G. T., Julnes, G., & Mark, M. M. (1998). Realist Evaluation: An Emerging Theory in Support of Practice. San Francisco, CA: New Directions for Evaluation.
- Jacobs, B., Ir, P., Bigdeli, M., Annear, P. L., & Van Damme, W. (2012). Addressing access barriers to health services: An analytical framework for selecting appropriate interventions in low-income Asian countries. Health Policy and Planning, 27(4), 288-300. doi: 10.1093/heapol/czr038
- Jagosh, J., Macaulay, A. C., Pluye, P., Salsberg, J., Bush, P. L., Henderson, J., [...] & Greenhalgh, T. (2012). Uncovering the benefits of participatory research: Implications of a realist review for health research and practice. The Milbank Quaterly, 90(2), 311-346. doi: 10.1111/j.1468-0009.2012.00665.x
- Kabeer, N. (1999). Resources, agency, achievements: Reflections on the measuremen of women’s empowerment. Development and Change, 30(3), 435-464. doi: 10.1111/ 1467-7660.00125
- Kane, S., Gerretsen, B., Scherpbier, R., Dal Poz, M., & Dieleman, M. (2010, October). A realist synthesis of randomised control trials involving use of community health workers for delivering child health interventions in low and middle income countries. BMC Health Services Research, 10, 286. doi: 10.1186/1472-6963-10-286
- Lacouture, A., Breton, E., Ridde, V., & Guichard, A. (2012, November). Pulling apart the population health intervention black box: the concept of ‘mechanism’ from a realist evaluation perspective. Poster session presented at the 5th European Public Health Conference: All Inclusive Public Health, Malta. doi: 10.1093/eurpub/ cks115
- Le Bossé, Y. (2003). De l’« habilitation » au « pouvoir d’agir » : vers une appréhension plus circonscrite de la notion d’empowerment. Nouvelles Pratiques Sociales, 16(2), 30-51. doi: 10.7202/009841ar
- Mansoor, K. (2003). Realist evaluation for practice. British Journal of Social Work, 33(6), 803-818. doi: 10.1093/bjsw/33.6.803
- Marchal, B., Dedzo, M., & Kegels, G. (2010). A realist evaluation of the management of a well-performing regional hospital in Ghana. BMC Health Services Research, 10, 24. doi: 10.1186/1472-6963-10-24
- Marchal, B., van Belle, S., van Olmen, J., Hoeree, T., & Kegels, G. (2012). Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research. Evaluation, 18(2), 192-212. doi: 10.1177/ 1356389012442444
- McEvoy, P., & Richard, D. (2006). A critical realist rationale for using a combination of quantitative and qualitative methods. Journal of Research in Nursing, 11(1), 66-78. doi: 10.1177/1744987106060192
- McLeroy, K. R., Bibeau, D., Steckler, A., & Glanz, K. (1988). An ecological perspective on health promotion programs. Health Education & Behavior, 15(4), 351-377. doi: 10.1177/109019818801500401
- Merton, R. K. (1968). On sociological theories of the middle range. In R. K. Merton (Ed.), Social theory and social structure (pp. 39-72). New York, NY: Free Press.
- Morin, E., & Le Moigne, J.-L. (1999). L’intelligence de la complexité. Paris, France : L’Harmattan.
- Olivier de Sardan, J.-P. (1998). Émique. L’Homme, 38(147), 151-166.
- Pawson, R. (2002). Evidence-based policy: The promise of ‘Realist Synthesis’. Evaluation, 8(3), 340-358. doi: 10.1177/135638902401462448
- Pawson, R. (2003). Nothing as practical as a good theory. Evaluation, 9(4), 471-490. doi: 10.1177/1356389003094007
- Pawson, R. (2006). Evidence-based policy. A realist perspective. London, UK: Sage Publications.
- Pawson, R. (2013). The science of evaluation: A realist manifesto. London, UK: Sage Publications.
- Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2004). Realist synthesis: An introduction. ERSC Research Methods Programme. Manchester, UK: University of Manchester.
- Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005). Realist review – a new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy, 10(S1), 21-34. doi: 10.1258/135581905430 8530
- Pawson, R., & Manzano-Santaella, A. (2012). A realist diagnostic workshop. Evaluation, 18(2), 176-191. doi: 10.1177/1356389012440912
- Pawson, R., & Tilley, N. (1997). Realistic Evaluation. London, UK: Sage Publications.
- Perdersen, L. H., & Rieper, O. (2008). Is realist evaluation a realistic approach for complex reforms? Evaluation, 14(3), 271-293. doi: 10.1177/1356389008090856
- Plante, J. (1994). Évaluation de programme. Sainte-Foy, Canada : Presses de l’Université de Laval.
- Ridde, V., Robert, E., Guichard, A., Blaise, P., & Van Holmen, J. (2011). L’approche Realist à l’épreuve du réel de l’évaluation des programmes. CJPE, 26(3), 37-59.
- Ridde, V., Robert, E., & Meessen, B. (2012). A literature review of the disruptive effects of user fee exemption policies on health systems. BMC Public Health, 12, 289. doi: 10.1186/1471-2458-12-289
- Robert, E., & Samb, O. M. (2012). Pour une cartographie des soins de santé gratuits en Afrique de l’Ouest. Afrique Contemporaine, 3(243), 100-101.
- Scotland, J. (2012). Exploring the philosophical underpinnings of research: Relating ontology and epistemology to the methodology and methods of the scientific, interpretive, and critical research paradigms. English Language Teaching, 5(9), 9-16. doi: 10.5539/elt.v5n9p9
- Smits, P., Champagne, F., & Blais, R. (2009). Propensity for participatory evaluation. International Journal of Learning, 16(6), 611-632.
- Tremblay, M. C., & Richard, L. (2011). Complexity: a potential paradigm for a health promotion discipline. Health Promot Int. doi: 10.1093/heapro/dar054
- Weiss, C. (1970). The politicization of evaluation research. Journal of Social Issues, 26(4), 57-68. doi: 10.1111/j.1540-4560.1970.tb01743.x
- Weiss, C. (1997). How Can Theory-Based Evaluation Make Greater Headway? Evaluation Review, 21(51), 501-524. doi: 10.1177/0193841X9702100405
- Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013). RAMESES publication standards: Realist syntheses. BMC Medicine, 11, 21. doi: 10.1186/1741-7015-11-21
- Wong, G., Westhorp, G., Pawson, R., & Greenhalgh, T. (2013). Realist synthesis: RAMESES training materials. Retrieved from http://www.ramesesproject.org/media/Realist_reviews_training_materials.pdf