Abstracts
Résumé
La modération des résultats d’évaluation est une pratique devenue courante dans de nombreux systèmes éducatifs. Ses buts sont de renforcer l’équité des résultats entre les élèves et/ou leur comparabilité lorsque l’évaluation sert à certifier ou à sélectionner les élèves. Selon les contextes, différentes méthodes sont appliquées. Deux approches sont présentées : la modération statistique et la modération sociale. La première consiste de manière générale en une transformation statistique des résultats des élèves à l’aide d’une épreuve de calibration. La seconde est une démarche de travail collaboratif et de développement professionnel qui amène les enseignants à construire collectivement des pratiques communes d’évaluation à l’aide de standards. Cet article propose une réflexion théorique qui permet une description de ces deux approches (différentes méthodes, apports et limites) afin de les comparer. Son apport est d’actualiser cette comparaison et de dégager quels en sont les enjeux pour les différents acteurs du système scolaire. Un certain nombre de recommandations liées à leurs conditions d’utilisation sont envisagées en conclusion.
Mots-clés :
- modération,
- modération sociale,
- modération statistique,
- évaluation certificative,
- évaluation sommative,
- comparabilité,
- équité,
- développement professionnel de l’enseignant
Abstract
The moderation of evaluation results is a common practice in many educational systems. Its goals are to reinforce equity between students’ results and/or their comparability when assessment is used to certify or select students. Depending on the context, different methods are applied. Two approaches are identified: statistical moderation and social moderation. The first is generally a statistical transformation of students’ results using a calibration test. The second is a professional development and collaborative work approach that leads teachers to collectively build common evaluation practices using standards. This paper proposes a theoretical reflection that allows a description of these two approaches (their different methods, contributions and limits) in order to compare them and to identify what are the stakes for the different actors of the school system. A number of recommendations related to their conditions of use are considered in conclusion.
Keywords:
- moderation,
- social moderation,
- statistical moderation,
- certification,
- summative evaluation,
- comparability,
- equity,
- teacher professional development
Resumo
A moderação dos resultados da avaliação é uma prática comum em muitos sistemas educativos. As suas metas são as de reforçar a equidade dos resultados entre os alunos e / ou a sua comparabilidade quando a avaliação é usada para certificar ou selecionar alunos. Dependendo dos contextos, são aplicados diferentes métodos. São apresentadas duas abordagens: a moderação estatística e a moderação social. A primeira consiste geralmente numa transformação estatística dos resultados dos alunos usando um teste de calibração. A segunda é uma abordagem de trabalho colaborativo e de desenvolvimento profissional que leva os professores a construir coletivamente práticas comuns de avaliação usando standards. Este artigo propõe uma reflexão teórica que permite uma descrição dessas duas abordagens (diferentes métodos, contribuições e limites) para compará-las. A sua contribuição é a de atualizar essa comparação e identificar quais são os desafios para os diferentes atores no sistema educativo. Conclui-se com uma série de recomendações relacionadas com as suas condições de utilização.
Palavras chaves:
- moderação,
- moderação social,
- moderação estatística,
- avaliação certificativa,
- avaliação sumativa,
- comparabilidade,
- equidade,
- desenvolvimento profissional de professores
Appendices
Références
- Adie, L. (2014). The development of shared understandings of assessment policy: Travelling between global and local contexts. Journal of Education Policy, 24(4), 532-545. doi: 10.1080/02680939.2013.853101
- Adie, L. E., Klenowski, V., & Wyatt-Smith, C. (2012). Towards an understanding of teacher judgement in the context of social moderation. Educational Review, 64(2), 223-240. doi: 10.1080/00131911.2011.598919
- Allal, L., & Mottier Lopez, L. (2014). Teachers’ professional judgment in the context of collaborative assessment practice. In C. Wyatt-Smith, V. Klenowski & P. Colbert (Eds.). Designing assessment for quality learning (pp. 151-165). London: Springer.
- Board of Studies, Teaching & Educational Standards NSW. (2011). Explanation of aligning and moderating procedures for the Higher School Certificate. Sydney: New South Wales Education Standards Authority. Retrieved from www.boardofstudies.nsw.edu.au/hsc-results/moderation.html
- Burton, E., & Linn, R. L. (1994). Comparability across assessments: Lessons from the use of moderation procedures in England. Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing (CRESST).
- Cardinet, J., Johnson, S., & Pini, G. (2010). Applying generalizability theory using EduG. New York: Routledge.
- Colbert, P., Wyatt-Smith, C., & Klenowski, V. (2012). A systems-level approach to building sustainable assessment cultures: Moderation, quality task design and dependability of judgement. Policy Futures in Education, 10(4), 386-401. doi: 10.2304/pfie.2012.10.4.386
- Earl, L. (2003). Assessment as learning: Using classroom assessment to maximize student learning. Thousand Oaks, CA: Corwin Press.
- Elley, W. B., & Livingstone, I. D. (1972). External examinations and internal assessments. Wellington: NZCER.
- Harlen, W. (2007). Assessment of learning. London: SAGE Publications.
- Hong Kong Examinations and Assessment Authority (HKEAA). (2010). Moderation of school-based assessment scores in the HKDSE. Hong Kong: HKEAA. Retrieved from www.hkeaa.edu.hk/DocLibrary/Media/Leaflets/HKDSE-SBA-ModerationBooklet_r.pdf
- Johnson, S. (2011). A focus on teacher assessment reliability in GCSE and GCE. Coventry, UK: Office of Qualifications and Examinations Regulation.
- Kim, S.-H., & Cohen, A. S. (2002). A comparison of linking and concurrent calibration under the graded response model. Applied Psychological Measurement, 26, 25-41. doi: 10.1177/0146621602026001002
- Klenowski, V., & Wyatt-Smith, C. (2010). Standards, teacher judgement and moderation in contexts of national curriculum and assessment reform. Assessment Matters, 2, 107-131. Retrieved from http://researchbank.acu.edu.au/fea_pub/583
- Laveault, D. (2009a). L’évaluation en classe : des politiques aux pratiques. Mesure et évaluation en éducation, 32(3), 1-22. doi: 10.7202/1024929ar
- Laveault, D. (2009b). L’amélioration de l’efficacité du système éducatif : sur quels indicateurs s’appuyer ? Dans X. Dumay & V. Dupriez (dir.), L’efficacité dans l’enseignement : promesses et zones d’ombre (pp. 177-196). Bruxelles : De Boeck.
- Laveault, D. & Grégoire, J. (2014). Introduction aux théories des tests en psychologie et en sciences de l’éducation (3e éd.). Bruxelles : De Boeck.
- Linn, R. L. (1993). Linking results of distinct assessments. Applied Measurement in Education, 1(1), 83-102. doi: 10.1207/s15324818ame0601_5
- Looney, J. W. (2011). Alignment in complex education systems: Achieving balance and coherence. OECD Education Working Papers, 64. doi: 10.1787/5kg3vg5lx8r8-en
- Matters, G. (2006). Statistical moderation and social moderation around Australia. Paper presented at the 32nd Annual Conference of the International Association for Educational Assessment, Singapore. Retrieved from https://works.bepress.com/gabrielle_matters/42
- Maxwell, G. S. (2001). Moderation of assessments in vocational education and training. Brisbane: Queensland Government Departement of Employment and Training.
- Maxwell, G. S. (2007). Implications for moderation of proposed changes to senior secondary school syllabuses. Brisbane: Queensland Studies Authority.
- Ministère de l’Éducation de l’Ontario (MEO). (2007). Harmonisation de l’évaluation : une collaboration pour évaluer de façon cohérente et équitable le travail des élèves. Toronto : Gouvernement de l’Ontario, Secrétariat de la littératie et de la numératie. Repéré à www.edu.gov.on.ca/fre/literacynumeracy/inspire/research/Teacher_Moderation_fr.pdf
- Ministère de l’Éducation de l’Ontario (MEO). (2010). Faire croître le succès : évaluation et communication du rendement des élèves fréquentant les écoles de l’Ontario (1re éd.). Toronto : Gouvernement de l’Ontario. Repéré à www.edu.gov.on.ca/fre/policyfunding/growSuccessfr.pdf
- Ministère de l’Éducation, du Loisir et du Sport (MELS). (2011). Sanction des études. Québec : Gouvernement du Québec, Direction de la sanction des études.
- Ministère de l’Éducation, du Loisir et du Sport (MELS). (2015). Guide de gestion – Édition 2015 : Sanction des études et épreuves ministérielles – Formation générale des jeunes ; formation générale des adultes ; formation professionnelle. Québec : Gouvernement du Québec. Repéré à www.education.gouv.qc.ca/fileadmin/site_web/documents/dpse/sanction/Guide-sanction-2015_fr.pdf
- Ministère de l’Éducation, du Loisir et du Sport (MELS). (2016). Examens et épreuves : conversion et modération. Québec : Gouvernement du Québec. Repéré à www.education.gouv.qc.ca/eleves/examens-et-epreuves/traitement-des-resultats/conversion-et-moderation
- Mislevy, R. J. (1992). Linking educational assessments: Concepts, issues, methods and prospects. Princeton, NJ: Educational Testing Service.
- Mottier Lopez, L., & Pasquini, R. (2017). Professional controversies between teachers about their summative assessment practices: A tool for building assessment capacity. Assessment in Education: Principles, Policy & Practice, 24(2), 228-249. doi: 10.1080/0969594X.2017.1293001
- Mottier Lopez, L., Tessaro, W., Dechamboux, L. & Villabona, F. M. (2012). La modération sociale : un dispositif soutenant l’émergence de savoirs négociés sur l’évaluation certificative des apprentissages des élèves. Questions vives : Recherches en éducation, 6(18), 159-175. doi: 10.4000/questionsvives.1235
- Nusche, D., Laveault, D., MacBeath, J., & Santiago, P. (2012). OECDReviews of evaluation and assessment in education: New Zealand 2011. Paris: OECD Publishing. doi: 10.1787/9789264116917-en
- Queensland Studies Authority (QSA). (2007). September 2007 trial common assessment task: Teacher guidelines. Brisbane: QSA.
- Wilmut, J., & Tuson, J. (2005). Statistical moderation of teacher assessments: A report to the Qualifications and Curriculum Authority. London: Qualifications and Curriculum Authority.
- Wilson, M. (2004). Assessment, accountability and the classroom: A community of judgment. Yearbook of the National Society for the Study of Education, 103(2), 1-19. doi: 10.1111/j.1744-7984.2004.tb00046.x
- Wyatt-Smith, C., & Colbert, P. (2014). An account of the inner workings of standards, judgement and moderation: A previously untold evidence-based narrative. Brisbane: Australian Catholic University. Retrieved from http://research.acer.edu.au/cgi/viewcontent.cgi?article=1006&context=qld_review
- Wyatt-Smith, C., Klenowski, V., & Gunn, S. (2010). The centrality of teachers’ judgement practice in assessment: A study of standards in moderation. Assessment in Education: Principles, Policy & Practice, 17(1), 59-75. doi: 10.1080/09695940903565610
- Yerly, G. (2017). Évaluation des apprentissages en classe et évaluation à large échelle: quel est l’impact des épreuves externes sur les pratiques évaluatives des enseignants ? Mesure et évaluation en éducation, 40(1), 33-60.