Résumés
Résumé
Cette recherche porte sur les différences individuelles entre élèves lorsque ceuxci utilisent des échelles descriptives pour évaluer une production complexe. Plus précisément, elle a cherché à déterminer quelles caractéristiques du jugement de l’élève, pour ce qui est de la précision, de la sévérité et de la confiance, affectent leur rendement en écriture. La précision du jugement s’est avérée le meilleur prédicteur du rendement en écriture. Des différences importantes quant à l’habileté avec laquelle les élèves des groupes talentueux, doués ou en difficulté d’apprentissage utilisent les échelles descriptives ont également été observées. Même si les filles obtiennent de meilleures notes que les garçons à l’écrit, les différences entre les deux groupes quant à la précision, à la sévérité et à la confiance du jugement ne sont pas significatives. La comparaison des groupes francophone et anglophone au moyen des régressions multiples séparées indique que la compréhension des échelles descriptives contribue de la même manière au rendement en écriture dans chacun des groupes. Le degré de confiance, toutefois, s’est révélé significativement plus bas chez les francophones. Il n’y pas eu d’amélioration significative dans la capacité à évaluer des textes écrits entre la 5e et la 8e année. La recherche conclut en soulignant l’importance des dimensions socioaffectives du jugement de l’élève dans l’utilisation d’échelles descriptives.
Mots-clés :
- Évaluation par des pairs,
- autoévaluation,
- échelle descriptive,
- performance complexe,
- copie type,
- différences individuelles,
- écriture
Abstract
The purpose of this research was to study individual differences among students using rating scales (“rubrics”) to assess a complex performance. More precisely, we tried to determine which characteristics of a student’s judgment in terms of accuracy, severity and confidence have an impact on writing achievement. Accuracy was found to be the best predictor of writing achievement. Several important differences in the students’ ability to use rating scales were found among students with learning difficulties, gifted and talented students. Despite the fact that girls usually had better marks in writing, no differences were found between boys and girls as far as accuracy, severity and confidence were concerned. Multiple regressions on francophone and anglophone students’ results indicated that rating scales contributed in the same way to writing achievement in both groups. Degree of confidence in one’s assessment of a peer’s writing was significantly lower among francophones. No significant improvement in judgment accuracy was found from grade 5 to grade 8. The research concludes by stressing the importance of socio-affective aspects of a student’s judgment in the use of rating scales.
Keywords:
- Peer assessment,
- self-assessment,
- rating scales,
- complex performance,
- exemplar,
- individual differences,
- writing
Resumo
Esta investigação incide nas diferenças individuais entre alunos quando estes utilizam escalas descritivas para avaliar uma produção complexa. Mais precisamente, procurou determinar quais as categorias do juízo do aluno, em termos de precisão, de severidade e de confiança, que afectam o seu rendimento na escrita. A precisão do juízo revelou-se o melhor indicador de rendimento, na escrita. Observaram-se, também, diferenças significativas, relativas à capacidade dos alunos muito bons, bons ou com dificuldades de aprendizagem para utilizar escalas descritivas. Apesar de as raparigas, na escrita, alcançarem melhores classificações do que os rapazes, as diferenças entre os dois grupos, relativas à precisão, à severidade e à confiança do juízo não são significativas. A comparação entre os grupos de alunos francófonos e angloxaxónicos, por meio de regressões múltiplas separadas, revela que a compreensão de escalas descritivas contribui, em ambos os grupos, para o rendimento na escrita. Contudo, o grau de confiança revelou-se significativamente mais baixo junto dos alunos francófonos. Não houve melhorias significativas na capacidade de avaliar os textos escritos entre o 5º e o 8º anos. A investigação conclui pela importância das dimensões socio-afectivas do juízo do aluno na utilização de escalas descritivas.
Palavras chaves:
- Avaliação pelos pares,
- auto-avaliação,
- escala descritiva,
- desempenho complexo,
- teste-modelo,
- diferenças individuais,
- escrita
Parties annexes
Références
- Allal, L. (1999). Impliquer l’apprenant dans le processus d’évaluation: promesses et pièges de l’autoévaluation. In C. Depover & B. Noël (éds), L’évaluation des compétences et des processus cognitifs. Bruxelles: DeBoeck-Université.
- Allal, L, (2007). Régulations des apprentissages: orientations conceptuelles pour la recherche et la pratique en éducation. In L. Allal & L. Mottier Lopez (éds), Régulation des apprentissages en situation scolaire et en formation (pp. 7-23). Bruxelles: De Boeck.
- Beaman, R. (1998). The unquiet... even loud andragogy. Alternative assessments for adult learners. Innovative Higher Education, 23(1), 47-59.
- Bergee, M.J. (1997). Relationships among faculty, peer and self-evaluations of applied performances. Journal of Research in Music Education, 45(4), 601-612.
- Bishop, N. (1994). Grading actors. A student evaluation based on effort and improvement. Teaching Theatre, 5(2), 3-7.
- Bressoux, P., & Pansu, P. (2003). Quand les enseignants jugent leurs élèves. France: PUF.
- Church, A.H. (1997). Do you see what I see? An exploration of congruence in ratings from multiple perspectives. Journal of Applied Social Psychology, 27(11), 983-1020.
- Fallows, S., & Chandramohan, B. (2001). Multiple approaches to assessment: reflections on use of tutor, peer and self-assessment. Teaching in Higher Education, 6(2), 229-245. Howell, D.C. (1998). Méthodes statistiques en sciences humaines. Bruxelles: ITP/De Boeck.
- Laveault, D. (2007). De la régulation au réglage: étude des dispositifs d’évaluation favorisant l’autorégulation des apprentissages. In L. Allal & L. Mottier Lopez (éds), Régulation des apprentissages en situation scolaire et en formation (pp. 207-234). Bruxelles: De Boeck.
- Laveault, D., & Miles, C. (2006). Educational indicators of two Language Arts curricula conceptual equivalence. Bruxelles: International Test Commission.
- Liu, E.Z., Lin, S.S.J., & Yuan, S.M. (2002). Alternatives to instructor assessment: A case study of comparing self and peer assessment with instructor assessment under a networked innovative assessment procedures. International Journal of instructional Media, 29(4), 393-404.
- McCurdy, B.L., & Shapiro, E.S. (1992). A comparison of teacher-, peer- and selfmonitoring with curriculum-based measurement in reading among students with learning difficulties. The Journal of Special Education, 26(2), 162-180.
- Miller, PJ. (2003). The effect of scoring criteria specificity on peer and self-assessment. Assessment & Evaluation in Higher Education, 28(4), 383-394.
- Ministère de l’Éducation de l’Ontario (1997). Le curriculum de l’Ontario de la 1re à la 8e année - Français. Toronto: Auteur.
- Ministère de l’Éducation de l’Ontario (1999). Le curriculum de l’Ontario: Copies types de la 1re à la 8e année - Écriture. Toronto: Auteur.
- Ministère de l’Éducation du Québec (2001). Programme de formation de l’école québécoise. Éducation préscolaire et enseignement primaire. Québec: Auteur.
- Ministère de l’Éducation du Québec (2003). Politique d’évaluation des apprentissages. Québec: Auteur.
- Orsmond, P., Merry, S., & Reiling, K. (1997). A study in self-assessment: tutor and students’ perceptions of performance criteria. Assessment & Evaluation in Higher Education, 22(4), 357-369.
- Orsmond, P., Merry, S., & Reiling, K. (2000). The use of student derived marking criteria in peer and self-assessment. Assessment & Evaluation in Higher Education, 25(1), 23-38.
- Orsmond, P., Merry, S., & Reiling, K. (2002). The use of exemplars and formative feedback when using student derived marking criteria in peer and self-assessment. Assessment & Evaluation in Higher Education, 27(4), 309-323.
- Siegel, S., & Castellan, N.J. (1988). Nonparametric Statistics for the Behavioral Sciences (2e édition). New York: McGraw-Hill.
- Somervell, H. (1993). Issues in assessment, enterprise and higher education: the case for self-, peer and collaborative assessment. Assessment & Evaluation in Higher Education, 18(3), 221-233.
- Stiggins, R.J., Arter, J.A., Chappuis, J., & Chappuis, S. (2004). Classroom Assessment for Student Learning. Doing it right - Using it Well. Portland (Oregon): Assessment Training Institute.