Abstracts
Abstract
Purpose: Collaborative assessment, including two-stage exams, has been widely implemented in undergraduate education as both an assessment method and a learning strategy. In a two-stage exam, students complete an individual exam, then immediately complete the same exam in small groups. Although the benefits of two-stage exams are well supported in the literature, weighting practices can vary. This descriptive study examined systemic and individual barriers to assessment among undergraduate nursing students and explored the potential for grade inflation associated with two-stage exams.
Method: A total of 130 first- and second-year students enrolled in a collaborative undergraduate nursing program in British Columbia were recruited for the study. A pre-exam survey captured descriptive data on perceived barriers and their impact on exam performance, while a post-exam survey assessed satisfaction with two-stage exams, perceived effects on knowledge retention, and reduction of barriers. Grade inflation, a cited concern in the literature, was quantified by analyzing stage-one and stage-two exam scores across six undergraduate nursing courses using theoretical weighting scenarios.
Results: Some participants (69%) identified with at least one barrier to assessment, with the most common being test anxiety (59.2%); anxiety, stress, or mental health concerns (46.1%); and attention-deficit/hyperactivity disorder, attention deficit disorder, or Autism spectrum disorder (26.9%). Most participants (86.1%) indicated that two-stage exams helped to reduce barriers to assessment, primarily by allowing them to revisit the question (67.6%), providing them with a second chance (65.7%), and improving their understanding of the question (64.8%). Additionally, 90% (n = 97) stated that they felt better prepared to apply this knowledge in future courses or clinical settings. Perceptions of increased knowledge mastery was rated as 4.47 on a five-point scale, participant satisfaction was 4.4, and participation was 4.65. Grade inflation ranged from 0.33% for an A+ grade weighted at 90/10 to 9.63% for a D grade weighted at 75/25.
Conclusion: Findings highlight the prevalence of assessment-related barriers among nursing students and suggest that two-stage exams may help mitigate these challenges. Quantifying grade inflation across weighting scenarios provides faculty with evidence to guide decisions regarding the implementation of two-stage exams.
Keywords:
- two-stage exams,
- collaborative testing,
- nursing undergraduate education,
- assessment barriers,
- grade inflation
Résumé
Objectif : L’évaluation collaborative, y compris les examens en deux étapes, est largement mise en œuvre dans la formation de premier cycle, à la fois comme méthode d’évaluation et comme stratégie d’apprentissage. Dans un examen en deux étapes, les étudiantes et étudiants complètent d’abord un examen individuel, puis remplissent immédiatement le même examen en petits groupes. Bien que les avantages des examens en deux étapes soient documentés dans la littérature, les pratiques de pondération peuvent varier. Cette étude descriptive a examiné les obstacles systémiques et individuels liés à l’évaluation chez les étudiantes et étudiants en sciences infirmières au premier cycle, et a exploré le potentiel d’inflation des notes associé aux examens en deux étapes.
Méthode : Au total, 130 étudiantes et étudiants de première et de deuxième année inscrits à un programme collaboratif de formation infirmière de premier cycle en Colombie‑Britannique ont été recrutés pour l’étude. Un questionnaire administré avant l’examen a recueilli des données descriptives sur les obstacles perçus et leur impact sur la performance à l’examen, tandis qu’un questionnaire post‑examen a évalué la satisfaction à l’égard des examens en deux étapes, les effets perçus sur la rétention des connaissances et la réduction des obstacles. L’inflation des notes, une préoccupation relevée dans la littérature, a été quantifiée en analysant les résultats des examens de la première et de la deuxième étape dans six cours de premier cycle en sciences infirmières, selon différents scénarios théoriques de pondération.
Résultats : Certaines participantes et certains participants (69 %) ont indiqué éprouver au moins un obstacle à l’évaluation, les plus courants étant l’anxiété liée aux examens (59,2 %) ; l’anxiété, le stress ou des préoccupations de santé mentale (46,1 %) ; ainsi que le trouble du déficit de l’attention/hyperactivité, le trouble du déficit de l’attention ou un trouble du spectre de l’autisme (26,9 %). La majorité des participantes et participants (86,1 %) ont indiqué que les examens en deux étapes contribuaient à réduire les obstacles à l’évaluation, principalement en leur permettant de revenir sur la question (67,6 %), en leur offrant une deuxième chance (65,7 %) et en améliorant leur compréhension de la question (64,8 %). De plus, 90 % (n = 97) ont déclaré se sentir mieux préparés à appliquer ces connaissances dans de futurs cours ou milieux cliniques. La perception d’une maîtrise accrue des connaissances a obtenu une cote de 4,47 sur une échelle de cinq points ; la satisfaction des participantes et participants, une cote de 4,4 ; et la participation, une cote de 4,65. L’inflation des notes variait de 0,33 % pour une note A+ pondérée à 90/10 à 9,63 % pour une note D pondérée à 75/25.
Conclusion : Les résultats mettent en évidence la prévalence des obstacles liés à l’évaluation chez les étudiantes et étudiants en sciences infirmières et suggèrent que les examens en deux étapes peuvent contribuer à les atténuer. La quantification de l’inflation des notes selon différents scénarios de pondération fournit au corps professoral des données probantes pour orienter les décisions relatives à la mise en œuvre des examens en deux étapes.
Appendices
Bibliography
- Balta, J. Y., Supple, B., & O’Keeffe, G. W. (2021). The Universal Design for Learning framework in anatomical sciences education. Anatomical Sciences Education, 14(1), 71–78. https://doi.org/10.1002/ase.1992
- Bangcola, A. (2023). Ways of coping and mental health among nursing students transitioning from online learning to in-person classes in a university setting. The Malaysian Journal of Nursing, 15(1), 70–78. https://doi.org/10.31674/mjn.2023.v15i01.008
- Burgess, A., & Medina-Smuck, M. (2018). Collaborative testing using quizzes as a method to improve undergraduate nursing student engagement and interaction. Nursing Education Perspectives, 39(3), 178–179. https://doi.org/10.1097/01.nep.0000000000000223
- Caboral-Stevens, M., & Fox, D. P. (2020). The use of collaborative testing with baccalaureate nursing students. Teaching and Learning in Nursing, 15(1), 37–41. https://doi.org/10.1016/j.teln.2019.09.007
- CAST. (2024). The UDL guidelines. https://udlguidelines.cast.org
- Epstein, I., Khanlou, N., Ermel, R. E., Sherk, M., Simmonds, K. K., Balaquiao, L., & Chang, K.-Y. (2021). Students who identify with a disability and instructors’ experiences in nursing practice: A scoping review. International Journal of Mental Health and Addiction, 19(1), 91–118. https://doi.org/10.1007/s11469-019-00129-7
- Ferrell, D. K., & DeCrane, S. K. (2016). S.O.S. (students’ optimal success): A model for institutional action to support minority nursing students. Journal of Cultural Diversity, 23(2), 39–45.
- Gilley, B. H., & Clarkston, B. (2014). Collaborative testing: Evidence of learning in a controlled in-class study of undergraduate students. Journal of College Science Teaching, 43(3), 83–91. https://doi.org/10.2505/4/jcst14_043_03_83
- Helms, K. D., Keith, L. A., & Walker, L. P. (2019). Evaluating student learning through collaborative testing in a psychiatric mental health course. Journal of Doctoral Nursing Practice, 12(1), 3–9. https://doi.org/10.1891/2380-9418.12.1.3
- Kotcherlakota, S., Leeseberg Stamler, L., Clark, A., & Howell, M. C. (2024). Implementing universal design for learning in nursing education: Faculty perspectives. Teaching and Learning in Nursing, 19(1), e138–e144. https://doi.org/10.1016/j.teln.2023.10.003
- Mahoney, J. W., & Harris-Reeves, B. (2017). The effects of collaborative testing on higher order thinking: Do the bright get brighter? Active Learning in Higher Education, 20(1), 25–37. https://doi.org/10.1177/1469787417723243
- Martin, A. (2018). A quantitative framework for the analysis of two-stage exams. International Journal of Higher Education, 7(4), 33–54. https://doi.org/10.5430/ijhe.v7n4p33
- Meaders, C. L., & Vega, Y. (2023). Collaborative two-stage exams benefit students in a biology laboratory course. Journal of Microbiology & Biology Education, 24(1). https://doi.org/10.1128/jmbe.00138-22
- Murray, T. A., Pole, D. C., Ciarlo, E. M., & Holmes, S. (2016). A nursing workforce diversity project: Strategies for recruitment, retention, graduation, and NCLEX-RN success. Nursing Education Perspectives, 37(3), 138–143.
- Nicol, D., & Selvaretnam, G. (2022). Making internal feedback explicit: Harnessing the comparisons students make during two-stage exams. Assessment & Evaluation in Higher Education, 47(4), 507–522. https://doi.org/10.1080/02602938.2021.1934653
- Patiwael, J. A., Douma, A. H., Bezakova, N., Kusurkar, R. A., & Daelmans, H. E. M. (2021). Collaborative testing in physical examination skills training and the autonomous motivation of students: A qualitative study. BMC Medical Education, 21(1), Article 224. https://doi.org/10.1186/s12909-021-02618-7
- Peck, S. D., Stehle Werner, J. L., & Raleigh, D. M. (2013). Improved class preparation and learning through immediate feedback in group testing for undergraduate nursing students. Nursing Education Perspectives, 34(6), 400–404. https://doi.org/10.5480/11-507
- Peng, X., Jiang, L., Cao, D., Chen, G., Li, D., Teng, P., & Li, J. (2023). Teacher feedback-based collaborative testing improves students’ knowledge gaps of parasitology. Advances in Physiology Education, 47(2), 259–264. https://doi.org/10.1152/advan.00230.2022
- Radford, M., & Blount, C. (2023). The impact of collaborative testing on teamwork and collaboration in nursing students. International Journal of Nursing Education, 15(3), 34–36. https://doi.org/10.37506/ijone.v15i3.19569
- Rieger, G. W., & Heiner, C. E. (2014). Examinations that support collaborative learning: The students’ perspective. Journal of College Science Teaching, 43(4), 41–47. https://doi.org/10.2505/4/jcst14_043_04_41
- Riley, E., McCormack, L., Ward, N., Renteria, F., & Steele, T. (2021). 2-stage collaborative testing results in improved academic performance and student satisfaction in a prelicensure nursing course. Nurse Educator, 46(4), 261–265. https://doi.org/10.1097/nne.0000000000000934
- Saunders, A., Say, R., Visentin, D., & McCann, D. (2019). Evaluation of a collaborative testing approach to objective structured clinical examination (OSCE) in undergraduate nurse education: A survey study. Nurse Education in Practice, 35, 111–116. https://doi.org/10.1016/j.nepr.2019.01.009
- Sonmez, Y., Akdemir, M., Meydanlioglu, A., & Aktekin, M. R. (2023). Psychological distress, depression, and anxiety in nursing students: A longitudinal study. Healthcare, 11(5), 636. https://doi.org/10.3390/healthcare11050636
- Witt, A. J., Gerdin, B. J., De Haan, J. A., & Bergman, L. K. (2022). A comparison of collaborative testing and alternative test-taking methods on content retention in baccalaureate nursing students. Nursing Education Perspectives, 43(4), 243–245. https://doi.org/10.1097/01.nep.0000000000000856

