Abstracts
Abstract
Background: Educators have recently been compelled to incorporate more active instructional formats into medical education, such as problem-based learning (PBL). In view of the mixed outcome data on the use of PBL in postgraduate medical education (PGME), there is a need to synthesize the data to inform the application of PBL in PGME contexts.
Objective: The aim of this systematic review and meta-analysis was to synthesize learning outcomes of PBL in PGME contexts.
Methods: The authors systematically searched MEDLINE, Embase, APA PsycINFO, AMED, CINAHL, Web of Science, ERIC, and Cochrane databases from January 1, 1950, to July 1, 2022 for original studies that reported Kirkpatrick outcomes of PBL in PGME contexts. Outcomes data were extracted. Quantitative data relating to learning outcomes were meta-analyzed using a random-effects model to generate weighted mean differences.
Results: Of 4310 abstracts screened, the authors included 21 studies encompassing anesthesia, family medicine, internal medicine, occupational medicine, pediatrics, psychiatry, public health and surgical residency programs. The studies reported reaction (n = 12), learning (n = 15), behavioural (n = 6) and/or results outcomes (n = 4). Meta-analysis of the three eligible articles demonstrated no significant difference after PBL in pre- and post-test results (pooled mean difference=0.13%, 95% CI, -6.74–7.00). There were observed improvements in satisfaction levels and self-reported behavioural outcomes following PBL.
Conclusions: Although similar learning outcomes were observed using PBL and the usual teaching in PGME, PBL was associated with benefits in trainee satisfaction and behavioural changes that contribute to learning and performance. PGME programs should consider incorporating PBL into curricula.
Résumé
Contexte : Les éducateurs doivent maintenant incorporer des formats pédagogiques plus actifs dans l'enseignement médical, tels que l'apprentissage par problèmes (APP). Compte tenu des données mitigées concernant l'utilisation l’APP dans la formation médicale postuniversitaire, il est nécessaire de synthétiser l’état des connaissances à cet effet, afin d'éclairer l'application de l’APP dans les contextes de formation médicale postuniversitaire.
Objectif : L'objectif de cette revue systématique et de cette méta-analyse était de synthétiser les travaux concernant l’APP effectués dans les contextes de formation médicale postdoctorale.
Méthodes : Les auteurs ont effectué des recherches systématiques dans les bases de données MEDLINE, Embase, APA PsycINFO, AMED, CINAHL, Web of Science, ERIC et Cochrane entre le 1er janvier 1950 et le 1er juillet 2022 pour identifier les études originales faisant état du niveau d’apprentissage basé sur le modèle de Kirkpatrick concernant l’APP dans des contextes de formation médicale postdoctorale. Les données relatives aux résultats ont été extraites. Les données quantitatives relatives aux niveau d'apprentissage ont été méta-analysées à l'aide d'un modèle à effets aléatoires afin de générer des différences de moyennes pondérées.
Résultats : Sur les 4 310 résumés examinés, les auteurs ont inclus 21 études portant sur des programmes de résidence en anesthésie, en médecine familiale, en médecine interne, en médecine du travail, en pédiatrie, en psychiatrie, en santé publique et en chirurgie. Les études ont fait état des réactions (n = 12), de l'apprentissage (n = 15), du comportement (n = 6) et/ou des résultats (n = 4). La méta-analyse des trois articles admissibles n'a pas montré de différence significative après l'APP dans les résultats pré- et post-test (différence moyenne regroupée = 0,13 %, IC à 95 %, -6,74-7,00). Des améliorations ont été observées dans les niveaux de satisfaction et les résultats comportementaux autodéclarés à la suite de l'APP.
Conclusions : Bien que des résultats reliés à l'apprentissage similaires aient été observés en utilisant l'APP comparativement à l'enseignement habituel dans le cadre de la formation médicale postdoctorale, l'APP a été associé à des avantages en termes de satisfaction des apprenants et de changements de comportement qui contribuent à l'apprentissage et au rendement. Les programmes d’éducation médicale postdoctoraux devraient envisager d'intégrer l’APP dans les programmes d'études.
Appendices
Bibliography
- Prober CG, Khan S. Medical education reimagined: A call to action. Acad Med. 2013;88(10):1407–10. https://doi.org/10.1097/ACM.0b013e3182a368bd
- Prober CG, Heath C. Lecture halls without lectures — a proposal for medical education. N Engl J Med.2012 May 3;366(18):1657–9. https://doi.org/10.1056/NEJMp1202451
- Trullàs JC, Blay C, Sarri E, Pujol R. Effectiveness of problem-based learning methodology in undergraduate medical education: a scoping review. BMC Med Ed 2022 22:1 2022 Feb 17;22(1):1–12. https://doi.org/10.1186/s12909-022-03154-8
- Al-azri H, Ratnapalan S. Problem-based learning in continuing medical education L ’ apprentissage par problèmes en éducation médicale continue. Can Fam Phys. 2014;60:157–65.
- Donner RS, Bickley H. Problem-based learning: an assessment of its feasibility and cost. Hum Pathol. 1990;21(9):881–5. https://doi.org/10.1016/0046-8177(90)90170-A
- Trullàs JC, Blay C, Sarri E, Pujol R. Effectiveness of problem-based learning methodology in undergraduate medical education: a scoping review. BMC Med Educ. 2022;22(1):1–12. https://doi.org/10.1186/s12909-022-03154-8
- Albanese MA, Mitchell S. Problem-based learning: a review of literature on its outcomes and implementation issues. Acad Med 1993 Jan;68(1):52–81. https://doi.org/10.1097/00001888-199301000-00012.
- Suliman S, Al-Mohammed A, Al Mohanadi D, et al. It is all about patients’ stories: case-based learning in residents’ education. Qatar Med J. 2019:17. http://dx.doi.org/10.5339/qmj.2019.17
- Smits PB, de Buisonjé CD, Verbeek JH, van Dijk FJ, Metz JC, ten Cate OJ. Problem-based learning versus lecture-based learning in postgraduate medical education. Scand J Work Environ Health. 2003;29(4):280–7. https://doi.org/10.5271/sjweh.732
- Santos‐Gomez L, Kalishman S, Rezler A, Skipper B, Mennin SP. Residency performance of graduates from a problem-based and a conventional curriculum. Med Educ.1990 Jul 1;24(4):366–75. https://doi.org/10.1111/j.1365-2923.1990.tb02453.x.
- Albanese MA, Mitchell S. Problem-based learning: a review of literature on its outcomes and implementation issues. Acad Med. 1993/01/01. 1993;68(1):52–81. https://doi.org/10.1097/00001888-199301000-00012
- Hakim A, Gibson R, Johansson L. Problem-based learning as a tool in postgraduate medical education. Euro Resp J. 2017 Sep 1;50(suppl 61):PA2770. https://doi.org/10.1183/1393003.congress-2017.PA2770.
- Hurst JW. The overlecturing and underteaching of clinical medicine. Arch Intern Med. 2004;164(15):1605. https://dx.doi.org/10.1001/archinte.164.15.1605
- Graffam B. Active learning in medical education: strategies for beginning implementation. Med Teach. 2007 Feb;29(1):38-42. https://doi.org/10.1080/01421590601176398.
- Karunathilake I. Role of Problem-Based Learning (PBL) in postgraduate medical education. J Postgraduate Inst Med. 2019 Jul 31;6(1):91. https://doi.org/10.4038/jpgim.8255
- Zhao W, He L, Deng W, Zhu J, Su A, Zhang Y. The effectiveness of the combined problem-based learning (PBL) and case-based learning (CBL) teaching method in the clinical practical teaching of thyroid disease. BMC Med Educ. 2020;20(1). https://dx.doi.org/10.1186/s12909-020-02306-y
- Albanese M. Problem-based learning: why curricula are likely to show little effect on knowledge and clinical skills. Med Educ. 2000 Sep;34(9):729–38. https://doi.org/10.1046/j.1365-2923.2000.00753.x
- Covidence. Veritas Health Innovation.
- Emily Jones M. Lib guides: creating a PRISMA flow diagram: new. PRISMA. 2020;
- Cook DA, Reed DA. Appraising the quality of medical education research methods: the medical education research study quality instrument and the Newcastle–Ottawa scale-education. Acad Med. 2015;90(8):1067–76. https://doi.org/10.1097/ACM.0000000000000786
- StataCorp L. Stata statistical software: Release 15 (2017). College Station, TX: StataCorp LP. 2017;
- Smidt A, Balandin S, Sigafoos J, Reed VA. The Kirkpatrick model: A useful tool for evaluating training outcomes. J Intellect Dev Disabil. 2009;34(3):266–74. https://doi.org/10.1080/13668250903093125
- Heading GS, Fuller JD, Lyle DM, Madden DL. Using problem-based learning in public health service based training. N S W Public Health Bull. 2007;18(1–2):8–13. https://doi.org/10.1071/NB07008
- Sass P, Edelsack P. Teaching community health assessment skills in a problem-based format. Acad Med. 2001;76(1):88–91. https://doi.org/10.1097/00001888-200101000-00023
- Cook DA, Thompson WG, Thomas KG, Thomas MR. Lack of interaction between sensing-intuitive learning styles and problem-first versus information-first instruction: a randomized crossover trial. Adv Health Sci Ed. 2009;14(1):79–90. https://doi.org/10.1007/s10459-007-9089-8
- Foley RP, Levy J, Russinof HJ, Lemon MR. Planning and implementing a problem-based learning rotation for residents. Teach Learn Med. 1993;5(2):102–6. https://doi.org/10.1080/10401339309539600
- Goodyear HM. Problem based learning in a junior doctor teaching programme. Arch Dis Child. 2005;90(3):275–8. https://doi.org/10.1136/adc.2003.037630
- Ozuah PO, Curtis J, Stein REK. Impact of problem-based learning on residents’ self-directed learning. 2001;155(June):669–73. https://doi.org/10.1001/archpedi.155.6.669
- Heru AM. Teaching psychosomatic medicine using problem-based learning and role-playing. Acad Psych. 2011;35(4):245–8. https://doi.org/10.1176/appi.ap.35.4.245
- Schultz-Ross RA, Kline AE. Using problem-based learning to teach forensic psychiatry. Acad Psych. 1999;23(1):37–41. https://doi.org/10.1007/BF03340034
- Shefet D, Levkovitz Y. A national educational interactive conference for psychiatry residents in Israel. Acad Psychiatry 2011 Nov 1;35(6):419–20. https://doi.org/10.1176/appi.ap.35.6.419
- Nguyen L, Brunicardi FC, Dibardino DJ, Scott BG, Awad SS, Bush RL, et al. Education of the modern surgical resident: Novel approaches to learning in the era of the 80-hour workweek. World J Surg. 2006;30(6):1120–7. https://doi.org/10.1007/s00268-005-0038-5
- Yates WR, Gerdes TT. Problem-Based Learning in Consulttion. Gen Hosp Psychiatry. 1996;1638343(96):139–44. https://doi.org/10.1016/0163-8343(96)00022-9
- Prislin MD, Lenahan P, Shapiro J, Radecki S. Family practice residency behavioral science training: influence on graduate practice activity. Fam Med. 1997;29(7):483–7. Available from: http://www.ncbi.nlm.nih.gov/pubmed/9232409
- Lee L, Brunicardi FC, Scott BG, et al. Impact of a novel education curriculum on surgical training within an academic training program. J Surg Res. 2008;145(2):308–12. https://doi.org/10.1016/j.jss.2007.03.046
- Mulder SF, Bleijenberg G, Verhagen SC, Stuyt PMJ, Schijven MP, Tack CJ. Improved competence after a palliative care course for internal medicine residents. Palliat Med. 2009;23(4):360–8. https://doi.org/10.1177/0269216308100250
- Carrero E, Gomar C, Penzo W, Rull M. Comparison between lecture-based approach and case/problem-based learning discussion for teaching pre-anaesthetic assessment. Eur J Anaesthesiol. 2007;24(12):1008–15. https://doi.org/10.1017/S0265021506002304
- Komasawa N, Berg BW, Minami T. Problem-based learning for anesthesia resident operating room crisis management training. PLoS One. 2018;13(11):1–10. https://doi.org/10.1371/journal.pone.0207594
- Grol R, Mokkink H, Helsper‐Lucas A, Tielens V, Bulte J. Effects of the vocational training of general practice consultation skills and medical performance. Med Educ. 1989;23(6):512–21. https://doi.org/10.1111/j.1365-2923.1989.tb01577.x
- Rodrigues de Oliveira Filho G, Schonhorst L. Problem-based learning implementation in an intensive course of anaesthesiology: a preliminary report on residents’ cognitive performance and perceptions of the educational environment. Med Teach. 2005;27(4):382–4. https://doi.org/10.1080/01421590500151021
- Sakai T, Karausky PL, Valenti SL, Sandusky SL, Hirsch SC, Xu Y. Use of a problem-based learning discussion format to teach anesthesiology residents research fundamentals. J Clin Anesth. 2013 Sep;25(6):434–8. https://doi.org/10.1016/j.jclinane.2013.04.008
- Schmidt HG. Problem-based learning: rationale and description. Med Educ. 1983 Jan;17(1):11–6. https://doi.org/10.1111/j.1365-2923.1983.tb01086.x
- Itani KMF, Miller CC, Church HM, McCollum CH. Impact of a problem-based learning conference on surgery residents’ in training exam (ABSITE) scores. J Surg Res. 1997;70(1):66–8. https://doi.org/10.1006/jsre.1997.5112
- Gruppen LD, Stansfield RB, Zhao Z, Sen S. Institution and specialty contribute to resident satisfaction with their learning environment and workload. Acad Med. 2015 Nov;90(11 Suppl):S77-82. https://doi.org/10.1097/ACM.0000000000000898
- Thrush CR, Hicks EK, Tariq SG, et al. Optimal learning environments from the perspective of resident physicians and associations with accreditation length. Acad Med. 2007 Oct;82(10 Suppl):S121-5. https://doi.org/10.1097/ACM.0b013e318140658f
- Cook DA, West CP. Perspective: Reconsidering the focus on “outcomes research” in medical education: a cautionary note. Acad Med. 2013 Feb;88(2):162–7. https://doi.org/10.1097/ACM.0b013e31827c3d78
- Dweck C. Self-theories, their role in motivation, personality and development. Philadelphia, PA: Pyschology Press; 2000.
- Newman M, Van Den Bossche P, et al. Responses to the pilot systematic review of problem-based learning. Med Educ. 2004;38(9):921–3. https://doi.org/10.1111/j.1365-2929.2004.01943.x.
- Verma AA, Pasricha S V, Jung HY, et al. Assessing the quality of clinical and administrative data extracted from hospitals: the General Medicine Inpatient Initiative (GEMINI) experience. J Am Med Inform Assoc . 2021 Mar 1;28(3):578–87. https://doi.org/10.1093/jamia/ocaa225
- Gonzalez ML, Salmoni AJ. Online problem-based learning in postgraduate medical education - content analysis of reflection comments. Teach Higher Educ. 2008;13(2):183–92. https://doi.org/10.1080/13562510801923302.