Abstracts
Abstract
There is a noticeable growth in the number of systematic reviews published in open, distance, and digital education (ODDE), with a growing focus on flipped teaching and learning, particularly in higher education, emphasizing the need to consolidate evidence and findings under one comprehensive review. This umbrella review aims to thoroughly understand the current state of flipped learning in higher education and pinpoint research gaps, analyzing 23 systematic reviews published between 2018 and 2022 from three international databases: Web of Science, Education Source, and Scopus. It delves into publication and authorship patterns while synthesizing key insights. The thematic scope of the reviews reveals that many were focused on the effectiveness of flipped learning and teaching interventions, as well as learning design. The review explored theories guiding practice and research, instructional design considerations, and the application of flipped classrooms in various fields of study. It also examined the reported challenges of the flipped classroom model. As there are a scarcity of theoretical frameworks and a lack of detailed information on the pedagogical challenges of this model, recommendations are presented to enhance research and practice of flipped teaching and learning. The results of this umbrella review provide valuable insights to guide research in future and improve the quality of systematic reviews in the field of ODDE in general and flipped teaching and learning in particular.
Keywords:
- Flipped Learning,
- higher education,
- umbrella review,
- systematic review
Appendices
Bibliography
- Akçayır, G., & Akçayır, M. (2018). The flipped classroom: A review of its advantages and challenges. Computers & Education, 126, 334–345. https://doi.org/10.1016/j.compedu.2018.07.021
- Aromataris, E., Fernandez, R. S., Godfrey, C., Holly, C., Khalil, H., & Tungpunkom, P. (2014). Methodology for JBI umbrella reviews. In Joanna Briggs Institute Reviewers’ Manual: 2014 Edition, Supplement (pp. 1–34). The Joanna Briggs Institute. https://ro.uow.edu.au/articles/chapter/Methodology_for_JBI_umbrella_reviews/27794958?file=50564202
- *Arslan, A. (2020). A systematic review on flipped learning in teaching English as a foreign or second language. Journal of Language and Linguistic Studies, 16(2), 775–797. https://doi.org/10.17263/jlls.759300
- Bagley, S. (2020). The flipped classroom, lethal mutations, and the didactical contract: A cautionary tale. PRIMUS, 30(3), 243–260. https://doi.org/10.1080/10511970.2018.1555196
- *Baltacı, H. S. (2022). A snapshot of flipped instruction in English Language teaching in Turkiye: A systematic review. Turkish Online Journal of Distance Education, 23(4), 255–269. https://doi.org/10.17718/tojde.1182793
- *Banks, L., & Kay, R. (2022). Exploring flipped classrooms in undergraduate nursing and health science: A systematic review. Nurse Education in Practice, 64, Article 103417. https://doi.org/10.1016/j.nepr.2022.103417
- Bergmann, J., & Sams, A. (2012). Flip Your Classroom: Reach Every Student in Every Class Every Day (pp. 120-190). Washington DC: International Society for Technology in Education.
- Betihavas, V., Bridgman, H., Kornhaber, R., & Cross, M. (2016). The evidence for “flipping out”: A systematic review of the flipped classroom in nursing education. Nurse Education Today, 38, 15–21. https://doi.org/10.1016/j.nedt.2015.12.010
- Birgili, B., Seggie, F. N., & Oğuz, E. (2021). The trends and outcomes of flipped learning research between 2012 and 2018: A descriptive content analysis. Journal of Computers in Education, 8(1), 365–394. https://doi.org/10.1007/s40692-021-00183-y
- Bishop, J. L., & Verleger, M. A. (2013). The flipped classroom: A survey of the research. In 2013 ASEE annual conference and exposition, Conference proceedings. American Society for Engineering Education. https://www.researchgate.net/publication/285935974_The_flipped_classroom_A_survey_of_the_research
- Bond, M. (2020). Facilitating student engagement through the flipped learning approach in K–12: A systematic review. Computers & Education, 151, Article 103819. https://doi.org/10.1016/j.compedu.2020.103819
- Borah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A. (2017). Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry. BMJ Open, 7(2), Article e012545. https://doi.org/10.1136/bmjopen-2016-012545
- Braun V., & Clarke V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2),77–101. https://doi.org/10.1191/1478088706qp063oa
- Bredow, C. A., Roehling, P. V., Knorp, A. J., & Sweet, A. M. (2021). To flip or not to flip? A meta-analysis of the efficacy of flipped learning in higher education. Review of Educational Research, 91(6), 878–918. https://doi.org/10.3102/00346543211019122
- Brunton, J., & Thomas, J. (2012). Information management in systematic reviews. In D. Gough, S. Oliver, & J. Thomas (Eds.), An introduction to systematic reviews (pp. 83–106). SAGE.
- *Cevikbas, M., & Kaiser, G. (2022a). Can flipped classroom pedagogy offer promising perspectives for mathematics education on pandemic-related issues? A systematic literature review. ZDM Mathematics Education, 55(1), 177–191. https://doi.org/10.1007/s11858-022-01388-w
- *Cevikbas, M., & Kaiser, G. (2022b). Promoting personalized learning in flipped classrooms: A systematic review study. Sustainability, 14(18), Article 11393. https://doi.org/10.3390/su141811393
- Crompton, H., Burke, D., & Gregory, K. H. (2017). The use of mobile learning in PK–12 education: A systematic review. Computers & Education, 110, 51–63. https://doi.org/10.1016/j.compedu.2017.03.013
- *Divjak, B., Rienties, B., Iniesto, F., Vondra, P., & Žižak, M. (2022). Flipped classrooms in higher education during the COVID-19 pandemic: Findings and future research recommendations. International Journal of Educational Technology in Higher Education, 19, Article 9. https://doi.org/10.1186/s41239-021-00316-4
- El Gamal, H. (2022). Is flipped approach a panacea? A systematic review of trends, conceptions, and practices of a decade of research. Asian Journal of Distance Education, 17(2),153-180. https://doi.org/10.5281/zenodo.7245601
- *Ekici, M. (2021). A systematic review of the use of gamification in flipped learning. Education and Information Technologies, 26, 3327–3346. https://doi.org/10.1007/s10639-020-10394-y
- Eppard, J., & Rochdi, A. (2017). A framework for flipped learning. In I. Arnedillo Sánchez, P. Isaias, & L. Rodrigues (Eds.), Proceedings of the International Conference on Mobile Learning 2017 (pp. 33–40). International Association for Development of the Information Society. https://www.proceedings.com/content/036/036166webtoc.pdf
- *Evans L., Vanden Bosch, M. L., Harrington, S., Schoofs, N., & Coviak C. (2019). Flipping the classroom in health care higher education: A systematic review. Nurse Educator, 44(2), 74–78. https://doi.org/10.1097/NNE.0000000000000554
- *Farmus, L., Cribbie, R. A., & Rotondi, M. A. (2020). The flipped classroom in introductory statistics: Early evidence from a systematic review and meta-analysis. Journal of Statistics Education, 28(3), 316–325. https://doi.org/10.1080/10691898.2020.1834475
- *Fernández-Martín, F.D., Romero-Rodríguez, J.-M., Gómez-García, G., & Ramos Navas-Parejo, M. (2020). Impact of the flipped classroom method in the mathematical area: A systematic review. Mathematics, 8(12), Article 2162. https://doi.org/10.3390/math8122162
- *Fung, C.-H., Besser, M., & Poon, K.-K. (2021). Systematic literature review of flipped classroom in mathematics. Eurasia Journal of Mathematics, Science and Technology Education, 17(6), Article em1974. https://doi.org/10.29333/ejmste/10900
- *Gerber, A., & Eybers, S. (2021). Converting to inclusive online flipped classrooms in response to COVID-19 lockdown. South African Journal of Higher Education, 35(4), 34–57. https://doi.org/10.20853/35-4-4285
- Gough, D., Oliver, S., & Thomas, J. (2017). An introduction to systematic reviews (2nd ed.). SAGE.
- Gough, D., Thomas, J., & Oliver, S. (2012). Clarifying differences between review designs and methods. Systematic Reviews, 1, Article 28. https://doi.org/10.1186/2046-4053-1-28
- * Gianoni-Capenakas, S., Lagravere, M., Pacheco-Pereira, C., & Yacyshyn, J. (2019). Effectiveness and Perceptions of Flipped Learning Model in Dental Education: A Systematic Review. Journal of dental education, 83(8), 935–945. https://doi.org/10.21815/JDE.019.109Giannakos, M. N., Krogstie, J., & Chrisochoides, N. (2014). Reviewing the flipped classroom research: Reflections for computer science education. In E. Barendsen & V. Dagiené (Eds.), Proceedings: Computer Science Education Research Conference ’14 (pp. 23–30). ACM. https://doi.org/10.1145/2691352.2691354
- *Gianoni-Capenakas, S., Lagravere, M., Pacheco-Pereira, C., & Yacyshyn, J. (2019). Effectiveness and perceptions of flipped learning model in dental education: A systematic review. Journal of Dental Education, 83(8), 935–945. https://doi.org/10.21815/JDE.019.109
- Grant, M. J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information and Libraries Journal, 26(2), 91–108. https://doi.org/10.1111/j.1471-1842.2009.00848.x
- Hammersley, M. (2020). Reflections on the methodological approach of systematic reviews. In O. Zawacki-Richter, M. Kerres, S. Bedenlier, M. Bond, & K. Buntins (Eds.), Systematic reviews in educational research (pp. 23–39). Springer VS. https://doi.org/10.1007/978-3-658-27602-7_2
- *Hendrik, H., & Hamzah, A. (2021). Flipped classroom in programming course: A systematic literature review. International Journal of Emerging Technologies in Learning (iJET), 16(02), 220–236. https://doi.org/10.3991/ijet.v16i02.15229
- Hew, K. F., Bai, S., Huang, W., Dawson, P., Du, J., Huang, G., Jia, C., & Thankrit, K. (2021). On the use of flipped classroom across various disciplines: Insights from a second-order meta-analysis. Australasian Journal of Educational Technology, 37(2), 132–151. https://doi.org/10.14742/ajet.6475
- Hoshang, S., Hilal, T. A., & Hilal, H. A. (2021). Investigating the Acceptance of Flipped Classroom and Suggested Recommendations. Procedia Computer Science, 184, 411–418. https://doi.org/10.1016/j.procs.2021.03.052
- Hwang, G.-J., Yin, C., & Chu, H.-C. (2019). The era of flipped learning: Promoting active learning and higher order thinking with innovative flipped learning strategies and supporting systems. Interactive Learning Environments 27(8), 991–994. https://doi.org/10.1080/10494820.2019.1667150
- *Inayah, S., Juandi, D., Darhim, D., Prabawanto, S., & Jupri, A. (2023). The impact of flipped classroom implementation in mathematics learning at school: Systematic literature review. Journal Analisa, 9(1), 59–73. https://doi.org/10.15575/ja.v9i1.18226
- Jonassen, D., Davidson, M., Collins, M., Campbell, J., & Haag, B. B. (1995). Constructivism and computer-mediated communication in distance education. American Journal of Distance Education, 9(2), 7–25. https://doi.org/10.1080/08923649509526885
- Karabulut-Ilgu, A., Jaramillo Cherrez, N., & Jahren, C. T. (2018). A Systematic Review of Research on the Flipped Learning Method in Engineering Education. British Journal of Educational Technology, 49, 398-411.
- https://doi.org/10.1111/bjet.12548
- Kapur, M., Hattie, J., Grossman, I., & Sinha, T. (2022). Fail, flip, fix, and feed—Rethinking flipped learning: A review of meta-analyses and a subsequent meta-analysis. Frontiers in Education, 7, Article 956416. https://doi.org/10.3389/feduc.2022.956416
- *Karagöl, I., & Esen, E. (2019). The effect of flipped learning approach on academic achievement: A meta-analysis study. Hacettepe University Journal of Education, 34(3), 708–727. https://doi.org/10.16986/HUJE.2018046755
- *Kazeminia, M., Salehi, L., Khosravipour, M., & Rajati, F. (2022). Investigation of flipped classroom effectiveness in teaching anatomy: A systematic review. Journal of Professional Nursing, 42, 15–25. https://doi.org/10.1016/j.profnurs.2022.05.007
- *Koh, J. H. L. (2019). Four pedagogical dimensions for understanding flipped classroom practices in higher education: A systematic review. Educational Sciences: Theory and Practice, 19(4), 14–33. https://jestp.com/menuscript/index.php/estp/article/view/756/709
- Låg, T., & Sæle, R. G. (2019). Does the flipped classroom improve student learning and satisfaction? A systematic review and meta-analysis. AERA Open, 5(3), 1–17. https://doi.org/10.1177/2332858419870489
- Lee, K., Zawacki-Richter, O., & Cefa Sari, B. (2022). A systematic literature review on technology in online doctoral education. Studies in Continuing Education, 46(1), 38–64. https://doi.org/10.1080/0158037X.2022.2135499
- Lewin, K. (1952). Field theory in social science: Selected theoretical papers (D. Cartwright, Ed.). Harper and Brothers.
- Li, S., & Fang, D. (2015). Factors of college students in the flipped classroom. In F. Khoshnoud & T. Li (Chairs), 2015 10th International Conference on Computer Science & Education (pp. 805–809). IEEE. https://doi.org/10.1109/ICCSE.2015.7250355
- Lin, H.-C., & Hwang, G.-J. (2019). Research trends of flipped classroom studies for medical courses: A review of journal publications from 2008 to 2017 based on the technology-enhanced learning model. Interactive Learning Environments, 27(8), 1011–1027. https://doi.org/10.1080/10494820.2018.1467462
- Liu, L., Hew, K. F., & Du, J. (2024). Design principles for supporting self-regulated learning in flipped classrooms: A systematic review. International Journal of Educational Research, 124, Article 102319. https://doi.org/10.1016/j.ijer.2024.102319
- Lo, C. K. (2020). Systematic reviews on flipped learning in various education contexts. In O. Zawacki-Richter, M. Kerres, S. Bedenlier, M. Bond, & K. Buntins (Eds.), Systematic reviews in educational research (pp. 129–143). Springer VS. https://doi.org/10.1007/978-3-658-27602-7_8
- Lo, C. K. (2023). Strategies for enhancing online flipped learning: A systematic review of empirical studies during the COVID-19 pandemic. Interactive Learning Environments, 32(7), 3517–3545. https://doi.org/10.1080/10494820.2023.2184392
- *Lo, C.K., Hew, K.F. (2022).Design principles for fully online flipped learning in health professions education: a systematic review of research during the COVID-19 pandemic. BMC Medical Education, 22 (720). https://doi.org/10.1186/s12909-022-03782-0
- Lo, C. K., & Hew, K. F. (2017). A critical review of flipped classroom challenges in K–12 education: Possible solutions and recommendations for future research. Research and Practice in Technology Enhanced Learning, 12(1), Article 4. https://doi.org/10.1186/s41039-016-0044-2
- Lo, C. K., & Hwang, G. J. (2018). How to advance our understanding of flipped learning: Directions and a descriptive framework for future research. Knowledge Management & E-Learning, 10(4), 441–454. https://doi.org/10.34105/J.KMEL.2018.10.027
- Lundin, M., Bergviken Rensfeldt, A., Hillman, T. et al. (2018). Higher education dominance and siloed knowledge: a systematic review of flipped classroom research. International Journal of Education Technology in High Education, 15(20). https://doi.org/10.1186/s41239-018-0101-6
- Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med, 6(7), Article e1000097. https://doi.org/10.1371/journal.pmed.1000097
- Nicholas, D., Watkinson, A., Jamali, H. R., Herman, E., Tenopir, C., Volentine, R., Allard, S., & Levine, K. (2015). Peer review: Still king in the digital age. Learned Publishing, 28(1), 15–21. https://doi.org/10.1087/20150104
- *Özbay, Ö., & Çınar, S. (2021). Effectiveness of flipped classroom teaching models in nursing education: A systematic review. Nurse Education Today, 102, Article 104922. https://doi.org/10.1016/j.nedt.2021.104922
- *Park, J. H., Han, W. S., Kim, J.,& Lee, H. (2021). Strategies for flipped learning in the health professions education in South Korea and their effects: A systematic review. Education Sciences, 11(1), Article 9. https://doi.org/10.3390/educsci11010009
- Pulley, P. G. (2014). Blending face-to-face and technology: Implementing flipped K–12 classrooms. In L. Kyei-Blankson & E. Ntuli (Eds.), Practical applications and experiences in K–20 blended learning environments (pp. 105–119). IGI Global.
- Rasheed, R. A., Kamsin, A., Abdullah, N. A., Kakudi, H. A., Ali, A. S., Musa, A. S., & Yahya, A. S. (2020). Self-regulated learning in flipped classrooms: A systematic literature review. International Journal of Information and Education Technology, 10(11), 848–853. https://doi.org/10.18178/ijiet.2020.10.11.1469
- Rees, R., & Oliver, S. (2012). Stakeholder perspectives and participation in reviews. In D. Gough, S. Oliver, & J. Thomas (Eds.), An introduction to systematic reviews (pp. 17–34). Sage.
- Sahin, M. C. (2009). Instructional design principles for 21st century learning skills. Procedia—Social and Behavioral Sciences, 1(1), 1464–1468. https://doi.org/10.1016/j.sbspro.2009.01.258
- Şensöz, M. Z., & Erdemir, N. (2022). A systematic review of graduate studies on flipped classrooms in English language teaching in Turkey. ELT Research Journal, 1(1), 1–15.
- Smith, R. (2006). Peer review: A flawed process at the heart of science and journals. Journal of the Royal Society of Medicine, 99(4), 178–182. https://doi.org/10.1258/jrsm.99.4.178
- The Joanna Briggs Institute. (2014). Methodology for JBI umbrella reviews. The Joanna Briggs Institute.
- Wohlfart, O., & Wagner, I. (2023). Teachers’ role in digitalizing education: An umbrella review. Educational Technology Research and Development, 71(2), 339–365. https://doi.org/10.1007/s11423-022-10166-0
- Xiao, J. (2023). Introduction to history, theory, and research in ODDE. In O. Zawacki-Richter, & I. Jung (Eds.), Handbook of open, distance and digital education: Towards an informed approach to ODDE (pp. 15–25). Springer. https://doi.org/10.1007/978-981-19-2080-6_1
- *Xu, P., Chen, Y., Nie, W., Wang, Y., Song, T., Li, H., Li, J., Yi, J., & Zhao, L. (2019). The effectiveness of a flipped classroom on the development of Chinese nursing students’ skill competence: A systematic review and meta-analysis. Nurse Education Today, 80, 67–77. https://doi.org/10.1016/j.nedt.2019.06.005
- *Youhasan, P., Chen, Y., Lyndon, M., & Henning, M. A. (2021). Exploring the pedagogical design features of the flipped classroom in undergraduate nursing education: A systematic review. BMC Nursing, 20(1), Article 50. https://doi.org/10.1186/s12912-021-00555-w
- Zhou, M., & Li, Z. (2018). Blended mobile learning in theatre arts classrooms in higher education. Innovations in Education and Teaching International, 56(3), 307–317. https://doi.org/10.1080/14703297.2018.1447389
- Zawacki-Richter, O. (2009). Research Areas in Distance Education: A Delphi Study. The International Review of Research in Open and Distributed Learning, 10(3). https://doi.org/10.19173/irrodl.v10i3.674
- Zawacki-Richter, O. & Naidu, S. (2016). Mapping Research Trends from 35 Years of Publications in "Distance Education". Distance Education, 37(3), 245-269. https://doi.org/10.1080/01587919.2016.1185079
- Zawacki-Richter, O., Kerres, M., Bedenlier, S., Bond, M., & Buntins, K. (2020). Systematic reviews in educational research: Methodology, perspectives and application. Springer. http://link.springer.com/10.1007/978-3-658-27602-7
- Zawacki-Richter, O., & Bozkurt, A. (2023). Research Trends in Open, Distance, and Digital Education. In O. Zawacki-Richter & I. Jung (Eds.), Handbook of Open, Distance and Digital Education (pp. 199– 220). Springer Nature Singapore. https://doi.org/10.1007/978-981-19-2080-6_12
- Zawacki-Richter, O., Cefa, B., & Bai, J. Y. H. (2025). Towards reproducible systematic reviews in Open, Distance, and Digital Education (ODDE) – an umbrella mapping review. Review of Education. https://doi.org/10.1002/rev3.70031
- *Zou, D., Luo, S., Xie, H., & Hwang, G.-J. (2020). A systematic review of research on flipped language classrooms: Theoretical foundations, learning activities, tools, research topics and findings. Computer Assisted Language Learning, 35(8), 1811–1837. https://doi.org/10.1080/09588221.2020.1839502
- Zuber, W. J. (2016). The flipped classroom, a review of the literature. Industrial and Commercial Training, 48(2), 97–103. https://doi.org/10.1108/ICT-05-2015-0039
(an asterisk indicates systematic reviews included in this umbrella review)