Abstracts
Abstract
Online learning environments could be well understood as a multifaceted phenomenon affected by different aspects of learner participation including synchronous/asynchronous interactions. The aim of this study was to investigate learners’ participation in online courses, synchronous interaction with a conversational virtual agent, their relationships with learner performance, and the participation/interaction factor identification. To examine learner participation, we collected learning management system (LMS) log data that included the frequency and length of course access, discussion board postings, and final grades. To examine synchronous learner interaction, we collected learners’ conversation logs from the conversational agent. We calculated the quantity and quality of discussion postings and conversations with the agent. The results showed that the frequency and length of course access, the quantity and quality of discussion postings, and the quality of conversation with the agent were significantly associated with the learner achievement. This study also identified two factors that comprise online learning participation and interaction: interaction quality and LMS-oriented interaction.
Keywords:
- online learning,
- learner participation,
- online interaction,
- conversational agent
Appendices
Bibliography
- Abbasi, S., & Kazi, H. (2014). Measuring effectiveness of learning chatbot systems on student's learning outcome and memory retention. Asian Journal of Applied Science and Engineering, 3(2), 251-260. Retrieved from http://journals.abc.us.org/index.php/ajase/article/view/251-260
- Andresen, M. A. (2009). Asynchronous discussion forums: Success factors, outcomes, assessments, and limitations. Journal of Educational Technology & Society, 12(1), 249-257. Retrieved from https://www.jstor.org/stable/pdf/jeductechsoci.12.1.249
- Baker, C. (2010). The impact of instructor immediacy and presence for online student affective learning, cognition, and motivation. Journal of Educators Online, 7(1), 1-30. Retrieved from https://eric.ed.gov/?id=EJ904072
- Beavers, A. S., Lounsbury, J. W., Richards, J. K., Huck, S. W., Skolits, G. J., & Esquivel, S. L. (2013). Practical considerations for using exploratory factor analysis in educational research. Practical Assessment, Research & Evaluation, 18(6), 1-13. Retrieved from http://www.pareonline.net/getvn.asp?v=18&n=6
- Beldarrain, Y. (2006). Distance education trends: Integrating new technologies to foster student interaction and collaboration. Distance Education, 27(2), 139-153. doi: 10.1080/01587910600789498
- Bettinger, E., Liu, J., & Loeb, S. (2016). Connections matter: How interactive peers affect students in online college courses. Journal of Policy Analysis and Management, 35(4), 932-954. doi: 10.1002/pam.21932
- Boling, E. C., Hough, M., Krinsky, H., Saleem, H., & Stevens, M. (2012). Cutting the distance in distance education: Perspectives on what promotes positive, online learning experiences. The Internet and Higher Education, 15(2), 118-126. doi: 10.1016/j.iheduc.2011.11.006
- Bradley, M. E., Thom, L. R., Hayes, J., & Hay, C. (2008). Ask and you will receive: How question type influences quantity and quality of online discussions. British Journal of Educational Technology, 39(5), 888-900. doi: 10.1111/j.1467-8535.2007.00804.x
- Comrey, A. L., & Lee, H. B. (1992). A first course in factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum. Retrieved from http://psycnet.apa.org/record/1992-97707-000
- Croxton, R. A. (2014). The role of interactivity in student satisfaction and persistence in online learning. Merlot Journal of Online Learning and Teaching, 10(2), 314-325. Retrieved from http://jolt.merlot.org/vol10no2/croxton_0614.pdf
- Delialioglu, O., & Yildirim, Z. (2007). Students' perceptions on effective dimensions of interactive learning in a blended learning environment. Journal of Educational Technology & Society, 10(2), 133-146. Retrieved from https://www.jstor.org/stable/pdf/jeductechsoci.10.2.133
- Dennen, V. P., Aubteen Darabi, A., & Smith, L. J. (2007). Instructor-learner interaction in online courses: The relative perceived importance of particular instructor actions on performance and satisfaction. Distance Education, 28(1), 65-79. doi: 10.1080/01587910701305319
- Drange, T., Sutherland, I., & Irons, A. (2015, March). Challenges of interaction in online teaching: A case study. Proceedings of the International Conference on E-Technologies and Business on the Web (pp. 35-42). Paris, France: The Society of Digital Information and Wireless Communications. Retrieved from http://ebw2015.sdiwc.us/
- Fryer, L. K., Ainley, M., Thompson, A., Gibson, A., & Sherlock, Z. (2017). Stimulating and sustaining interest in a language course: An experimental comparison of Chatbot and Human task partners. Computers in Human Behavior, 75, 461-468. doi: 10.1016/j.chb.2017.05.045
- Garrison, D. R., & Cleveland-Innes, M. (2005). Facilitating cognitive presence in online learning: Interaction is not enough. The American Journal of Distance Education, 19(3), 133-148. doi: 10.1207/s15389286ajde1903_2
- Giesbers, B., Rienties, B., Tempelaar, D., & Gijselaers, W. (2014). A dynamic analysis of the interplay between asynchronous and synchronous communication in online learning: The impact of motivation. Journal of Computer Assisted Learning, 30(1), 30-50. doi: 10.1111/jcal.12020
- Gilbert, P. K., & Dabbagh, N. (2005). How to structure online discussions for meaningful discourse: A case study. British Journal of Educational Technology, 36(1), 5-18. doi: 10.1111/j.1467-8535.2005.00434.x
- Goggins, S., & Xing, W. (2016). Building models explaining student participation behavior in asynchronous online discussion. Computers & Education, 94, 241-251. doi: 10.1016/j.compedu.2015.11.002
- Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2010). Multivariate data analysis (7th ed.). Upper Saddle River, NJ: Prentice Hall. Retrieved from https://www.pearson.com/us/higher-education/program/Hair-Multivariate-Data-Analysis-7th-Edition/PGM263675.html
- Hawkins, A., Graham, C. R., Sudweeks, R. R., & Barbour, M. K. (2013). Academic performance, course completion rates, and student perception of the quality and frequency of interaction in a virtual high school. Distance Education, 34(1), 64-83. doi: 10.1080/01587919.2013.770430
- Heller, B., Proctor, M., Mah, D., Jewell, L., & Cheung, B. (2005, June). Freudbot: An investigation of chatbot technology in distance education. Proceedings of the 2005 EdMedia: World Conference on Educational Media and Technology (pp. 3913-3918). Montreal, Canada: Association for the Advancement of Computing in Education. Retrieved from https://psych.athabascau.ca/html/chatterbot/ChatAgent-content/EdMediaFreudbotFinal.pdf
- Hrastinski, S. (2008). What is online learner participation? A literature review. Computers & Education, 51(4), 1755-1765. doi: 10.1016/j.compedu.2008.05.005
- Johnson, G. M. (2006). Synchronous and asynchronous text-based CMC in educational contexts: A review of recent research. TechTrends, 50(4), 46-53. doi: 10.1007/s11528-006-0046-9
- Joksimović, S., Gašević, D., Kovanović, V., Riecke, B. E., & Hatala, M. (2015). Social presence in online discussions as a process predictor of academic performance. Journal of Computer Assisted Learning, 31(6), 638-654. doi: 10.1111/jcal.12107
- Jia, J. (2009). CSIEC: A computer assisted English learning chatbot based on textual knowledge and reasoning. Knowledge-Based Systems, 22(4), 249-255. doi: 10.1016/j.knosys.2008.09.001
- Jung, I., Choi, S., Lim, C., & Leem, J. (2002). Effects of different types of interaction on learning achievement, satisfaction and participation in web-based instruction. Innovations in Education and Teaching International, 39(2), 153-162. doi: 10.1080/14703290252934603
- Kang, M., & Im, T. (2013). Factors of learner-instructor interaction which predict perceived learning outcomes in online learning environment. Journal of Computer Assisted Learning, 29(3), 292-301. doi: 10.1111/jcal.12005
- Levy, Y. (2007). Comparing dropouts and persistence in e-learning courses. Computers & Education, 48(2), 185-204. doi: 10.1016/j.compedu.2004.12.004
- Mayadas, A. F., Bourne, J., & Bacsich, P. (2009). Online education today. Science, 323(5910), 85-89. doi: 10.1126/science.1168874
- Michinov, N., Brunot, S., Le Bohec, O., Juhel, J., & Delaval, M. (2011). Procrastination, participation, and performance in online learning environments. Computers & Education, 56(1), 243-252. doi: 10.1016/j.compedu.2010.07.025
- Ni, A. Y. (2013). Comparing the effectiveness of classroom and online learning: Teaching research methods. Journal of Public Affairs Education, 19(2), 199-215. Retrieved from https://www.jstor.org/stable/23608947
- Ohlund, B., Yu, C. H., Jannssch-Pennell, A., & Digangi, S. A. (2000). Impact of asynchronous and synchronous Internet-based communication on collaboration and performance among K-12 teachers. Journal of Educational Computing Research, 23, 405-420. doi: 10.2190/U40F-M2LK-VKVW-883L
- Picciano, A. G. (2002). Beyond student perceptions: Issues of interaction, presence, and performance in an online course. Journal of Asynchronous Learning Networks, 6(1), 21-40. Retrieved from https://pdfs.semanticscholar.org/bfdd/f2c4078b58aefd05b8ba7000aca1338f16d8.pdf
- Pituch K. A., & Stevens, J. (2016). Applied multivariate statistics for the social sciences (3rd ed.). Mahwah, NJ: Routledge. Retrieved from https://www.routledge.com/Applied-Multivariate-Statistics-for-the-Social-Sciences-Analyses-with/Pituch-Stevens/p/book/9780415836661
- Richardson, J. C., & Swan, K. (2003). Examining social presence in online courses in relation to students' perceived learning and satisfaction. Journal of Asynchronous Learning Networks, 7(1), 68-88. Retrieved from http://hdl.handle.net/2142/18713
- Sabry, K., & Baldwin, L. (2003). Web-based learning interaction and learning styles. British Journal of Educational Technology, 34(4), 443-454. doi: 10.1111/1467-8535.00341
- Seaman, J. E., Allen, I. E., & Seaman, J. (2018). Grade increase: Tracking distance education in the United States. Retrieved from Babson College, Babson Survey Research Group website: https://eric.ed.gov/?id=ED580852
- Shawar, B. A., & Atwell, E. (2007). Chatbots: are they really useful? LDV Forum, 22(1), 29-49. Retrieved from http://www.jlcl.org/2007_Heft1/Bayan_Abu-Shawar_and_Eric_Atwell.pdf
- Song, D. (2018). Learning Analytics as an educational research approach. International Journal of Multiple Research Approaches, 10(1), 102-111. doi: 10.29034/ijmra.v10n1a6
- Song, D., & Lee, J. (2014). Has Web 2.0 revitalized informal learning?: The relationship between the levels of Web 2.0 and informal learning websites. Journal of Computer Assisted Learning, 30(6), 511-533. doi: 10.1111/jcal.12056
- Song, D., Oh. E., & Rice, M. (2017, July). Interacting with a conversational agent system for educational purposes in online courses. Proceedings of the 10th International Conference on Human System Interaction (pp. 78-82). Ulsan, South Korea: IEEE. doi: 10.1109/HSI.2017.8005002
- Stoessel, K., Ihme, T. A., Barbarino, M. L., Fisseler, B., & Stürmer, S. (2015). Sociodemographic diversity and distance education: Who drops out from academic programs and why? Research in Higher Education, 56(3), 228-246. doi: 10.1007/s11162-014-9343-x
- Swan, K. (2001). Virtual interaction: Design factors affecting student satisfaction and perceived learning in asynchronous online courses. Distance Education, 22(2), 306-331. doi: 10.1080/0158791010220208
- Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Boston, MA: Pearson. Retrieved from https://www.pearson.com/us/higher-education/program/Tabachnick-Using-Multivariate-Statistics-6th-Edition/PGM332849.html
- Tu, C. H. (2002). The measurement of social presence in an online learning environment. International Journal on E-learning, 1(2), 34-45. Retrieved from https://www.learntechlib.org/p/10820/
- van den Boom, G., Paas, F., & van Merriënboer, J. J. (2007). Effects of elicited reflections combined with tutor or peer feedback on self-regulated learning and learning outcomes. Learning and Instruction, 17(5), 532-548. doi: 10.1016/j.learninstruc.2007.09.003
- Wenger, E. (1998). Communities of practice: Learning, meaning, and identity. Cambridge: Cambridge University Press. Retrieved from http://www.cambridge.org/9780521663632
- Wu, W. C. V., Yen, L. L., & Marek, M. (2011). Using online EFL interaction to increase confidence, motivation, and ability. Journal of Educational Technology & Society, 14(3), 118-129. Retrieved from https://www.jstor.org/stable/jeductechsoci.14.3.118
- Yamagata-Lynch, L. C. (2014). Blending online asynchronous and synchronous learning. The International Review of Research in Open and Distributed Learning, 15(2), 189-212. Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/1778/2837