An Intelligent Nudging System to Guide Online Learners

  • M. Elena Rodriguez Universitat Oberta de Catalunya
  • Ana Elena Guerrero-Roldán Universitat Oberta de Catalunya
  • David Baneres Universitat Oberta de Catalunya
  • Abdulkadir Karadeniz Anadolu University
Keywords: artificial intelligence, early warning system, nudges, at-risk learners, online learning

Abstract

This work discusses a nudging intervention mechanism combined with an artificial intelligence (AI) system for early detection of learners’ risk of failing or dropping out. Different types of personalized nudges were designed according to educational principles and the learners’ risk classification. The impact on learners’ performance, dropout reduction, and satisfaction was evaluated through a study with 252 learners in a first-year course at a fully online university. Different learners’ groups were designed, with each receiving a different set of nudges. Results showed that nudges positively impacted the learners’ performance and satisfaction, and reduced dropout rates. The impact significantly increased when different types of nudges were provided. Our research reinforced the role of AI as useful in online, distance, and open learning for providing timely learner support, improved learning experiences, and enhanced learner-teacher communication.

References

Ajjawi, R., & Boud, D. (2018). Examining the nature and effects of feedback dialogue. Assessment and Evaluation in Higher Education, 43(7), 1106–1119. https://doi.org/10.1080/02602938.2018.1434128

Arnold, K. E., & Pistilli, M. D. (2012, April 29). Course signals at Purdue: Using learning analytics to increase student success. In S. Dawson, C. Haythornthwaite, S. B. Shum, D. Gasevic & R. Ferguson (Eds.), Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 267–270). Association for Computing Machinery. https://doi.org/10.1145/2330601.2330666

Baneres, D., Rodríguez, M. E., Guerrero-Roldán, A. E., & Karadeniz, A. (2020). An early warning system to detect at-risk students in online higher education. Applied Sciences (Switzerland), 10(13), 4427. https://doi.org/10.3390/app10134427

Barr, V. (2014, December 1). Women in STEM, women in computer science: We’re looking at it incorrectly. Blog@CACM. https://cacm.acm.org/blogs/blog-cacm/180850-women-in-stem-women-in-computer-science-were-looking-at-it-incorrectly/

Benartzi, S., Beshears, J., Milkman, K. L., Sunstein, C. R., Thaler, R. H., Shankar, M., Tucker-Ray, W., Congdon, W. J., & Galing, S. (2017). Should governments invest more in nudging? Psychological Science, 28(8), 1041–1055. https://doi.org/10.1177/0956797617702501

Bucher, T., Collins, C., Rollo, M. E., McCaffrey, T. A., De Vlieger, N., Van der Bend, D., Truby, H., & Perez-Cueto, F. J. A. (2016). Nudging consumers towards healthier choices: A systematic review of positional influences on food choice. British Journal of Nutrition, 115(12), 2252–2263. https://doi.org/10.1017/S0007114516001653

Caraban, A., Karapanos, E., Gonçalves, D., & Campos, P. (2019, May 2). 23 ways to nudge: A review of technology-mediated nudging in human-computer interaction. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (article 503). Association for Computing Machinery. https://doi.org/10.1145/3290605.3300733

Castro, R. (2019). Blended learning in higher education: Trends and capabilities. Education and Information Technologies, 24(4), 2523–2546. https://doi.org/10.1007/s10639-019-09886-3

Chassignol, M., Khoroshavin, A., Klimova, A., & Bilyatdinova, A. (2018). Artificial intelligence trends in education: A narrative overview. Procedia Computer Science, 136, 16–24. https://doi.org/10.1016/j.procs.2018.08.233

Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. IEEE Access, 8, 75264–75278. https://doi.org/10.1109/ACCESS.2020.2988510

Cheung, L. L. W., & Kan, A. C. N. (2002). Evaluation of factors related to student performance in a distance-learning business communication course. Journal of Education for Business, 77(5), 257–263. https://doi.org/10.1080/08832320209599674

Clarizia, F., Colace, F., Lombardi, M., Pascale, F., & Santaniello, D. (2018, September 23). Chatbot: An education support system for student. In A. Castiglione, F. Pop, M. Ficco & F. Palmieri (Eds.), Cyberspace Safety and Security, CSS 2018 (Lecture Notes in Computer Science, Vol. 11161, pp. 291–302). Springer. https://doi.org/10.1007/978-3-030-01689-0_23

Damgaard, M. T., & Nielsen, H. S. (2018). Nudging in education. Economics of Education Review, 64, 313–342. https://doi.org/https://doi.org/10.1016/j.econedurev.2018.03.008

Didia, D., & Hasnat, B. (1998). The determinants of performance in the university introductory finance course. Financial Practice & Education, 8(1), 102–107.

Eom, S. B., Wen, H. J., & Ashill, N. (2006). The determinants of students’ perceived learning outcomes and satisfaction in university online education: An empirical investigation. Decision Sciences Journal of Innovative Education, 4(2), 215–235. https://doi.org/10.1111/j.1540-4609.2006.00114.x

Grau-Valldosera, J., Minguillón, J., & Blasco-Moreno, A. (2019). Returning after taking a break in online distance higher education: from intention to effective re-enrollment. Interactive Learning Environments, 27(3), 307–323. https://doi.org/10.1080/10494820.2018.1470986

Hummel, D., & Maedche, A. (2019). How effective is nudging? A quantitative review on the effect sizes and limits of empirical nudging studies. Journal of Behavioral and Experimental Economics, 80, 47–58. https://doi.org/10.1016/j.socec.2019.03.005

Kraft, M. A., & Rogers, T. (2015). The underutilized potential of teacher-to-parent communication: Evidence from a field experiment. Economics of Education Review, 47, 49–63. https://doi.org/10.1016/j.econedurev.2015.04.001

Kruskal, W. H. (1957). Historical notes on the Wilcoxon Unpaired Two-Sample Test. Journal of the American Statistical Association, 52(279), 356–360. https://doi.org/10.1080/01621459.1957.10501395

Márquez-Vera, C., Cano, A., Romero, C., Noaman, A. Y. M., Mousa Fardoun, H., & Ventura, S. (2016). Early dropout prediction using data mining: A case study with high school students. Expert Systems, 33(1), 107–124. https://doi.org/10.1111/exsy.12135

Martínez-Argüelles, M. J., Plana, D., Hintzmann, C., Batalla-Busquets, J. M., & Badia, M. (2015). Usefulness of feedback in e-learning from the students’ perspective. Intangible Capital, 11(4), 627–645. https://doi.org/10.3926/ic.622

Martinez, I. (2014). The effects of nudges on students’ effort and performance: Lessons from a MOOC (EdPolicyWorks Working Paper Series No. 19). https://education.virginia.edu/sites/default/files/files/EdPolicyWorks_files/19_Martinez_Lessons_from_a_MOOC.pdf

Mitrovic, A., Gordon, M., Piotrkowicz, A., & Dimitrova, V. (2019, June 21). Investigating the effect of adding nudges to increase engagement in active video watching. In S. Isotani, E. Millán, A. Ogan, P. Hastings, B. McLaren & R. Luckin (Eds.), Artificial Intelligence in Education, AIED 2019 (Lecture Notes in Computer Science, Vol. 11624, pp. 320–332). Springer. https://doi.org/10.1007/978-3-030-23204-7_27

Oates, B. J. (2006). Researching information systems and computing. SAGE.

Ortigosa, A., Carro, R. M., Bravo-Agapito, J., Lizcano, D., Alcolea, J. J., & Blanco, Ó. (2019). From lab to production: Lessons learnt and real-life challenges of an early student-dropout prevention system. IEEE Transactions on Learning Technologies, 12(2), 264–277. https://doi.org/10.1109/TLT.2019.2911608

Piotrkowicz, A., Dimitrova, V., Hallam, J., & Price, R. (2020, July 14). Towards personalisation for learner motivation in healthcare: A study on using learner characteristics to personalise nudges in an e-learning context. Adjunct Publication of the 28th ACM Conference on User Modeling, Adaptation and Personalization, (pp. 287–292). https://doi.org/10.1145/3386392.3399290

Reimann, N., Sadler, I., & Sambell, K. (2019). What’s in a word? Practices associated with ‘feedforward’ in higher education. Assessment and Evaluation in Higher Education, 44(8), 1279–1290. https://doi.org/10.1080/02602938.2019.1600655

Rodríguez, M. E., Guerrero-Roldán, A. E., Baneres, D., & Karadeniz, A. (2019, November). Towards an intervention mechanism for supporting learners performance in online learning. Proceedings of the 12th Annual International Conference of Education, Research and Innovation, ICERI 2019 (pp. 5136–5145). Seville, Spain. https://doi.org/10.21125/iceri.2019.1244

Sadler, D. R. (2010). Beyond feedback: Developing student capability in complex appraisal. Assessment and Evaluation in Higher Education, 35(5), 535–550. https://doi.org/10.1080/02602930903541015

Siemens, G., & Baker, R. S. J. D. (2012, April 29). Learning analytics and educational data mining: Towards communication and collaboration. Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 252–254). Association for Computing Machinery. https://doi.org/10.1145/2330601.2330661

Sparks, C., Dimmock, J., Whipp, P., Lonsdale, C., & Jackson, B. (2015). “Getting connected”: High school physical education teacher behaviors that facilitate students’ relatedness support perceptions. Sport, Exercise, and Performance Psychology, 4(3), 219–236. https://doi.org/10.1037/spy0000039

Sunstein, C. R. (2015). Which nudges do people like? A national survey. Social Science Research Network. https://doi.org/10.2139/ssrn.2619899

van Oldenbeek, M., Winkler, T. J., Buhl-Wiggers, J., & Hardt, D. (2019, May 15). Nudging in blended learning: Evaluation of email-based progress feedback in a flipped-classroom information systems course. Proceedings of the 27th European Conference on Information Systems, ECIS (article 186). AIS eLibrary. https://aisel.aisnet.org/ecis2019_rp/186

Vasquez, H., Fuentes, A. A., Kypuros, J. A., & Azarbayejani, M. (2015, December 7). Early identification of at-risk students in a lower-level engineering gatekeeper course. In 2015 IEEE Frontiers in Education Conference, FIE (vol. 2015, pp. 1–9). Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/FIE.2015.7344361

Weijers, R. J., de Koning, B. B., & Paas, F. (2020). Nudging in education: From theory towards guidelines for successful implementation. European Journal of Psychology of Education, 36, 883–902. https://doi.org/10.1007/s10212-020-00495-0

York, B., Loeb, S., & Doss, C. (2019). One step at a time: The effects of an early literacy text-messaging program for parents of preschoolers. Journal of Human Resources, 54(3), 537–566. https://doi.org/10.3368/jhr.54.3.0517-8756R

Published
2022-02-01
How to Cite
Rodriguez, M. E., Guerrero-Roldán, A. E., Baneres, D., & Karadeniz, A. (2022). An Intelligent Nudging System to Guide Online Learners. The International Review of Research in Open and Distributed Learning, 23(1), 41-62. https://doi.org/10.19173/irrodl.v22i4.5407