Internationalizing Professional Development: Using Educational Data Mining to Analyze Learners’ Performance and Dropouts in a French MOOC

Keywords: MOOCs, learner grades, learner dropout, learner performance, academic cohorts, educational data mining, CHAID, low- and middle-income countries, developing countries

Abstract

This paper uses data mining from a French project management MOOC to study learners’ performance (i.e., grades and persistence) based on a series of variables: age, educational background, socio-professional status, geographical area, gender, self- versus mandatory-enrollment, and learning intentions. Unlike most studies in this area, we focus on learners from the French-speaking world: France and French-speaking European countries, the Caribbean, North Africa, and Central and West Africa. Results show that the largest gaps in MOOC achievements occur between 1) learners from partner institutions versus self-enrolled learners 2) learners from European countries versus low- and middle-income countries, and 3) learners who are professionally active versus inactive learners (i.e., with available time). Finally, we used the CHAID data-mining method to analyze the main characteristics and discriminant factors of MOOC learner performance and dropout.

Author Biographies

Rawad Chaker, Lyon 2 University

Rawad Chaker holds a PhD in Educational Sciences. He's specialized in educational technology, with a sociological and psychological approach. He's an Assistant Professor at Lyon 2 University, France.

Rémi Bachelet, Centrale Lille

Rémi Bachelet holds a PhD in Management sciences and is an Assistant Professor at Ecole Centrale de Lille. He's the creator of the "Project Management" MOOC, the first certifying MOOC in France.

References

Albelbisi, N., Yusop, F. D., & Salleh, U. K. M. (2018). Mapping the factors influencing success of massive open online courses (MOOC) in Higher Education. EURASIA Journal of Mathematics, Science, and Technology Education, 14(7), 2995–3012. https:/doi.org/10.29333/ejmste/91486

Allione, G., & Stein, R. M. (2016). Mass attrition: An analysis of drop out from principles of microeconomics MOOC. The Journal of Economic Education, 47(2), 174-186. https://doi.org/10.1080/00220485.2016.1146096

Altbach, P. G. (2014). MOOCs as neocolonialism: Who controls knowledge? International Higher Education, 75, 5–7. https://doi.org/10.6017/ihe.2014.75.5426

Bachelet, R., & Chaker, R. (2017). Toward a typology of MOOC activity patterns. In C. Delgado Kloos, P. Jermann, M. Pérez-Sanagustín, D. Seaton, & S. White (Eds.) Digital education: Out to the world and back to the campus. EMOOCs 2017. Lecture Notes in Computer Science, vol 10254 (pp. 134-139). Springer, Cham. https://doi.org/10.1007/978-3-319-59044-8_15

Bozkurt, A., Akgün-Özbek, E., & Zawacki-Richter, O. (2017). Trends and patterns in massive open online courses: Review and content analysis of research on MOOCs (2008–2015). The International Review of Research in Open and Distributed Learning, 18(5), 118-147. https://doi.org/10.19173/irrodl.v18i5.3080

Breslow, L., Pritchard, D. E., DeBoer, J., Stump, G. S., Ho, A. D., & Seaton, D. T. (2013). Studying learning in the worldwide classroom research into edX's first MOOC. Research & Practice in Assessment, 8, 13–25. Retrieved from https://www.rpajournal.com/studying-learning-in-the-worldwide-classroom-research-into-edxs-first-mooc/

Brouns, F., Teixeira, A., Morgado, L., Fano, S., Fueyo, A., & Jansen, D. (2017). Designing massive open online learning processes: the sMOOC pedagogical framework. In Open Education: from OERs to MOOCs (pp. 315-336). Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-52925-6_16

Castillo, N. M., Lee, J., Zahra, F. T., & Wagner, D. A. (2015). MOOCS for development: Trends, challenges, and opportunities. International Technologies & International Development, 11(2), 35. Retrieved from https://repository.upenn.edu/literacyorg_articles/6

Christensen, G., Steinmetz, A., Alcorn, B., Bennett, A., Woods, D., & Emanuel, E. J. (2013, November 6). The MOOC phenomenon: Who takes massive open online courses and why? [Working paper]. University of Pennsylvania. http://dx.doi.org/10.2139/ssrn.2350964

Colas, J. F., Sloep, P. B., & Garreta-Domingo, M. (2016). The effect of multilingual facilitation on active participation in MOOCs. The International Review of Research in Open and Distributed Learning, 17(4), 280-314. https:doi.org/10.19173/irrodl.v17i4.2470

Czerniewicz, L., Deacon, A., Small, J., & Walji, S. (2014). Developing world MOOCs: A curriculum view of the MOOC landscape. Journal of Global Literacies, Technologies, and Emerging Pedagogies, 2(3), 122-139. Retrieved from http://hdl.handle.net/11427/19562

Daniel, J., Vázquez Cano, E., & Gisbert, M. (2015). The future of MOOCs: Adaptive learning or business model? Educational Technology in Higher Education, 12(1), 64–73. http://dx.doi.org/10.7238/rusc.v12i1.2475

Dodson, M. N., Kitburi, K., & Berge, Z. L. (2015). Possibilities for MOOCs in corporate training and development. Performance Improvement, 54(10), 14–21. https://doi.org/: 10.1002/pfi.21532

Domingo, M., Paran, A., Révész, A., & Palange, A. (2019, January). Exploring factors that influence the impact of MOOC learning on participants’ professional practice. UCL Institute of Education, University College London. Retrieved from https://london.ac.uk/sites/default/files/leaflets/ExploringFactorsThatInfluenceTheImpactOfMOOCs_Final.pdf

Elias, T. (2011). 71. Universal instructional design principles for mobile learning. International Review of Research in Open and Distributed Learning, 12(2), 143-156. https://doi.org/10.19173/irrodl.v12i2.965

Emanuel, E. J. (2013). MOOCs taken by educated few. Nature, 503(342). https://doi.org/10.1038/503342a

Gamage, D., Perera, I., & Fernando, S. (2016, March 7–9). Evaluating effectiveness of MOOCs using empirical tools: Learners perspective. The 10th International Technology, Education and Development Conference (pp. 8276-8284). Valencia, Spain. https://doi.org/10.21125/inted.2016.0937

Garrido, M., Koepke, L., Andersen, S., Mena, A., Macapagal, M., & Dalvit, L. (2016). An examination of MOOC usage for professional workforce development outcomes in Colombia, the Philippines & South Africa. Technology & Social Change Group, University of Washington Information School. Retrieved from https://tascha.uw.edu/publications/an-examination-of-mooc-usage-for-professional-workforce-development-outcomes/

Guàrdia, L., Maina, M., & Sangrà, A. (2013). MOOC design principles: A pedagogical approach from the learner’s perspective. eLearning Papers, 33. Retrieved from https://r-libre.teluq.ca/596/1/In-depth_33_4.pdf

Guo, P. J., & Reinecke, K. (2014, March 4–5). Demographic differences in how students navigate through MOOCs [Paper presentation]. The First ACM Conference on Learning @ Scale, 21–30. Atlanta, Georgia. https://doi.org/10.1145/2556325.2566247

Hansen, J. D., & Reich, J. (2015). Democratizing education? Examining access and usage patterns in massive open online courses. Science, 350(6265), 1245–1248. https://doi.org/10.1126/science.aab3782

Henderikx, M. A., Kreijns, K., & Kalz, M. (2017). Refining success and dropout in massive open online courses based on the intention–behavior gap. Distance Education, 38(3), 353–368. https://doi.org/10.1080/01587919.2017.1369006

Hossain, J. (2010). Professional development of higher education teachers: Can ODL contribute? Turkish Online Journal of Distance Education, 11(1), 123–133. Retrieved from https://dergipark.org.tr/en/pub/tojde/issue/16907/176319

Hrdličková, Z., & Dooley, G. (2017, June). AuthorAID capacity development impact study 2017 [Summary report]. INASP. Retrieved from https://www.inasp.info/sites/default/files/2018-04/AuthorAID%20study%20%E2%80%93%20summary%20report.pdf

Jansen, D., Schuwer, R., Teixeira, A., & Aydin, C. H. (2015). Comparing MOOC adoption strategies in Europe: Results from the HOME project survey. International Review of Research in Open and Distributed Learning, 16(6), 116-136. https://doi.org/10.19173/irrodl.v16i6.2154

Jones, K. M., Stephens, M., Branch-Mueller, J., & de Groot, J. (2016). Community of practice or affinity space: A case study of a professional development MOOC. Education for Information, 32(1), 101–119. https://doi.org/10.3233/EFI-150965

Jordan, K. (2013, August 27). MOOC completion rates: The data. Katy Jordan. Retrieved from http://www.katyjordan.com/MOOCproject.html

Kaliisa, R., & Picard, M. (2017). A systematic review on mobile learning in higher education: The African perspective. TOJET: The Turkish Online Journal of Educational Technology, 16(1), 1–18. http://www.tojet.net/articles/v16i1/1611.pdf

King, M., Luan, B., & Lopes, E. (2018). Experiences of Timorese language teachers in a blended massive open online course (MOOC) for continuing professional development (CPD). Open Praxis, 10(3), 279-287. Retrieved from https://www.learntechlib.org/p/187316/

King, M., Pegrum, M., & Forsey, M. (2018). MOOCs and OER in the Global South: Problems and potential. The International Review of Research in Open and Distributed Learning, 19(5). https://doi.org/10.19173/irrodl.v19i5.3742

Kizilcec, R. F., & Halawa, S. (2015, March). Attrition and achievement gaps in online learning. In Proceedings of the Second (2015) ACM Conference on Learning@ Scale (pp. 57-66). https://doi.org/10.1145/2724660.2724680

Kizilcec, R. F., Pérez-Sanagustín, M., & Maldonado, J. J. (2017). Self-regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses. Computers & Education, 104, 18-33. https://doi.org/10.1016/j.compedu.2016.10.001

Koller, D., Ng, A., Do, C., & Chen, Z. (2013). Retention and intention in Massive Open Online Courses: In-depth. EDUCAUSE Review, 48(3), 62–63. Retrieved from https://er.educause.edu/articles/2013/6/retention-and-intention-in-massive-open-online-courses-in-depth

Labarthe, H., Bachelet, R., Bouchet, F., & Yacef, K. (2016, February 22–24). Increasing MOOC completion rates through social interactions: A recommendation system [Paper presentation]. eMOOCs 2016, the Fourth MOOC European Stakeholders Summit, 471–480. Graz, Austria. Retrieved from https://hal.archives-ouvertes.fr/hal-01277664/document

Lane, A. (2013, October 23–25). The potential of MOOCs to widen access to, and success in, higher education study [Paper presentation]. EADTU: The Open and Flexible Higher Education Conference 2013, 189–20. Paris, France. Retrieved from http://oro.open.ac.uk/id/eprint/38881

Launois, P., Allotey, P., Reidpath, D., Maher, D., Certain, E., & Ross, B. (2019). Lessons learnt from a professional development MOOC: Engaging culturally and linguistically diverse learners from low-and middle-income countries. European Journal of Open, Distance, and eLearning, 2. Retrieved from https://www.eurodl.org/?p=current&sp=brief&article=809

Laurillard, D. (2014, January 16). Five myths about MOOCs. Times Higher Education. Retrieved from https://www.timeshighereducation.com/comment/opinion/five-myths-about-moocs/2010480.article

Liyanagunawardena, T., Williams, S., & Adams, A. A. (2013). The impact and reach of MOOCs: A developing countries’ perspective. eLearning Papers, 33, 38–46. Retrieved from http://centaur.reading.ac.uk/32452/1/In-depth_33_1.pdf

Liyanagunawardena, T., Parslow, P., & Williams, S. (2014, February 10–12). Dropout: MOOC participants’ perspective [Paper presentation]. EMOOCs 2014, the Second MOOC European Stakeholders Summit, 95-100. Lausanne, Switzerland. Retrieved from http://centaur.reading.ac.uk/36002

Milligan, C., & Littlejohn, A. (2014). Supporting professional learning in a massive open online course. The International Review of Research in Open and Distributed Learning, 15(5), 197–-213. https://doi.org/10.19173/irrodl.v15i5.1855

Milligan, C., Littlejohn, A., & Margaryan, A. (2013). Patterns of engagement in connectivist MOOCs. MERLOT Journal of Online Learning & Teaching, 9(2), 149–159. Retrieved from https://jolt.merlot.org/vol9no2/milligan_0613.pdf

Mori, K., & Ractliffe, L. (2016, April). Evaluating the use of a MOOC within higher education professional development training [Paper presentation]. The 25th International Conference Companion on World Wide Web, 831–-833. Montreal, Quebec, Canada. https://doi.org/10.1145/2872518.2890577

Morris, N. P., Hotchkiss, S., & Swinnerton, B. (2015, May 18–20). Can demographic information predict MOOC learner outcomes? [Paper presentation]. eMOOCs 2015, the Third European MOOC Stakeholder Summit, 199-207. Mons Belgium. Retrieved from http://eprints.whiterose.ac.uk/86184/

Murugesan, R., Nobes, A., & Wild, J. (2017). A MOOC approach for training researchers in developing countries. Open Praxis, 9(1), 45–57. http://dx.doi.org/10.5944/openpraxis.9.1.476

Ngalasso, M. M. (1992). Le concept de français langue seconde. Études de linguistique appliquée, 88, 27. Retrieved from https://search.proquest.com/docview/1307659507?accountid=16511

Nielson, B. (2014). The year of the corporate MOOC? LinkedIn. Retrieved from https://www.linkedin.com/today/post/article/20140320165303-16131081-2014-the-year-of-the-corporate-mooc

Nkuyubwatsi, B. (2014, March). Cultural translation in massive open online courses (MOOCs). eLearning Papers, 37, 1–10. Retrieved from shorturl.at/bgoBV

Noukakis, D., Escher, G., & Aebischer, P. (2016). De Lausanne à Yaoundé: L’aventure des MOOCs Pratiques et recherche sur les MOOCs, à Lausanne et en Afrique francophone. Annales des Mines: Réalités Industrielles, 2, 48–53. https://doi.org/10.3917/rindu1.162.0048

Patru, M., & Balaji, V. (2016). Making sense of MOOCs: A Guide for policy-makers in developing countries. OASIS: Commonwealth of Learning Open Access Repository. Retrieved from http://dspace.col.org/handle/11599/2356

Radford, A. W., Robles, J., Cataylo, S., Horn, L., Thornton, J., & Whitfield, K. (2014). The employer potential of MOOCs: A mixed-methods study of human resource professionals’ thinking on MOOCs. The International Review of Research in Open and Distributed Learning, 15(5). https://doi.org/10.19173/irrodl.v15i5.1842

Radford, A. W., Coningham, B., & Horn, L. (2015). MOOCs: Not just for college Students—How organizations can use MOOCs for professional development. Employment Relations Today, 41(4), 1–15. https://doi.org/10.1002/ert.21469

Richter, T., & McPherson, M. (2012). Open educational resources: Education for the world? Distance Education, 33(2), 201–219. https://doi.org/10.1080/01587919.2012.692068

Rohs, M., & Ganz, M. (2015). MOOCs and the claim of education for all: A disillusion by empirical data. The International Review of Research in Open and Distributed Learning, 16(6). https://doi.org/10.19173/irrodl.v16i6.2033

Selingo, J. J. (2014). MOOC U: Who is getting the most out of online education and why. Simon & Schuster.

Stewart, B. (2013). Massiveness + openness = new literacies of participation? MERLOT Journal of Online Learning and Teaching, 9(2), 228–238. Retrieved from https://jolt.merlot.org/vol9no2/stewart_bonnie_0613.pdf

Stump, G. S., Hilpert, J. C., Husman, J., Chung, W., & Kim, W. (2011). Collaborative learning in engineering students: Gender and achievement. Journal of Engineering Education, 100(3), 475–497. https://doi.org/10.1002/j.2168-9830.2011.tb00023.x

Tyack, D. B., & Cuban, L. (1995). Tinkering toward utopia. Harvard University Press.

Waldrop, M. M. (2013). Online Learning: Campus 2.0. Massive open online courses are transforming higher education and providing fodder for scientific research. Nature, 495, 160–163. https://doi.org/10.1038/495160a

Zhenghao, C., Alcorn, B., Christensen, G., Eriksson, N., Koller, D., & Emanuel, E. J. (2015, September 22). Who’s benefiting from MOOCs, and why. Harvard Business Review. Retrieved from https://hbr.org/2015/09/whos-benefiting-from-moocs-and-why

Zillien, N., & Hargittai, E. (2009). Digital distinction: Status‐specific types of Internet usage. Social Science Quarterly, 90(2), 274–291. https://doi.org/10.1111/j.1540-6237.2009.00617.x

Published
2020-07-02
How to Cite
Chaker, R., & Bachelet, R. (2020). Internationalizing Professional Development: Using Educational Data Mining to Analyze Learners’ Performance and Dropouts in a French MOOC. The International Review of Research in Open and Distributed Learning, 21(4), 199-221. https://doi.org/10.19173/irrodl.v21i4.4787
Section
Research Articles