Internationalizing Professional Development: Using Educational Data Mining to Analyze Learners’ Performance and Dropouts in a French MOOC
DOI:
https://doi.org/10.19173/irrodl.v21i4.4787Keywords:
MOOCs, learner grades, learner dropout, learner performance, academic cohorts, educational data mining, CHAID, low- and middle-income countries, developing countriesAbstract
This paper uses data mining from a French project management MOOC to study learners’ performance (i.e., grades and persistence) based on a series of variables: age, educational background, socio-professional status, geographical area, gender, self- versus mandatory-enrollment, and learning intentions. Unlike most studies in this area, we focus on learners from the French-speaking world: France and French-speaking European countries, the Caribbean, North Africa, and Central and West Africa. Results show that the largest gaps in MOOC achievements occur between 1) learners from partner institutions versus self-enrolled learners 2) learners from European countries versus low- and middle-income countries, and 3) learners who are professionally active versus inactive learners (i.e., with available time). Finally, we used the CHAID data-mining method to analyze the main characteristics and discriminant factors of MOOC learner performance and dropout.
References
Albelbisi, N., Yusop, F. D., & Salleh, U. K. M. (2018). Mapping the factors influencing success of massive open online courses (MOOC) in Higher Education. EURASIA Journal of Mathematics, Science, and Technology Education, 14(7), 2995–3012. https:/doi.org/10.29333/ejmste/91486
Allione, G., & Stein, R. M. (2016). Mass attrition: An analysis of drop out from principles of microeconomics MOOC. The Journal of Economic Education, 47(2), 174-186. https://doi.org/10.1080/00220485.2016.1146096
Altbach, P. G. (2014). MOOCs as neocolonialism: Who controls knowledge? International Higher Education, 75, 5–7. https://doi.org/10.6017/ihe.2014.75.5426
Bachelet, R., & Chaker, R. (2017). Toward a typology of MOOC activity patterns. In C. Delgado Kloos, P. Jermann, M. Pérez-Sanagustín, D. Seaton, & S. White (Eds.) Digital education: Out to the world and back to the campus. EMOOCs 2017. Lecture Notes in Computer Science, vol 10254 (pp. 134-139). Springer, Cham. https://doi.org/10.1007/978-3-319-59044-8_15
Bozkurt, A., Akgün-Özbek, E., & Zawacki-Richter, O. (2017). Trends and patterns in massive open online courses: Review and content analysis of research on MOOCs (2008–2015). The International Review of Research in Open and Distributed Learning, 18(5), 118-147. https://doi.org/10.19173/irrodl.v18i5.3080
Breslow, L., Pritchard, D. E., DeBoer, J., Stump, G. S., Ho, A. D., & Seaton, D. T. (2013). Studying learning in the worldwide classroom research into edX's first MOOC. Research & Practice in Assessment, 8, 13–25. Retrieved from https://www.rpajournal.com/studying-learning-in-the-worldwide-classroom-research-into-edxs-first-mooc/
Brouns, F., Teixeira, A., Morgado, L., Fano, S., Fueyo, A., & Jansen, D. (2017). Designing massive open online learning processes: the sMOOC pedagogical framework. In Open Education: from OERs to MOOCs (pp. 315-336). Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-52925-6_16
Castillo, N. M., Lee, J., Zahra, F. T., & Wagner, D. A. (2015). MOOCS for development: Trends, challenges, and opportunities. International Technologies & International Development, 11(2), 35. Retrieved from https://repository.upenn.edu/literacyorg_articles/6
Christensen, G., Steinmetz, A., Alcorn, B., Bennett, A., Woods, D., & Emanuel, E. J. (2013, November 6). The MOOC phenomenon: Who takes massive open online courses and why? [Working paper]. University of Pennsylvania. http://dx.doi.org/10.2139/ssrn.2350964
Colas, J. F., Sloep, P. B., & Garreta-Domingo, M. (2016). The effect of multilingual facilitation on active participation in MOOCs. The International Review of Research in Open and Distributed Learning, 17(4), 280-314. https:doi.org/10.19173/irrodl.v17i4.2470
Czerniewicz, L., Deacon, A., Small, J., & Walji, S. (2014). Developing world MOOCs: A curriculum view of the MOOC landscape. Journal of Global Literacies, Technologies, and Emerging Pedagogies, 2(3), 122-139. Retrieved from http://hdl.handle.net/11427/19562
Daniel, J., Vázquez Cano, E., & Gisbert, M. (2015). The future of MOOCs: Adaptive learning or business model? Educational Technology in Higher Education, 12(1), 64–73. http://dx.doi.org/10.7238/rusc.v12i1.2475
Dodson, M. N., Kitburi, K., & Berge, Z. L. (2015). Possibilities for MOOCs in corporate training and development. Performance Improvement, 54(10), 14–21. https://doi.org/: 10.1002/pfi.21532
Domingo, M., Paran, A., Révész, A., & Palange, A. (2019, January). Exploring factors that influence the impact of MOOC learning on participants’ professional practice. UCL Institute of Education, University College London. Retrieved from https://london.ac.uk/sites/default/files/leaflets/ExploringFactorsThatInfluenceTheImpactOfMOOCs_Final.pdf
Elias, T. (2011). 71. Universal instructional design principles for mobile learning. International Review of Research in Open and Distributed Learning, 12(2), 143-156. https://doi.org/10.19173/irrodl.v12i2.965
Emanuel, E. J. (2013). MOOCs taken by educated few. Nature, 503(342). https://doi.org/10.1038/503342a
Gamage, D., Perera, I., & Fernando, S. (2016, March 7–9). Evaluating effectiveness of MOOCs using empirical tools: Learners perspective. The 10th International Technology, Education and Development Conference (pp. 8276-8284). Valencia, Spain. https://doi.org/10.21125/inted.2016.0937
Garrido, M., Koepke, L., Andersen, S., Mena, A., Macapagal, M., & Dalvit, L. (2016). An examination of MOOC usage for professional workforce development outcomes in Colombia, the Philippines & South Africa. Technology & Social Change Group, University of Washington Information School. Retrieved from https://tascha.uw.edu/publications/an-examination-of-mooc-usage-for-professional-workforce-development-outcomes/
Guàrdia, L., Maina, M., & Sangrà, A. (2013). MOOC design principles: A pedagogical approach from the learner’s perspective. eLearning Papers, 33. Retrieved from https://r-libre.teluq.ca/596/1/In-depth_33_4.pdf
Guo, P. J., & Reinecke, K. (2014, March 4–5). Demographic differences in how students navigate through MOOCs [Paper presentation]. The First ACM Conference on Learning @ Scale, 21–30. Atlanta, Georgia. https://doi.org/10.1145/2556325.2566247
Hansen, J. D., & Reich, J. (2015). Democratizing education? Examining access and usage patterns in massive open online courses. Science, 350(6265), 1245–1248. https://doi.org/10.1126/science.aab3782
Henderikx, M. A., Kreijns, K., & Kalz, M. (2017). Refining success and dropout in massive open online courses based on the intention–behavior gap. Distance Education, 38(3), 353–368. https://doi.org/10.1080/01587919.2017.1369006
Hossain, J. (2010). Professional development of higher education teachers: Can ODL contribute? Turkish Online Journal of Distance Education, 11(1), 123–133. Retrieved from https://dergipark.org.tr/en/pub/tojde/issue/16907/176319
Hrdličková, Z., & Dooley, G. (2017, June). AuthorAID capacity development impact study 2017 [Summary report]. INASP. Retrieved from https://www.inasp.info/sites/default/files/2018-04/AuthorAID%20study%20%E2%80%93%20summary%20report.pdf
Jansen, D., Schuwer, R., Teixeira, A., & Aydin, C. H. (2015). Comparing MOOC adoption strategies in Europe: Results from the HOME project survey. International Review of Research in Open and Distributed Learning, 16(6), 116-136. https://doi.org/10.19173/irrodl.v16i6.2154
Jones, K. M., Stephens, M., Branch-Mueller, J., & de Groot, J. (2016). Community of practice or affinity space: A case study of a professional development MOOC. Education for Information, 32(1), 101–119. https://doi.org/10.3233/EFI-150965
Jordan, K. (2013, August 27). MOOC completion rates: The data. Katy Jordan. Retrieved from http://www.katyjordan.com/MOOCproject.html
Kaliisa, R., & Picard, M. (2017). A systematic review on mobile learning in higher education: The African perspective. TOJET: The Turkish Online Journal of Educational Technology, 16(1), 1–18. http://www.tojet.net/articles/v16i1/1611.pdf
King, M., Luan, B., & Lopes, E. (2018). Experiences of Timorese language teachers in a blended massive open online course (MOOC) for continuing professional development (CPD). Open Praxis, 10(3), 279-287. Retrieved from https://www.learntechlib.org/p/187316/
King, M., Pegrum, M., & Forsey, M. (2018). MOOCs and OER in the Global South: Problems and potential. The International Review of Research in Open and Distributed Learning, 19(5). https://doi.org/10.19173/irrodl.v19i5.3742
Kizilcec, R. F., & Halawa, S. (2015, March). Attrition and achievement gaps in online learning. In Proceedings of the Second (2015) ACM Conference on Learning@ Scale (pp. 57-66). https://doi.org/10.1145/2724660.2724680
Kizilcec, R. F., Pérez-Sanagustín, M., & Maldonado, J. J. (2017). Self-regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses. Computers & Education, 104, 18-33. https://doi.org/10.1016/j.compedu.2016.10.001
Koller, D., Ng, A., Do, C., & Chen, Z. (2013). Retention and intention in Massive Open Online Courses: In-depth. EDUCAUSE Review, 48(3), 62–63. Retrieved from https://er.educause.edu/articles/2013/6/retention-and-intention-in-massive-open-online-courses-in-depth
Labarthe, H., Bachelet, R., Bouchet, F., & Yacef, K. (2016, February 22–24). Increasing MOOC completion rates through social interactions: A recommendation system [Paper presentation]. eMOOCs 2016, the Fourth MOOC European Stakeholders Summit, 471–480. Graz, Austria. Retrieved from https://hal.archives-ouvertes.fr/hal-01277664/document
Lane, A. (2013, October 23–25). The potential of MOOCs to widen access to, and success in, higher education study [Paper presentation]. EADTU: The Open and Flexible Higher Education Conference 2013, 189–20. Paris, France. Retrieved from http://oro.open.ac.uk/id/eprint/38881
Launois, P., Allotey, P., Reidpath, D., Maher, D., Certain, E., & Ross, B. (2019). Lessons learnt from a professional development MOOC: Engaging culturally and linguistically diverse learners from low-and middle-income countries. European Journal of Open, Distance, and eLearning, 2. Retrieved from https://www.eurodl.org/?p=current&sp=brief&article=809
Laurillard, D. (2014, January 16). Five myths about MOOCs. Times Higher Education. Retrieved from https://www.timeshighereducation.com/comment/opinion/five-myths-about-moocs/2010480.article
Liyanagunawardena, T., Williams, S., & Adams, A. A. (2013). The impact and reach of MOOCs: A developing countries’ perspective. eLearning Papers, 33, 38–46. Retrieved from http://centaur.reading.ac.uk/32452/1/In-depth_33_1.pdf
Liyanagunawardena, T., Parslow, P., & Williams, S. (2014, February 10–12). Dropout: MOOC participants’ perspective [Paper presentation]. EMOOCs 2014, the Second MOOC European Stakeholders Summit, 95-100. Lausanne, Switzerland. Retrieved from http://centaur.reading.ac.uk/36002
Milligan, C., & Littlejohn, A. (2014). Supporting professional learning in a massive open online course. The International Review of Research in Open and Distributed Learning, 15(5), 197–-213. https://doi.org/10.19173/irrodl.v15i5.1855
Milligan, C., Littlejohn, A., & Margaryan, A. (2013). Patterns of engagement in connectivist MOOCs. MERLOT Journal of Online Learning & Teaching, 9(2), 149–159. Retrieved from https://jolt.merlot.org/vol9no2/milligan_0613.pdf
Mori, K., & Ractliffe, L. (2016, April). Evaluating the use of a MOOC within higher education professional development training [Paper presentation]. The 25th International Conference Companion on World Wide Web, 831–-833. Montreal, Quebec, Canada. https://doi.org/10.1145/2872518.2890577
Morris, N. P., Hotchkiss, S., & Swinnerton, B. (2015, May 18–20). Can demographic information predict MOOC learner outcomes? [Paper presentation]. eMOOCs 2015, the Third European MOOC Stakeholder Summit, 199-207. Mons Belgium. Retrieved from http://eprints.whiterose.ac.uk/86184/
Murugesan, R., Nobes, A., & Wild, J. (2017). A MOOC approach for training researchers in developing countries. Open Praxis, 9(1), 45–57. http://dx.doi.org/10.5944/openpraxis.9.1.476
Ngalasso, M. M. (1992). Le concept de français langue seconde. Études de linguistique appliquée, 88, 27. Retrieved from https://search.proquest.com/docview/1307659507?accountid=16511
Nielson, B. (2014). The year of the corporate MOOC? LinkedIn. Retrieved from https://www.linkedin.com/today/post/article/20140320165303-16131081-2014-the-year-of-the-corporate-mooc
Nkuyubwatsi, B. (2014, March). Cultural translation in massive open online courses (MOOCs). eLearning Papers, 37, 1–10. Retrieved from shorturl.at/bgoBV
Noukakis, D., Escher, G., & Aebischer, P. (2016). De Lausanne à Yaoundé: L’aventure des MOOCs Pratiques et recherche sur les MOOCs, à Lausanne et en Afrique francophone. Annales des Mines: Réalités Industrielles, 2, 48–53. https://doi.org/10.3917/rindu1.162.0048
Patru, M., & Balaji, V. (2016). Making sense of MOOCs: A Guide for policy-makers in developing countries. OASIS: Commonwealth of Learning Open Access Repository. Retrieved from http://dspace.col.org/handle/11599/2356
Radford, A. W., Robles, J., Cataylo, S., Horn, L., Thornton, J., & Whitfield, K. (2014). The employer potential of MOOCs: A mixed-methods study of human resource professionals’ thinking on MOOCs. The International Review of Research in Open and Distributed Learning, 15(5). https://doi.org/10.19173/irrodl.v15i5.1842
Radford, A. W., Coningham, B., & Horn, L. (2015). MOOCs: Not just for college Students—How organizations can use MOOCs for professional development. Employment Relations Today, 41(4), 1–15. https://doi.org/10.1002/ert.21469
Richter, T., & McPherson, M. (2012). Open educational resources: Education for the world? Distance Education, 33(2), 201–219. https://doi.org/10.1080/01587919.2012.692068
Rohs, M., & Ganz, M. (2015). MOOCs and the claim of education for all: A disillusion by empirical data. The International Review of Research in Open and Distributed Learning, 16(6). https://doi.org/10.19173/irrodl.v16i6.2033
Selingo, J. J. (2014). MOOC U: Who is getting the most out of online education and why. Simon & Schuster.
Stewart, B. (2013). Massiveness + openness = new literacies of participation? MERLOT Journal of Online Learning and Teaching, 9(2), 228–238. Retrieved from https://jolt.merlot.org/vol9no2/stewart_bonnie_0613.pdf
Stump, G. S., Hilpert, J. C., Husman, J., Chung, W., & Kim, W. (2011). Collaborative learning in engineering students: Gender and achievement. Journal of Engineering Education, 100(3), 475–497. https://doi.org/10.1002/j.2168-9830.2011.tb00023.x
Tyack, D. B., & Cuban, L. (1995). Tinkering toward utopia. Harvard University Press.
Waldrop, M. M. (2013). Online Learning: Campus 2.0. Massive open online courses are transforming higher education and providing fodder for scientific research. Nature, 495, 160–163. https://doi.org/10.1038/495160a
Zhenghao, C., Alcorn, B., Christensen, G., Eriksson, N., Koller, D., & Emanuel, E. J. (2015, September 22). Who’s benefiting from MOOCs, and why. Harvard Business Review. Retrieved from https://hbr.org/2015/09/whos-benefiting-from-moocs-and-why
Zillien, N., & Hargittai, E. (2009). Digital distinction: Status‐specific types of Internet usage. Social Science Quarterly, 90(2), 274–291. https://doi.org/10.1111/j.1540-6237.2009.00617.x
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International Licence. The copyright of all content published in IRRODL is retained by the authors.
This copyright agreement and use license ensures, among other things, that an article will be as widely distributed as possible and that the article can be included in any scientific and/or scholarly archive.
You are free to
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
The licensor cannot revoke these freedoms as long as you follow the license terms below:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.