The 20-Year Evolution of Distance Education: A Bibliometric and LDA-Based Topic Model Analysis

Mehmet Yavuz; Şener Balat; Bünyami Kayalı; Emirhan Gülen

doi:10.19173/irrodl.v27i3.9164

Authors

Mehmet Yavuz Bingöl University, Türkiye https://orcid.org/0000-0001-6218-232X
Şener Balat Bingöl University, Türkiye https://orcid.org/0000-0002-9683-1778
Bünyami Kayalı Bayburt University, Türkiye https://orcid.org/0000-0001-6419-9088
Emirhan Gülen Bingöl University, Türkiye https://orcid.org/0000-0002-8396-722X

DOI:

https://doi.org/10.19173/irrodl.v27i3.9164

Keywords:

distance education, machine learning, topic modeling, LDA, bibliometric analysis

Abstract

Although research on distance education has increased substantially in recent years, comprehensive analyses capturing the overall thematic development of the field remain limited. Modeling studies are necessary to address this gap and to uncover long-term research trends. This study aimed to reveal the trends of research conducted in the field of distance education in the last two decades by using machine learning methodology and bibliometric analysis. The unique aspect of the study was its use of the Latent Dirichlet Allocation (LDA) algorithm, a machine learning method for analysing large-scale data. Within the scope of the study, 54,444 articles in the Web of Science database were analysed. Bibliometric analysis revealed that distance education had gained significant momentum, especially in the post-pandemic period, with a wide range of applications in different disciplines such as education, management, and health. As a result of LDA analysis, 19 thematic topics were identified. Among these, digitalization, artificial intelligence, Web-based learning, and social interaction and collaboration stood out. Time series analysis showed an increasing trend for topics such as artificial intelligence and emergency distance education over the years, with less interest shown in topics such as Web-based learning and program design. The study emphasized that distance education is in a technology-driven transformation process and pointed to areas that will offer new opportunities for researchers. Furthermore, recommendations for decision-makers, such as investments in digital infrastructure, integration of artificial intelligence-based systems, and the establishment of quality standards, also emerged.

References

Aggarwal, C. C., & Zhai, C. (2012). A survey of text classification algorithms. In C. C. Aggarwal & C. Zhai (Eds.), Mining text data (pp. 163–222). Springer. https://doi.org/10.1007/978-1-4614-3223-4_6

Al-Tkhayneh, K. M., Alghazo, E. M., & Tahat, D. (2023). The advantages and disadvantages of using artificial intelligence in education. Journal of Educational and Social Research, 13(4), 105–116. https://doi.org/10.36941/jesr-2023-0094

Amoozegar, A., Khodabandelou, R., & Ale Ebrahim, N. (2018). Major trends in distance education research: A combination of bibliometric and thematic analysis. International Journal of Information Research and Review, 5(2), 5352–5359. https://doi.org/10.6084/m9.figshare.6210536

Anderson, T. (Ed.). (2008). The theory and practice of online learning (2nd ed.). AU Press. https://doi.org/10.15215/aupress/9781897425084.01

Aydın, C. H., Zawacki-Richter, O., & Bozkurt, A. (2020, June). A review and content analysis of the Turkish Online Journal of Distance Education publications between 2000 and 2015. EDEN conference proceedings, 1, (pp. 217–225). https://doi.org/10.38069/edenconf-2020-ac0020

Aziz, S., Dowling, M., Hammami, H., & Piepenbrink, A. (2022). Machine learning in finance: A topic modeling approach. European Financial Management, 28(3), 744–770. https://doi.org/10.1111/eufm.12326

Bates, T. (2014). The role of technology in distance education. Taylor & Francis. https://doi.org/10.4324/9781315738598

Berge, Z. L., & Mrozowski, S. (2001). Review of research in distance education, 1990 to 1999. American Journal of Distance Education, 15(3), 5–19. https://doi.org/10.1080/08923640109527090

Blei, D. M. (2012). Probabilistic topic models. Communications of the Association for Computing Machinery, 55(4), 77–84. https://doi.org/10.1145/2133806.2133826

Blyznyuk, T., Budnyk, O., & Kachak, T. (2021). Boom in distance learning during the coronavirus pandemic: Challenges and possibilities. Journal of Vasyl Stefanyk Precarpathian National University, 8(1), 90–98. https://doi.org/10.15330/jpnu.8.1.90-98

Bozkurt, A. (2020). Coronavirus (COVID-19) pandemic process and education in the world after the pandemic evaluations: The new normal and the new educational paradigm. Journal of Open Education Applications and Research, 6(3), 112–142. https://izlik.org/JA99ML86GW

Bozkurt, A., Kır, Ş., Şenocak, D., Elibol, S., Özer, N., Orhan, G., Alpat, M. F., Çimen, E. E., Çankırlı, E., & İbileme, A. İ. (2022). Research tendencies in the discipline of distance education (2015–2022): Examination of doctoral theses in higher education in Turkey. Proceedings of the Fifth International Open & Distance Learning Conference (pp. 355–366). https://doi.org/10.5281/zenodo.7428522

Bozkurt, A., Kumtepe, E. G., Kumtepe, A. T., Aydın, İ. E., Bozkaya, M., & Aydın, C. H. (2015). Research trends in Turkish distance education: A content analysis of dissertations, 1986–2014. European Journal of Open, Distance and E-learning, 18(2), 1–21. https://doi.org/10.1515/eurodl-2015-0010

Bozkurt, A., & Sharma, R. C. (2020). Emergency remote teaching in a time of global crisis due to coronavirus pandemic. American Journal of Distance Education, 15(1), i–vi. https://doi.org/10.5281/zenodo.3778083

Bozkurt, A., & Zawacki-Richter, O. (2021). Trends and patterns in distance education (2014–2019): A synthesis of scholarly publications and a visualization of the intellectual landscape. International Review of Research in Open and Distributed Learning, 22(2), 19–45. https://doi.org/10.19173/irrodl.v22i2.5381

Bozkurt, A., Zawacki-Richter, O., & Aydın, C. H. (2019). Using social network analysis to review the research in open and distance learning. Proceedings of the Association for Educational Communications and Technology 2019 International Convention (pp. 38–44). Las Vegas, NV, United States.

Can, E. (2020). Coronavirus (COVID-19) pandemic and its pedagogical reflections: Open and distance education practices in Turkey. Journal of Open Education Applications and Research, 6(2), 11–53. https://izlik.org/JA32KL96LX

Charan, J. (2014). Impact factor: Is this a true measure of quality? International Journal of Medical Science and Public Health, 3(3), 246–247. https://doi.org/10.5455/ijmsph.2014.190420141

Cornali, F. (2024). In platform we trust(?): Concepts, problems and a case study about platform education. European Journal of Education, 59(4), e12702. https://doi.org/10.1111/ejed.12702

Daniel, J. (2012). Making sense of MOOCs: Musings in a maze of myth, paradox and possibility. Journal of Interactive Media in Education, 2012(3), 18. https://doi.org/10.5334/2012-18

Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008

Debortoli, S., Müller, O., Junglas, I., & Vom Brocke, J. (2016). Text mining for information systems researchers: An annotated topic modeling tutorial. Communications of the Association for Information Systems, 39(1), 7. https://doi.org/10.17705/1CAIS.03907

Delling, R. M. (1971). Grundzüge einer Wissenschaft vom Fernstudium [Fundamentals of the science of distance learning]. Epistolodidaktika, 1, 14–28.

Djeki, E., Dégila, J., Bondiombouy, C., & Alhassan, M. H. (2022). E-learning bibliometric analysis from 2015 to 2020. Journal of Computers in Education, 9(4), 727–754. https://doi.org/10.1007/s40692-021-00218-4

Ellaway, R. H. (2018). Technology-enhanced learning. In T. Swanwick (Ed.), Understanding medical education: Evidence, theory, and practice (2nd ed., pp. 139–149). Wiley-Blackwell. https://doi.org/10.1002/9781119373780.ch10

Fu, H., Xiao, Y., Mensah, I. K., & Wang, R. (2024). Exploring the configurations of learner satisfaction with MOOCs designed for computer science courses based on integrated LDA-QCA method. Education and Information Technologies, 29(8), 9883–9905. https://doi.org/10.1007/s10639-023-12185-7

Garrison, D. R., Anderson, T., & Archer, W. (2000). Critical inquiry in a text‐based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2–3), 87–105. https://doi.org/10.1016/S1096-7516(00)00016-6

Griffiths, T. L., & Steyvers, M. (2004). Finding scientific topics. Proceedings of the National Academy of Sciences, 101(1), 5228–5235. https://doi.org/10.1073/pnas.0307752101

Gunawardena, C. N., & McIsaac, M. S. (2013). Distance education. In Jonassen, D., & Driscoll, M. (Eds.), Handbook of research on educational communications and technology (pp. 361–401). Routledge. https://doi.org/10.4324/9781410609519

Gurcan, F., Özyurt, Ö., & Çağıltay, N. E. (2021). Investigation of emerging trends in the e-learning field using latent Dirichlet allocation. International Review of Research in Open and Distributed Learning, 22(2), 1–18. https://doi.org/10.19173/irrodl.v22i2.5358

Hakan, C., Zawacki-Richter, O., & Bozkurt, A. (2020, June). A review and content analysis of the Turkish online journal of distance education publications between 2000 and 2015. In EDEN Conference Proceedings, 1, (pp. 217–225). https://doi.org/10.38069/edenconf-2020-ac0020

Hamal, O., El Faddouli, N. E., Harouni, M. H. A., & Lu, J. (2022). Artificial intelligence in education. Sustainability, 14(5), 2862. https://doi.org/10.3390/su14052862

Henderson, M., Selwyn, N., & Aston, R. (2017). What works and why? Student perceptions of “useful” digital technology in university teaching and learning. Studies in Higher Education, 42(8), 1567–1579. https://doi.org/10.1080/03075079.2015.1007946

Hodges, C., Moore, S., Lockee, B., Trust, T., & Bond, A. (2020). The difference between emergency remote teaching and online learning. EDUCAUSE Review, 27(1), 1–9. https://er.educause.edu/articles/2020/3/the-difference-between-emergency-remote-teaching-and-online-learning

Howell, S. L., Williams, P. B., & Lindsay, N. K. (2003). Thirty-two trends affecting distance education: An informed foundation for strategic planning. Online Journal of Distance Learning Administration, 6(3). https://www.westga.edu/~distance/ojdla/fall63/howell63.html

Hrastinski, S. (2008). What is online learner participation? A literature review. Computers & Education, 51(4), 1755–1765. https://doi.org/10.1016/j.compedu.2008.05.005

Huang, Y. (2021). Strategies for enhancing student interaction in an online health promotion course. College Student Journal, 55(1), 1–6. https://eric.ed.gov/?id=EJ1313964

Kaldoudi, E., Konstantinidis, S., & Bamidis, P. D. (2010). Web advances in education: Interactive, collaborative learning via Web 2.0. In M. D. Lytras, P. Ordóñez de Pablos, A. Ziderman, E. Damiani, D. Avison, & J. B. E. M. L. Horner (Eds.), Affective, interactive and cognitive methods for e-learning design: Creating an optimal education experience (pp. 32–50). IGI Global. https://doi.org/10.4018/978-1-60566-940-3.ch003

Kanishcheva, N. A. (2022, February). The role of distance learning in the development of the digital economy. International Scientific and Practical Conference Strategy of Development of Regional Ecosystems (pp. 198–203). Atlantis Press. https://doi.org/10.2991/assehr.k.220208.029

Karagözoğlu, A. A., Abdurrezzak, S., & Doğan, Ü. (2024). A bibliometric analysis of studies on distance education. Anadolu Journal of Educational Sciences International, 14(1), 449–474. https://doi.org/10.18039/ajesi.1281711

Karl, A., Wisnowski, J., & Rushing, W. H. (2015). A practical guide to text mining with topic extraction. Wiley Interdisciplinary Reviews: Computational Statistics, 7(5), 326–340. https://doi.org/10.1002/wics.1361

Konrad, M. (2017). Text mining and topic modeling toolkit. PyPI. https://pypi.org/project/tmtoolkit/

Kurulgan, M. (2024). A bibliometric analysis of research on dropout in open and distance learning. Turkish Online Journal of Distance Education, 25(4), 200–229. https://doi.org/10.17718/tojde.1355394

Lagos-Castillo, A., Chiappe, A., Ramirez-Montoya, M. S., & Becerra Rodríguez, D. F. (2025). Mapping the intelligent classroom: Examining the emergence of personalized learning solutions in the digital age. Contemporary Educational Technology, 17(1), ep543. https://doi.org/10.30935/cedtech/15617

Li, C., Wang, H., Zhang, Z., Sun, A., & Ma, Z. (2016, July). Topic modeling for short texts with auxiliary word embeddings. Proceedings of the 39th International Conference on Research and Development in Information Retrieval (pp. 165–174). Association for Computing Machinery. https://doi.org/10.1145/2911451.2911499

Martin, A. J. (2023). University students’ motivation and engagement during the COVID-19 pandemic: The roles of lockdown, isolation, and remote and hybrid learning. Australian Journal of Education, 67(2), 163–180. https://doi.org/10.1177/00049441231179791

Means, B., Toyama, Y., Murphy, R., & Baki, M. (2013). The effectiveness of online and blended learning: A meta-analysis of the empirical literature. Teachers College Record, 115(3), 1–47. https://doi.org/10.1177/016146811311500307

Mishra, S., Sahoo, S., & Pandey, S. (2021). Research trends in online distance learning during the COVID-19 pandemic. Distance Education, 42(4), 494–519. https://doi.org/10.1080/01587919.2021.1986373

Moore, M. G., & Kearsley, G. (2012). Distance education: A systems view of online learning. Cengage.

National Forum. (2021). Next steps for teaching and learning: Moving forward together. Key themes in online and blended learning, 2010–2020. https://www.teachingandlearning.ie/wp-content/uploads/Key-themes-in-online-and-blended-learning-2010-2020.pdf

Oviatt, D., Burdis, J., & West, R. E. (2012). Distance education, 2000–2010. Educational Technology, 52(1), 44–48. http://www.jstor.org/stable/44429990

Özmen, E., & Kan, A. Ü. (2021). Bibliometric analysis of theses on distance education in Turkey between 2015–2020. Turkish Studie Educational Sciences, 16(4), 2005–2027. https://doi.org/10.47423/TurkishStudies.51788

Pai, K.-C., Kuo, B.-C., Liao, C.-H., & Liu, Y.-M. (2021). An application of Chinese dialogue-based intelligent tutoring system in remedial instruction for mathematics learning. Educational Psychology, 41(2), 137–152. https://doi.org/10.1080/01443410.2020.1731427

Park, S. Y., Nam, M.-W., & Cha, S.-B. (2012). University students’ behavioral intention to use mobile learning: Evaluating the technology acceptance model. British Journal of Educational Technology, 43(4), 592–605. https://doi.org/10.1111/j.1467-8535.2011.01229.x

Peña-Ayala, A. (Ed.). (2014). Educational data mining: Applications and trends. Springer. https://doi.org/10.1007/978-3-319-02738-8

Peters, O. (2014). Foreword. In O. Zawacki-Richter & T. Anderson (Eds.), Online distance education: Towards a research agenda (pp. ix–xii). Athabasca University Press. http://dx.doi.org/10.15215/aupress/9781927356623.01

Saba, F. (2000). Research in distance education: A status report. International Review of Research in Open and Distributed Learning, 1(1), 1–9. https://doi.org/10.19173/irrodl.v1i1.4

Savery, J. R. (2009). Problem-based approach to instruction. In C. M. Reigeluth & A. A. Carr-Chellman (Eds.), Instructional-design theories and models: Building a common knowledge base (Vol. III, pp. 155–178). Routledge.

Selwyn, N. (2019). Should robots replace teachers? AI and the future of education. John Wiley & Sons. https://doi.org/10.1002/9781119340829

Siemens, G. (2005). Connectivism: A learning theory for the digital age. Elearnspace. http://www.elearnspace.org/Articles/connectivism.htm

Siemens, G., & Long, P. (2011). Penetrating the fog: Analytics in learning and education. EDUCAUSE Review, 46(5), 30–40. https://er.educause.edu/articles/2011/9/penetrating-the-fog-analytics-in-learning-and-education

Teo, T. (2019). Students and teachers’ intention to use technology: Assessing their measurement equivalence and structural invariance. Journal of Educational Computing Research, 57(1), 201–225. https://doi.org/10.1177/0735633117749430

Veletsianos, G. (2020). Learning online: The student experience. Johns Hopkins University Press.

Wallach, H. M. (2006, June). Topic modeling: Beyond bag-of-words. Proceedings of the 23rd International Conference on Machine Learning (pp. 977–984). Association for Computing Machinery. https://doi.org/10.1145/1143844.1143967

Watermeyer, R., Crick, T., Knight, C., & Goodall, J. (2021). COVID-19 and digital disruption in UK universities: Afflictions and affordances of emergency online migration. Higher Education, 81(3), 623–641. https://doi.org/10.1007/s10734-020-00561-y

Whalley, B., France, D., Park, J., Mauchline, A., & Welsh, K. (2021). Towards flexible personalized learning and the future educational system in the fourth industrial revolution in the wake of COVID-19. Higher Education Pedagogies, 6(1), 79–99. https://doi.org/10.1080/23752696.2021.1883458

Xiao, J. (2023). Critical issues in open and distance education research. International Review of Research in Open and Distributed Learning, 24(2), 213–228. https://doi.org/10.19173/irrodl.v24i2.6881

Yavuz, M., Kayalı, B., Balat, Ş., & Karaman, S. (2020). Review of distance learning applications in the universities in the COVID-19 period. Journal of National Education, 49(1), 129–154. https://doi.org/10.37669/milliegitim.784822

Yılmaz Özden, Ş., Hamutoğlu, N. B., Kıyıcı, M., & Bozkurt, A. (2023). Investigation of research trends in educational technologies based on scientometric method (1965–2020): A cross-comparative study between publications from the world and the UK. Educational Technology Research and Development, 71(4), 1421–1447. https://doi.org/10.1007/s11423-023-10224-1

Yörük, T. (2024). Artificial intelligence and personalised learning in education. In S. Karataş (Ed.), International research in the field of educational sciences XXIII, (pp. 21–34). Eğitim Publisher.

Zankadi, H., Idrissi, A., Daoudi, N., & Hilal, I. (2023). Identifying learners’ topical interests from social media content to enrich their course preferences in MOOCs using topic modeling and NLP techniques. Education and Information Technologies, 28(5), 5567–5584. https://doi.org/10.1007/s10639-022-11373-1

Zawacki-Richter, O., Bäcker, E. M., & Vogt, S. (2009). Review of distance education research (2000 to 2008): Analysis of research areas, methods, and authorship patterns. International Review of Research in Open and Distributed Learning, 10(6), 21–50. https://doi.org/10.19173/irrodl.v10i6.741

Zawacki-Richter, O., Marin, V. I., Bond, M., & Gouverneur, F. (2020). Systematic review of research on artificial intelligence applications in higher education. International Journal of Educational Technology in Higher Education, 17(1), 1–27. https://doi.org/10.1186/s41239-019-0171-0

Zawacki-Richter, O., & Naidu, S. (2016). Mapping research trends from 35 years of publications in Distance Education. Distance Education, 37(3), 245–269. https://doi.org/10.1080/01587919.2016.1185079

Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory Into Practice, 41(2), 64–70. https://doi.org/10.1207/s15430421tip4102_2