A Systematic Review of Systematic Reviews on Open Educational Resources: An Analysis of the Legal and Technical Openness
Keywords:open educational resources, legal openness, technical openness, systematic review, PRISMA
Almost all open educational resources (OER) definitions encompass key concepts such as the 5R activities and open licenses. However, little attention is given to the technical aspects and tools that allow the user to interact with these resources. This study aims to answer five research questions regarding (a) 5R activities, (b) open licenses and intellectual property, (c) technical aspects, (d) tools for developing OER, and (e) the topic of sustainability. To answer these questions, a systematic review of systematic reviews on OER was conducted following the reporting checklist of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). Sixteen studies were eligible and included in this review. The main findings suggest that although most studies did not mention the term 5R exactly, they mentioned related terms, such as share and adaptation. There was also a tendency toward focusing on more legal issues than technical aspects. Besides, most of the studies that mentioned tools discussed them as platforms to access OER, not exactly tools that encourage users to develop or adapt resources in an easy way. In relation to sustainability, several studies highlighted the relevance of developing sustainable OER models, but only a few suggested approaches to sustain an OER project. Therefore, with this article, we hope to raise awareness of the importance of the technical openness and tools that might contribute to fostering users’ engagement with the OER, helping them to act as producers and contributors rather than mere passive receivers.
Arimoto, M. M., & Barbosa, E. F. (2012). A systematic review of methods for developing open educational resources. In G. Biswas, L.-H. Wong, T. Hirashima, & W. Chen (Eds.), Proceedings of the 20th International Conference on Computers in Education, ICCE 2012 (pp. 262–269). Asia-Pacific Society for Computers in Education. https://apsce.net/conference_4_detail.php?id=710
Axe, J., Childs, E., DeVries, I., & Webster, K. (2020). Student experiences of open educational practices: A systematic literature review. Journal of E-Learning and Knowledge Society, 16(4), 67–75. https://doi.org/10.20368/1971-8829/1135340
Clinton, V. (2019). Cost, outcomes, use, and perceptions of open educational resources in psychology: A narrative review of the literature. Psychology Learning and Teaching, 18(1), 4–20. https://doi.org/10.1177/1475725718799511
Craig, C. D. (2020). 2020 pandemic: Resilient Canadian higher education institutions will integrate OER. In N. Callaos, B. Muirhead, L. Robertson, B. Sanchez, & M. Savoie (Eds.), 14th International Multi-Conference on Society, Cybernetics and Informatics (IMSCI 2020) (pp. 149–153). International Institute of Informatics and Systemics. https://www.proceedings.com/content/056/056306webtoc.pdf
Creative Commons. (n.d.). Open education. https://creativecommons.org/about/program-areas/education-oer/
Creative Commons. (2020). What is OER? https://wiki.creativecommons.org/wiki/What_is_OER%3F
Dichev, C., Bhattarai, B., Clonch, C., & Dicheva, D. (2011). Towards better discoverability and use of open content. In D. Dicheva, Z. Markov, & E. Stefanova (Eds.), Proceedings of S3T’11 Third International Conference on Software, Services and Semantic Technologies (pp. 195–203). Springer. https://doi.org/10.1007/978-3-642-23163-6
Hilton, J., III, Wiley, D., Stein, J., & Johnson, A. (2010). The four ‘R’s of openness and ALMS analysis: Frameworks for open educational resources. Open Learning: The Journal of Open, Distance and E-learning, 25(1), 37–44. https://doi.org/10.1080/02680510903482132
Hilton, J., III. (2016). Open educational resources and college textbook choices: A review of research on efficacy and perceptions. Educational Technology Research and Development, 64(4), 573–590. https://doi.org/10.1007/s11423-016-9434-9
Hylén, J., Pedro, F., Schuller, T., & Allen-Sinclair, A. (2007). Giving knowledge for free: The emergence of open educational resources. OECD. https://doi.org/10.1787/9789264032125-en
Ivanova, M., Grosseck, G., & Holotescu, C. (2020). Analysis and modeling the domain of open educational resources from learning analytics perspective. In I. Roceanu (Ed.), The 16th International Scientific Conference of e-Learning and Software for Education: E-Learning sustainment for never-ending learning (Vol. III, pp. 66–74). E-Learning and Software for Education. https://doi.org/10.12753/2066-026X-20-178
King, M., Pegrum, M., & Forsey, M. (2018). MOOCs and OER in the Global South: Problems and potential. The International Review of Research in Open and Distributed Learning, 19(5). https://doi.org/10.19173/irrodl.v19i5.3742
Levin, D. (2017). An assessment of the technical infrastructure for open educational resources. EdTech Strategies. https://hewlett.org/library/oer-technology-infrastructure-assessment/
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: Explanation and elaboration. BMJ (Clinical Research Ed.), 339. https://doi.org/10.1136/bmj.b2700
Luo, T., Hostetler, K., Freeman, C., & Stefaniak, J. (2020). The power of open: Benefits, barriers, and strategies for integration of open educational resources. Open Learning, 35(2), 140–158. https://doi.org/10.1080/02680513.2019.1677222
Meng, X., Cui, C., & Wang, X. (2020). Looking back before we move forward: A systematic review of research on open educational resources. In Y. Xie, J. M. Pereira Barroso, & Y.-M. Huang (Eds.), Proceedings – 2020 9th International Conference of Educational Innovation Through Technology, EITT 2020 (pp. 92–96). IEEE. https://doi.org/10.1109/EITT50754.2020.00022
Moon, J., & Park, Y. (2021). A scoping review on open educational resources to support interactions of learners with disabilities. The International Review of Research in Open and Distributed Learning, 22(2), 314–341. https://doi.org/10.19173/irrodl.v22i2.5110
Moreno, N., Caro, E. T., & Cabedo, R. (2018). Systematic review: OER and disability. In M. El Mohajir, M. Al Achhab, B. El Mohajir, & I. Jellouli (Eds.), 2018 IEEE 5th International Congress on Information Science and Technology (CiSt) (pp. 428–431). IEEE. https://doi.org/10.1109/CIST.2018.8596659
Paragarino, V. R., Silveira, I. F., & Llamas-Nistal, M. (2018). Open educational resources: A brief vision from IEEE topics. In C. Gonzalez, M. Castro, & M. Llamas (Eds.), Proceedings of 2018 IEEE Global Engineering Education Conference (EDUCON) (pp. 2076–2081). IEEE. https://doi.org/10.1109/EDUCON.2018.8363495
Tlili, A., Huang, R., Chang, T. W., Nascimbeni, F., & Burgos, D. (2019). Open educational resources and practices in China: A systematic literature review. Sustainability (Switzerland), 11(18), Article 4867. https://doi.org/10.3390/su11184867
UNESCO. (2002). Forum on the impact of open courseware for higher education in developing countries: Final report. https://unesdoc.unesco.org/ark:/48223/pf0000128515
UNESCO. (2019). Recommendation on open educational resources (OER). https://www.unesco.org/en/legal-affairs/recommendation-open-educational-resources-oer
Wang, X., Liu, M., Li, Q., & Gao, Y. (2017). A bibliometric analysis of 15 years of research on open educational resources. In S. L. Wong (Ed.), Proceedings of the 25th International Conference on Computers in Education, ICCE 2017 - Main conference proceedings (pp. 296–305). Asia-Pacific Society for Computers in Education.
Wiley, D. (2014). Defining the “open” in open content and open educational resources. Opencontent.org. http://opencontent.org/definition/
William and Flora Hewlett Foundation. (2018, April 20). How can technology advance open educational resources? https://hewlett.org/how-can-technology-advance-open-educational-resources/
Wong, B. T. M., & Li, K. C. (2019). Using open educational resources for teaching in higher education: A review of case studies. In Proceedings - 2019 International Symposium on Educational Technology, ISET 2019 (pp. 186–190). IEEE. https://doi.org/10.1109/ISET.2019.00046
Yuan, M., & Recker, M. (2015). Not all rubrics are equal: A review of rubrics for evaluating the quality of open educational resources. The International Review of Research in Open and Distributed Learning, 16(5). https://doi.org/10.19173/irrodl.v16i5.2389
Zhang, X., Tlili, A., Nascimbeni, F., Burgos, D., Huang, R., Chang, T. W., Jemni, M., & Khribi, M. K. (2020). Accessibility within open educational resources and practices for disabled learners: A systematic literature review. Smart Learning Environments, 7(1). https://doi.org/10.1186/s40561-019-0113-2
How to Cite
This work is licensed under a Creative Commons Attribution 4.0 International License.
This work is licensed under a Creative Commons Attribution 4.0 International Licence. The copyright of all content published in IRRODL is retained by the authors.
This copyright agreement and use license ensures, among other things, that an article will be as widely distributed as possible and that the article can be included in any scientific and/or scholarly archive.
You are free to
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
The licensor cannot revoke these freedoms as long as you follow the license terms below:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.