International Review of Research in Open and Distributed Learning

Volume 23, Number 2

May - 2022

 

Ukrainian E-Learning Platforms for Schools: Evaluation of Their Functionality

 

Maryna Zhenchenko1, Oksana Melnyk2, Yaroslava Prykhoda3, and Igor Zhenchenko4
1,3Taras Shevchenko National University of Kyiv, Ukraine; 2Institute of Educational Content Modernization, Ukraine; 4Borys Grinchenko Kyiv University, Ukraine

 

Abstract

This article defines 27 criteria for evaluating the functionality of e-learning platforms, grouped into three macro groups: (a) learning management, (b) learning content management, and (c) communications and collaboration tools. The proposed criteria can be used to evaluate any e-learning platform’s functionality. They allow teachers and administrators to make conscious choices about the highest-quality e-learning platform for their schools and developers to improve e-learning platforms’ functionality. The developed criteria became the basis for rating the functionality of Ukrainian developers’ eight e-learning platforms’ and determining the degree of support (in whole or partly) of e-learning components, categorized on the cognitive, social constructivist, motivation, and e-learning theories (CT, SCT, MT, and E-LT). The results indicate that the lack of communication and collaboration tools necessary to ensure quality distance learning is the main problem of Ukrainian e-leaning platforms. Comparative analysis of the functionality of e-learning platforms and components categorized on the learning theories helped determine that only three of the eight Ukrainian e-learning platforms (Accent [Mobischool], Class Assessment, My Class) fully follow the CT, SCT, and MT, but these platforms are all commercial products; therefore, they only partially support the E-LT. Solving this problem will be facilitated by developing e-learning platforms with open access, financed by the state budget in the context of the development of open and distance learning for Ukrainian students, as well as improving communication and collaboration tools in the context of conforming e-learning components to the social constructivist learning theory.

Keywords: e-learning platform, evaluation, functional suitability, open and distance education, learning theories

Introduction

The COVID-19 pandemic has affected all educational institutions in the world. The government of Ukraine, trying to restrain the spread of COVID-19, decided to close all educational institutions on March 12, 2020. This lockdown lasted until the end of the school year (May 2020). According to UNESCO’s global monitoring, this nationwide closure affected 1,676,550 primary school students and 2,376,878 secondary school students in Ukraine (UNESCO, 2020), all of whom massively moved to distance learning.

Distance education is defined by the Association for Educational Communications and Technology as “institution-based, formal education where the learning group is separated, and where interactive telecommunications systems are used to connect learners, resources and instructors” (Parchure, 2016, p. 63). The distance learning format has actualized teachers’ use of e-learning platforms that differ both in structure and offered functions. Piotrowski (2010, p. 20) defines e-learning platforms as “software that provides the technical infrastructure on which e-learning activities can take place.” Ouadoud et al. (2016b, p. 582) emphasize that “a type LMS (Learning Management System) e-learning platform is a software including services to assist teachers in the management of their course” Ecoutin (2000, p. 5) describes open and distance learning platforms as software that assists in distance learning and combines the tools needed “for the three main users—teacher, student, administrator.”

An important problem in the implementation of e-learning platforms in distance education is the lack of clear criteria for assessing their quality. In evaluating e-learning platforms, Tomczyk et al. (2020) looked at the following criteria in teachers’ and students’ surveys: general course quality, professionally prepared materials, content usefulness, visual design, and the innovative character of platforms. Pandu and Fajar (2019) and Abubakari et al. (2021) evaluated e-learning platforms via the User Experience Questionnaire (UEQ). The UEQ consists of six scales with 26 items reflecting the following basic components: (a) attractiveness, (b) dependability, (c) efficiency, (d) perspicuity, (e) novelty, and (f) stimulation (Abubakari et al., 2021, p 4; Schrepp, 2015).

However, surveys of students and teachers mostly provide their opinions about using e-learning platforms (Pandu & Fajar, 2019, p. 1) and are not sufficient in evaluating e-learning platforms’ functionality and their ability to provide quality distance learning based on the e-learning components categorized by the following learning theories: cognitive theory (CT), social constructivist theory (SCT), motivation theory (MT), and e-learning theory (E-LT) (Kumar & Sharma, 2021; Schunk, 2020).

Defining criteria that can be used to rate the functionality of e-learning platforms, and to determine their effectiveness in the context of existing learning theories, will allow teachers and administrators to make a conscious choice about the highest-quality e-learning platform to use at their schools, and it will allow developers to see how to improve the functionality of their e-learning platforms.

The objectives of this study were twofold:

  1. to define criteria for assessing the functionality of e-learning platforms; and
  2. to perform a rating assessment of the functionality of Ukrainian developers’ e-learning platforms and determine the degree of Ukrainian platforms’ support (in whole or in part) of e-learning components categorized by the CT, SCT, MT, and E-LT learning theories.

Theoretical Framework for Evaluating E-Learning Platforms

Ouadoud et al. (2016a) developed the approach for the quality evaluation of e-learning platforms, which is based on “the quality model interactive systems” (Ouadoud et al., 2016a, p. 13) of International Organization for Standardization (ISO) standard number 25010: “The product quality model categorizes product quality properties into eight characteristics (functional suitability, reliability, performance efficiency, usability, security, compatibility, maintainability and portability). Each characteristic is composed of a set of related subcharacteristics” (ISO, 2011, s. 4.2). The researchers combined the characteristics presented in ISO standard 25010 into two categories—utility and usability—each of which was divided into subcategories (Ouadoud et al., 2016a, pp. 16-17, 19), which are presented in Tables 1 and 2.

Characteristics selected for evaluating an e-learning platform are developed via a software engineering approach with an emphasis on the technical aspects of the e-learning platform. In this study, we analyzed the quality of the e-learning platforms by one characteristic only: functional suitability. This helped us to determine how certain functionalities of a platform help with implementing e-learning components, defined according to different learning theories.

Table 1 summarizes the sub-characteristics of the functional suitability of e-learning platforms proposed by Ouadoud et al (2016a).

Table 1

Characteristics Selected for Evaluating the Functional Suitability of an E-Learning Platform

Functional completeness Functional correctness Functional appropriateness
  • Forum
  • Synchronous causerie (cat/chat)
  • Virtual classroom (videoconferencing/webinar)
  • Sharing documents
  • Calendar
  • Awareness (list of connected people)
  • Tests management
  • Collaboration (Wikis)
  • Learners’ management (registration, schedule, etc.)
  • Learners’ management in working groups
  • Users’ roles management
  • Customizable platform
  • Advancement scale or progression percentage in the course resources
  • Management (course)
  • Support of multiple authors
  • Learners’ and teachers’ management of working time
  • Results and notes
  • Notes display
  • Course tracking statistics
  • Control connections (tracking of learners)
  • Reports on test results
  • Glossary
  • Reports on the frequency or use of a course
  • Certification (certificate of training follow-up)
  • Foyer (family group)
  • Registration chat
  • Messaging
  • Plagiarism detection tools
  • RSS feed/podcast: means of distributing files (audio, video, other)

Note. Adapted from “Studying and Analyzing the Evaluation Dimensions of E-Learning Platforms Relying on a Software Engineering Approach,” by M. Ouadoud, M. Y. Chkouri, A. Nejjari, and K. E. El Kadiri, 2016, International Journal of Emerging Technologies in Learning, 11(1), pp. 16-17 (https://doi.org/10.3991/ijet.v11i01.4924). CC-BY.

The list of functional suitability sub-characteristics were modified and supplemented by functional characteristics, which, according to Colace et al. (2002), “must be absolutely present in an on-line learning platform.” (Colace et al., 2002, p. 7) The following are the particular functional characteristics (Colace et al., 2002, pp. 6-7):

Important services that are necessary for efficiently training the authors of the mentioned research online include “textual or vocal chat, whiteboard, live video stream, virtual classroom, application and file sharing” (Colace et al., 2002, p. 5).

Baggia et al. (2019, p. 53) combined various characteristics that “have to be considered when selecting the appropriate system for an individual case” into three main groups:

  1. Learning content management: This includes content authoring, content storage and management, course libraries, compliance with standards for e-learning software Sharable Content Object Reference Model (SCORM) and Aviation Industry Computer-Based Training Committee (AICC) or Tin Can Application Programming Interface (API), and multimedia support.
  2. Course management: This includes registration management, course catalogue management, course calendars, gradebooks, student and instructor portals, attendance tracking, proficiency testing, e-commerce capabilities (the ability to sell online courses), and virtual classrooms.
  3. Social learning and collaboration: This includes support social learning with collaboration features (live chat, blog modules, Web conference integration, following concept, content sharing and rating, discussion boards, file sharing, integration with social media networks, profiling and expertise capabilities, and gamification tools).

The works of Baggia et al. (2019), Colace et al. (2002), and Ouadoud et al. (2016a) became the basis for developing criteria for assessing the functionality of e-learning platforms, presented in the results this study.

Kumar and Sharma (2021, p. 11) emphasize that “e-learning components, identified from the learning theories are very much important for any platform. If these components are not integrated in the platforms, the success of learning cannot be guaranteed.” In analyzing the theoretical perspective of e-learning pedagogy, Kumar and Sharma (2021) derived the following characteristics for a successful e-learning framework: learner-centered, eco-sustainability, socioeconomic/cost-effectiveness, connectivity/networking, increased accessibility, on-demand availability, interaction, participation, cooperation, collaboration, motivation, engaging, communication, intrinsic motivation, extrinsic motivation, intriguing ideas, self-determination, competence, autonomy, relatedness, cognitive effectiveness, convenient, reliability, efficiency, achievement, personalization, self-pacing, constructive alignment, higher learning outcomes, learner satisfaction, confidence, peer review, evaluation/assessment/feedback from instructors, improved tracking, flexibility, skills and knowledge improvement, and learner satisfaction. These characteristics can be further divided according to the four major learning theories (CT, SCT, MT, and E-LT) (Kumar & Sharma, 2021, p. 4), shown in Table 2.

Table 2

E-Learning Components Categorized by Learning Theory

Cognitive theory Social constructivist theory Motivation theory E-learning theory
  • Learner satisfaction
  • Higher learning outcome
  • Cognitive effectiveness
  • Individual learning
  • Personalization
  • Achievement
  • Self-efficacy
  • Efficiency improvement
  • Skills and knowledge Improvement
  • Collaboration
  • Interaction
  • Participation
  • Cooperation
  • Engaging
  • Communication
  • Constructive alignment
  • Peer review
  • Evaluation /assessment/feedback
  • Motivation
  • Intrinsic motivation
  • Extrinsic motivation
  • Intriguing ideas
  • Self-determination
  • Competence
  • Autonomy
  • Relatedness
  • Confidence
  • Learner-centered
  • Eco-sustainability
  • Socioeconomic/cost-effectiveness
  • Connectivity/ networking
  • Increased accessibility
  • On-demand availability
  • Convenience
  • Flexibility
  • Self-pacing
  • Improved tracking

Note. Components of e-learning are from “E-Learning Theories, Components, and Cloud Computing-Based Learning Platforms,” by V. Kumar and D. Sharma, 2021, International Journal of Web-Based Learning and Teaching Technologies, 16(3) p. 5 (https://doi.org/10.4018/IJWLTT.20210501.oa1). Copyright 2021 by IGI Global.

Our study of functionality of an e-learning platform in the context of their compliance of e-learning components, identified from the learning theories, will answer our main question: How well does an e-learning platform help to achieve the goals of the learning process?

Methods

This study was conducted in four stages: (a) searching scientific sources devoted to the problem of evaluating e-learning platforms, a literature analysis, and determining the criteria for evaluation of the functionality of e-learning platforms; (b) selecting e-learning platforms of Ukrainian developers for assessment; (c) rating assessment of the functionality of e-learning platforms of Ukrainian developers; and (d) evaluating Ukrainian e-learning platforms on a pedagogical approach and determining the degree of support (in whole or in part) of e-learning components, categorized by learning theories: CT, SCT, MT, and E-LT. At each stage, the research methods described below were used.

Stage 1

At the first stage of the research, we searched the Scopus database for e-learning platforms’ problems of quality assessment and their compliance with e-learning theories with the following queries: e-learning platforms, evaluation e-learning platforms, and e-learning theories (only open-access journals were searched). The range of selected articles was expanded by analyzing references in the articles found with the specified search queries.

Further study of scientific articles allowed us to identify several studies whose results became the basis for the development of criteria for assessing e-learning platforms’ functionality—in particular, Baggia et al. (2019), Colace et al. (2002), and Ouadoud et al. (2016a, 2016b).

Stage 2

Computerization and informatization of the Ukrainian education system are accompanied by the development of electronic educational resources (EERs) and e-learning platforms. The commission on informatization of educational institutions was established by order of Ukraine’s Ministry of Education and Science, Youth and Sports, dated November 25, 2011, No. 1364 (as amended by the order of the Ministry of Education and Science, Youth and Sports of Ukraine, dated November 29, 2012, No. 1341) for state examination, granting permission for the use of EERs and e-learning platforms in the educational process in all secondary schools of Ukraine.

For the selection of e-learning platforms for evaluation, the protocols of the commission for 2016-2019 were analyzed, as the permission to use the platforms is granted for five years. Qualitative analysis of the protocols was based on the search phrases educational platform, educational system, and online platform, which allowed us to single out e-learning platforms among EERs of different types. Using an online information retrieval method, using the search query distance learning platforms and services, the All-Ukrainian School Online platform—developed in late 2020 with support from the Ukraine Ministry of Education and Science in response to distance learning challenges due to the COVID-19 pandemic—was added to our list of e-learning platforms.

Note that highly specialized platforms that are focused on in-depth study of a particular discipline—such as Lingva.Skills for the social project for learning foreign languages, Indigo Mental Training Club, and GIOS for learning mathematics—remained outside the scope of this study.

Stage 3

Developing the criteria for assessing e-learning platforms’ functionality became the basis for qualitative analysis of e-learning platforms that were included in the list identified in the second stage. Each function was coded with one tag (+ or -) to remark on the presence or absence of a particular feature (i.e., the tag learners’ management + is used to indicate the presence of the learners’ management function).

The presence or absence of certain functionality of e-learning platforms was studied by qualitative analysis of information provided by developers on the sites of e-learning platforms (description of functionality, video presentation, etc.).

The final results consist of a set of evaluations composed of numerical ratings expressed in a range from 1 to 5, depending on the number of available functionalities in each of the three units. The maximum score a platform can receive is 15 points.

Stage 4

Comparative analysis of the functionality of e-learning platforms and e-learning components categorized on the learning allowed us to determine the degree of support (fully or partially) Ukrainian e-learning platforms of different e-learning components categorized on the CT, SCT, MT and E-LT. Mathematical methods were used for processing the survey results, and graphical methods were used to construct diagrams and tables.

Results

Criteria for Evaluating E-Learning Platforms’ Functionality

The criteria proposed by Colace et al. (2002), Ouadoud et al. (2016a), and Baggia et al. (2019) were summarized, clarified, and grouped into three categories: (a) learning management, (b) learning content management, and (c) communications and collaboration tools (Table 3).

A learning content management system includes “all the functions enabling creation, description, importation or exportation of contents as well as their reuse and sharing” (Colace et al., 2002, p. 2). “Set of Tools represents all the services that manage teaching processes and interactions among users” (Colace et al., 2002, p. 9). Whereas distance education technologies are divided into two modes of delivery, namely, synchronous learning (all participants are present at the same time) and asynchronous learning (participants access course materials flexibly on their own schedule) (Parchure, 2016), communication tools between teachers and students are divided into “two fundamental categories: asynchronous communication tools and synchronous communication tools” (Colace et al., 2002, p. 5). Therefore, the described approach made it possible to propose 27 criteria for evaluating the functionality of e-learning platforms, presented in Table 3.

Table 3

Criteria of Evaluating E-Learning Platforms’ Functionality

Learning management Learning content management Communication and collaboration tools
  • Awareness (list of connected people)
  • Learners’ management (registration, schedule, etc.)
  • Learners’ management in working groups (student groups’ creation and management)
  • Users’ roles management
  • Advancement scale or progression percentage in the course resource
  • Management course (course catalogue, multiple course management)
  • Tracking of learners (progress tracking, reports on course frequency or use)
  • Management of tests (auto-evaluation tests, reports on test results)
  • Learning outcomes management (electronic class register, electronic diary)
  • Certification (certificate of follow-up training)
  • Multimedia content (audio, video, flash, etc.)
  • Ready content from a developer
  • Content inclusion in accordance with standards
  • Constructor for creating teachers’ content
  • Test constructor
  • Course importation from other producers
  • Content importation
  • Plagiarism detection
  • Sharing documents
Asynchronous communication tools
  • Forum
  • E-mail
Synchronous communication tools
  • Textual or voice chat
  • Live video stream
  • Virtual classroom (videoconference/ webinar)
  • Application sharing
  • Whiteboard
  • Gamification tools

Rating Assessment of Ukrainian E-Learning Platforms’ Functionality and Determination of the Degree of Their Support of Different Learning Theories

Table 4 presents the e-learning platforms selected for assessment and created by Ukrainian developers over the last five years. The platforms are arranged chronologically depending on the year of development. Each platform is assigned a code number (Table 4), which presents the results of a qualitative analysis of the functionality of the selected e-learning platforms in accordance with the evaluation criteria proposed in Table 3.

Table 4

E-learning Platforms of Ukrainian Developers

Platform code Platform name URL
1 Accent (Mobischool) http://mobischool.ac-cent.com/
2 Class Assessment https://klasnaocinka.com.ua/
3 My Class https://miyklas.com.ua/
4 Pidruchnyk.ua http://www.gutenbergz.com/ua/pidruchnyk.html
5 Euclid https://www.euclidlms.com/
6 Classtime https://www.classtime.com/uk/
7 The Only School https://eschool-ua.com/
8 All-Ukrainian School Online https://lms.e-school.net.ua/

Analysis results (Table 5) show that most of the considered e-platforms have similar functionality for learning management and learning content management. There is a lack of course importation from other producers and plagiarism detection functions across almost all platforms. The latter function, plagiarism detection, is especially important given the problem of academic integrity in the educational environment. Only the Classtime platform has the anti-cheating function. All commercial platforms are recommended for use in the educational process marked without content. The developers of the platforms offer teachers and students their own content (a set of test tasks, interactive exercises, theoretical materials on individual topics, etc.), but this content has not passed state examination. Only electronic versions of textbooks are recommended by the Ukraine Ministry of Education and Science on the Pidruchnyk.ua platform, and the All-Ukrainian School Online platform hosts electronic courses certified by experts from the Ministry of Education and Science of Ukraine.

Table 5

Analysis of the Functionality of E-Learning Platforms

Functionality criteria E-learning platform
1 2 3 4 5 6 7 8
Learning management
Management course (course catalogue, multiple course management) + + + + + + + +
Awareness (list of connected people) + + + + + + + +
Learners’ management (registration, schedule, etc.) + + + + + + + +
Learners’ management in working groups (student groups’ creation and management) + + + - + + + -
Advancement scale or progression percentage in the course resource + + + - + - + -
Management of user roles + + + + + + + +
Management of tests (auto-evaluation of tests, reports on test results) + + + - + + + -
Learning outcomes management (electronic class register, electronic diary) + + + + - - + -
Tracking of learners (progress tracking, reports on course frequency or use) + + + - + + + +
Certification (certificate of follow-up training) - - - - - + + -
Learning content management
Multimedia content + + - + + + + +
Ready content from a developer + + + + - + - +
Content inclusion in accordance with standards - - - + - - - +
Constructor for creating teachers’ content + + + - + + + -
Tests constructor + + + - + + + -
Course importation from other producers - - - - - + - -
Content importation + + + - + + + -
Plagiarism detection - - - - - + - -
Sharing documents + + - - + + - -
Communication and collaboration tools
Asynchronous communication tools
E-mail + - + - + - + -
Forum - + - - - - - -
Synchronous communication tools
Textual or voice chat + + + - + + + -
Whiteboard + + - - - - - -
Live video stream - - - - - - - -
Virtual classroom + + + - - - - -
Application sharing - - - - - - - -
Gamification tools - + - - - + - -

Note. 1 = Accent (Mobischool); 2 = Class Assessment; 3 = My Class; 4 = Pidruchnyk.ua; 5 = Euclid; 6 = Classtime; 7 = The Only School; 8 = All-Ukrainian School Online.

The top five e-learning platforms in terms of functionality are Class Assessment, Accent (Mobischool), My Class, Classtime, and The Only School (Figure 1).

Figure 1

Ratings of Analyzed Platforms

The availability of communication and collaboration tools—such as whiteboards and virtual classrooms, which are necessary to ensure quality distance learning—is most problematic in these e-learning platforms. The application sharing function, which is important during studying such subjects as computer science and technology, is not supported by any of the analyzed platforms. Only two analyzed platforms, Class Assessment and Classtime, support gamification tools. The first platform allows a creation of quizzes for students; the second allows a creation of team games and puzzles. Insufficient attention from developers of Ukrainian e-learning platforms to communication and collaboration tools negatively affects the quality of distance learning with these platforms: “Collaboration during problem-solving is one of the skills best promoted by modern e-learning” (Abubakari et al., 2021, p. 3).

An evaluation of the functionality of the e-learning platforms according to the criteria (Table 3) and the e-learning components categorized on the learning theories (Table 2) helped us determine how the analyzed platforms support the four learning theories (completely or partially). Only three of the analyzed commercial e-learning platforms’ (Accent [Mobischool], Class Assessment, and My Class) support functions aimed at ensuring collaboration, interaction, extrinsic participation, cooperation, engagement, communication, constructive alignment, peer review, and evaluation/assessment/feedback—that is, they support all the components of SC theory: “The platforms that follow the Social Constructivist theory pedagogy will in turn deliver motivational and cognitive components” (Kumar & Sharma, 2021, p. 6).

The Accent (Mobischool), Class Assessment, and My Class e-learning platforms follow all three learning theory pedagogies completely. However, since these are commercial products, they only partially support the E-LT, which assumes increased accessibility and on-demand availability.

The Pidruchnyk.ua platform supports all learning theories only partially, as it provides access to electronic textbooks only and supports the functions of managing learning outcomes (electronic class register, electronic diary). The platform does not have tools for collaboration and group communication, for example.

The Euclid, Classtime, and The Only School platforms support all learning theories only partially as well, as they do not have sufficient collaboration, participation, and cooperation tools, and access requires payment.

The All-Ukrainian Online School platform, developed by order of the state, corresponds to E-LT, as it is free. However, it is an example of a mass open online course for middle and high school students, not a full-fledged e-learning platform, because it does not have many functionalities for learning management and content management, tools for communication between students and teachers, and teamwork organization. This platform therefore does not adhere the CT, SCT and MT:

The educational content of the platform contains lessons in 18 main subjects: Ukrainian literature, Ukrainian language, Biology, Biology and Ecology, Geography, World History, History of Ukraine, Mathematics, Algebra, Geometry, Art, Basics of Law, Science, Physics, Chemistry, English and Foreign literature. Once launched, the content of the platform will be gradually supplemented according to the calendar plan. With the assistance of the International Renaissance Foundation, a mobile application of the All-Ukrainian School Online will be created soon and the functionality of the platform will be expanded, which will allow teachers to adapt teaching materials to the students’ individual needs. (Ministry of Education and Science of Ukraine, 2020)

A significant disadvantage of the All-Ukrainian Online School platform is not only limited functionality, in particular, the lack of communication and collaboration tools, but also the focus on middle and high school students only. To develop effective distance education in school, it is necessary to place on this platform all 23 electronic textbooks for students of the first, second, fifth, and sixth grades, developed by Ukrainian publishers in 2018-2019 and recommended by the Ministry of Education and Science of Ukraine for use in the educational process (Zhenchenko et al., 2020, p. 732).

Discussion

Ouadoud et al. (2016a, 2016b) studied and analyzed the evaluation dimensions of e-learning platforms relying on a software engineering approach based on the quality model interactive systems of ISO standard no. 25010, which takes into account all technical aspects of interactive systems of e-learning platforms. In the context of our study, this model was used partly (functional suitability category). To evaluate e-learning platforms by criteria combined into the categories of performance efficiency, compatibility, security, maintainability, portability, and usability, more detailed technical information is needed. Colace et al. (2002, p. 7) distinguished, among the various functionalities of e-learning platforms, a representative number of the functionalities that must be absolutely present in any online e-learning platform. We accounted for the functionalities of e-learning platforms described by Colace et al. (2002) during the development of the e-learning platforms evaluation criteria.

Colace et al. (2002, p. 8) consider that “in order to accurately evaluate the potentials of an online learning platform, it is important to pay attention to its three main components: Learning Management System; Learning Content Management System; Virtual environment for teaching and services associated with it.” Baggia et al. (2019) divide the functional characteristics of e-learning platforms into three major groups: (a) learning content management, (b) course management, and (c) social learning and collaboration. With this in mind, we have grouped the evaluation criteria of e-learning platforms into three macro groups: (a) learning management, (b) learning content management, and (c) communications and collaboration tools.

Assessing the functionality of e-learning platforms in the context of compliance e-learning components categorized on the learning theories (Kumar & Sharma, 2021) will allow developers to develop e-learning platforms that follow all four learning theories (CT, SCT, MT, E-LT) completely.

Various aspects of e-learning platforms’ usability need further research via the UEQ (Pandu & Fajar, 2019, Abubakari et al., 2021) to improve teachers’ and students’ ability to use them. An in-depth assessment of student-teacher interaction through e-learning platforms can be based on Responsive Interactions for Learning (RIFL) measures—educator (RIFL-Ed) version (Rodrigues et al., 2021).

Conclusion and Implications

To assess the functionality of an e-learning platform, 27 criteria have been defined. They were grouped into three macro groups: (a) learning management, (b) learning content management, and (c) communications and collaboration tools. These criteria became the basis for rating assessment and determining the degree of support for various learning theories of the seven Ukrainian commercial platforms (Accent [Mobischool], Class Assessment, My Class, Pidruchnyk.ua, Euclid, Classtime, and The Only School) and the free platform All-Ukrainian School Online, developed in December 2021 by the Ministry of Education and Science of Ukraine to solve the problem of accessibility within quality distance education in Ukraine.

The main problem with Ukrainian e-leaning platforms is the lack of communication and collaboration tools necessary to ensure quality distance learning. The most common means of communication that support an e-learning platform are e-mails and chats. Only two platforms (Accent [Mobischool] and Class Assessment) provide whiteboard and virtual classroom functions, and two platforms (Class Assessment and Classtime) have gamification tools. Therefore, only three of the eight e-learning platforms follow the CT, SCT, and MT theories completely, but these are commercial products; hence, they support E-LT only partially.

The proposed criteria for assessing the functionality of e-learning platforms in the pedagogical aspect, taking into account the support of e-learning components according to the e-learning theories, can be used to assess and test functionality in developing new e-learning platforms and improving functionality in already-existing ones.

References

Abubakari, M. S., Nurkhamid, & Hungilo, G. (2021). Evaluating an e-learning platform at graduate school based on user experience evaluation technique. c, 1737, Article 012019. https://doi.org/10.1088/1742-6596/1737/1/012019

Baggia, А., Leskovar, R., Rajkovič, U., Šmitek, B., Pesjak, K., Saša, M., Ravnik, S., Valjavec, M., Kingston, L., Murphy, F., Coffey, A., Narduzzi, B., Lillo-Crespo, M., & Riquelme, J. (2019, March 20-22). Selecting the e-learning platform for nursing education. In P. Šprajc, I. Podbregar, D. Maletič, & M Radovanović (Eds.), 38th International Conference on Organizational Science Development: Ecosystem of organizations in the digital age: Conference proceedings (pp. 49-63). University of Maribor, University Press. https://doi.org/10.18690/978-961-286-250-3

Colace, F., De Santo, M., & Vento, M. (2002). Evaluating on-line learning platforms: A case study. In Proceedings of the 36th Hawaii International Conference on System Sciences (HICSS’03) (pp. 1-9). IEEE Computer Society. https://www.computer.org/csdl/pds/api/csdl/proceedings/download-article/12OmNASILFE/pdf

Ecoutin, E. (2000). Étude comparative technique et pédagogique des plates-formes pour la formation ouverte et à distance. Fonds Social Européen. https://edutice.archives-ouvertes.fr/file/index/docid/ 1712/filename/synt08.pdf

International Organization for Standardization (ISO). (2011). Systems and software engineering—Systems and software quality requirements and evaluation (SQuaRE)—System and software quality models (ISO standard no. 25010:2011). ISO/International Electrotechnical Commission. https://www.iso.org/obp/ui/#iso:std:iso-iec:25010:ed-1:v1:en

Kumar, V., & Sharma, D. (2021). E-learning theories, components, and cloud computing-based learning platforms. International Journal of Web-Based Learning and Teaching Technologies, 16(3), Article 1. https://doi.org/10.4018/IJWLTT.20210501.oa1

Ministry of Education and Science of Ukraine. (2020). All-Ukrainian Online School. https://mon.gov.ua/ua/tag/vseukrayinska-shkola-onlajn

Ouadoud, M., Chkouri, M. Y., Nejjari, A., & El Kadiri, K. E. (2016a). Studying and analyzing the evaluation dimensions of e-learning platforms relying on a software engineering approach. International Journal of Emerging Technologies in Learning, 11(1), 11-20. https://doi.org/10.3991/ijet.v11i01.4924

Ouadoud, M., Chkouri, M. Y., Nejjari A., & El Kadiri, K. E. (2016b). Studying and comparing the free e-learning platforms. In 4th IEEE International Colloquium on Information Science and Technology (CiSt) (pp. 581-586). Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/CIST.2016.7804953

Pandu, F., & Fajar, A. N. (2019). E-learning implementation using user experience questionnaire. Journal of Physics: Conference Series, 1367, Article 012015. https://doi.org/10.1088/1742-6596/1367/1/012015

Parchure, N. P. (2016). “E-learning”—A boon for distance education. International Journal of Management and Applied Science, 2(10), 63-66. http://www.iraj.in/journal/journal_file/journal_pdf/14-308-148007275163-66.pdf

Piotrowski, M. (2010). What is an e-learning platform? In Y. Kats (Ed.), Learning management system technologies and software solutions for online teaching: Tools and applications (pp. 20-36). IGI Global. https://doi.org/10.4018/978-1-61520-853-1.ch002

Rodrigues, M., Schneider, A., Sokolovic, N., Brunsek, A., Oré, B., Perlman, M., & Jenkins, J. (2021). Development and evaluation of an open-source, online training for the measurement of adult-child responsivity at home and in early childhood education and care settings. The International Review of Research in Open and Distributed Learning, 22(3), 1-18. https://doi.org/10.19173/irrodl.v22i3.5472

Schrepp, M. (2015). User experience questionnaire handbook. https://doi.org/10.13140/RG.2.1.2815.0245

Schunk, D. H. (2020). Learning theories. An educational perspective. Pearson. https://www.pearson.com/us/higher-education/program/Schunk-Learning-Theories-An-Educational-Perspective-8th-Edition/PGM1996609.html

Tomczyk, Ł., Włoch, A., Potyrała, K., Wnęk-Gozdek, J. & Demeshkant, N. (2020). Evaluation of the functionality of a new e-learning platform vs. previous experiences in e-learning and the self-assessment of own digital literacy. Sustainability, 12(23), Article 10219. https://doi.org/10.3390/su122310219

UNESCO. (2020). Education: From disruption to recovery. https://en.unesco.org/covid19/educationresponse

Zhenchenko, M., Melnyk, O., Miroshnychenko, V., and Zhenchenko, V. (2020). Electronic textbooks for Ukrainian education: Statistics, models of development, quality problems. CEUR Workshop Proceedings (pp. 721-733). http://ceur-ws.org/Vol-2732/20200721.pdf

 

Athabasca University

Creative Commons License

Ukrainian E-Learning Platforms for Schools: Evaluation of Their Functionality by Maryna Zhenchenko, Oksana Melnyk, Yaroslava Prykhoda, and Igor Zhenchenko is licensed under a Creative Commons Attribution 4.0 International License.