Implementation of Tel Aviv University Moocs in Academic Curriculum: a Pilot Study

The study presented in this paper examines the feasibility of using MOOCs as a learning environment in academic courses. This paper focuses on the students who participated in two MOOCs offered by Tel Aviv University (TAU) during the year 2013. The preliminary findings of this pilot study illustrate the scope of student activity, the learning intensity, and learner path. In addition, attitudes of TAU students who participated in these courses as part of their curriculum are presented. From TAU's perspective, the presented MOOCs are considered to be a successful experience for all those involved: the students, who were very satisfied with their learning and high achievements; the lecturer team, who were very enthusiastic and satisfied with the learning process as well as the new experience; and the University policy makers, who took the challenge and integrated this new model of learning into the academic environment.


Article abstract
The study presented in this paper examines the feasibility of using MOOCs as a learning environment in academic courses. This paper focuses on the students who participated in two MOOCs offered by Tel Aviv University (TAU) during the year 2013. The preliminary findings of this pilot study illustrate the scope of student activity, the learning intensity, and learner path. In addition, attitudes of TAU students who participated in these courses as part of their curriculum are presented. From TAU's perspective, the presented MOOCs are considered to be a successful experience for all those involved: the students, who were very satisfied with their learning and high achievements; the lecturer team, who were very enthusiastic and satisfied with the learning process as well as the new experience; and the University policy makers, who took the challenge and integrated this new model of learning into the academic environment.

Introduction
Massive open online courses (MOOCs) are the latest revolution in online teaching and learning . These academic courses are available to the general public, worldwide; do not have any preconditions; and are usually free of charge (Johnson, Adams Becker, Cummins, Estrada, Freeman, & Ludgate, 2013;Allen & Seaman, 2014;Fini, 2009;Stewart, 2013). MOOCs are offered by a variety of initiatives, such as Coursera, Udemy, MITx, edX, Udacity, which include the world's leading universities: Stanford, Harvard, and MIT. The courses are taught by some of the most leadingedge professors around the world, in various fields. They allow for flexible learning at any time and any place, integrating a variety of tasks into the course structure. The structure and scope of each course varies, depending on the characteristics and needs of the course curriculum, and the instructor's decision. A major emphasis is put on selecting suitable course subjects, instructors, the appropriate structure for high quality video production, and a friendly interface. Such courses developed with these guidelines have altered the conception of education and created a different culture of learning, one which involves collaborative social learning combined with various social tools (such as discussion groups and assessment process management tools). This type of course development enables the teaching of mass online courses.
In the year 2013, Tel Aviv University (TAU) joined the community of leading universities that provide MOOCs, after developing high-quality academic courses that are accessible to the public.
TAU offers three academic MOOCs, taught in English, in the fields of archeology, history and science. The courses are available through Coursera (see https://www.coursera.org), an international education company that offers over 620 academic courses taught by the best lecturers from 108 academic institutions worldwide, including a number of leading universities, such as Princeton and Stanford. These courses are offered as a public service and as future training for the information society. In addition, as a pioneer step, TAU policy makers have allowed TAU undergraduate students to take these MOOCs as part of their current curriculum and receive academic credit for them upon completion.
Although there is a debate about the advantages of MOOCs and their potential negative consequences (Borden, 2014;Decker, 2014;Samuels, 2014;Shirky, 2012;Carey, 2013), universities cannot ignore the impact MOOCs have on higher education institutions. Therefore, it is important to explore the feasibility and advantages of MOOCs as part of the academic curriculum. And hence, the main goal of this research is to examine the feasibility of using MOOCs as a learning environment in academic courses. This paper will focus on the students who participated in the first two TAU MOOCs during the year 2013 -archeology and life sciences (the third is still ongoing). It will present the scope of student activity, the learning intensity, and learner path, in addition to attitudes of TAU students who participated in these courses as part of their curriculum for their degree.
On the other hand, criticism and objections are increasing along with evaluation studies and position papers whose attitudes towards MOOCs are suspicious or resistant (Samuels, 2014). To some extent, this situation balances the enthusiasm that has gripped the public.  Stewart, Siemens, & Cormier, 2010) Some of the MOOCs provide a statement of accomplishment for students who meet the passing criteria of the course. In addition, some of the institutions offer the option to earn an official verified certificate, which costs money and securely links the student's coursework to the student's identity (e.g., Coursera's "Signature Track"). These certificates, however, do not include course credit towards an academic degree. Although all MOOCs have their large scale of registered students and free access in common, they have bifurcated in two very distinct and separate pedagogical types of courses, known as xMOOCs and cMOOCs (Siemens, 2013;Rodriguez, 2013). xMOOCs represent online learning environments which focus on scalability and address very large classes, while cMOOCs represent online learning environments which focus on community and connections, and are designed based on connectivism and connective knowledge (Ravenscroft, 2011). These MOOCs continue to use the acronym MOOCs, which was first coined by Siemens and Downes . There are researchers who argue that the xMOOCs might be better suited for studying a wide range of knowledge that can be learned through repetitive practice, while the cMOOCs enable learners to obtain "higher order creative skills" (Grünewald, Meinel, Totschnig, & Willems, 2013). Thus, these two pedagogical types shouldn't be treated or evaluated in the same way (Daniel, 2012). Both types of MOOCs emphasize dialogue as an important element in the learning process. Almost every MOOC actively encourages dialogue and discussion among course participants. Furthermore, dialogue is actually perceived to be the primary mechanism for maintaining connections between different ideas, which are the base upon which knowledge is developed (Ravenscroft, 2011).

83
The MOOCs phenomenon is controversial, both for its effectiveness and in terms of its potential implications on higher education. Some researchers argue that MOOCs are still not effective in regards to student needs (Adamopoulos, 2013). One piece of evidence is the low retention rate of students in these courses (Clow, 2013;Lewin, 2013). Furthermore, they claim that MOOCs have negative potential consequences on higher education (Decker, 2014;Samuels, 2014), mostly on research and development. MOOCs initiatives may disrupt the structure of higher education because of their business model, which dismantles the relationship between the three components that university activities are built on: teaching, research, and granting credit approval for courses. These researchers are concerned that the traditional business model of the university will eventually need to shift to accommodate the existence of credit-earning MOOCs (Decker, 2014). Other researchers (Shirky, 2012;Carey, 2013) believe in the tremendous potential contribution of MOOCs. They argue that MOOCs offer flexibility, affordable access, and fast-track completion at a low cost for whoever is interested in learning (Yuan, Powell, 2013). They claim that higher education institutions will have to be flexible and aware of the changes, even in light of the criticism raised by recent studies. Regarding students, several factors can be found for their motivation in using MOOCs (Belanger & Thornton, 2013;Zutshi, O'Hare, & Rodafinos, 2013): to support lifelong learning or to gain an understanding of the subject matter, with no particular expectations for completion or achievement; for fun, entertainment, the social experience, and the intellectual stimulation; for the convenience, often in conjunction with barriers to traditional education options; and to experience or to explore online education.
Academic accreditation is one of the key issues that arises in public debate regarding MOOCs' effect on the higher education system (Dolan, 2014). Changes in academic recognition are usually based on localized initiatives of various academic institutions (Eaton, 2012;ACE, 2012;Masterson, 2013), such as Antioch University, which became the first US institution to offer credit for MOOC learning through Coursera. At this stage, the changes are bottom-up, not top-down, as a result of planed policy and official regulation of governmental institutions or other central organizations in the USA higher education system. It is important to note that, in general, the higher education system in the USA is characterized by decentralization and high variability between institutions and between states; therefore, this phenomenon is not unusual. However, some of the most important USA central organizations in higher education have published statements recently in which they acknowledge their growing awareness of the importance of the debate in this field as well as their attempts to match system practices to the developing reality. In addition, academic recognition issues related to MOOCs were published recently in the UK as well. According to the "Universities UK", the representative organization for UK universities (2013), currently there are still no statements of systematic recognition of MOOC studies at higher education institutions in the UK; however, there are specific instances where UK higher education institutions have decided to accredit MOOCs.
The MOOCs presence is hard to ignore and the process of its adoption and expansion must be accompanied by exploring difficult questions such as: What are the problems that MOOCs could solve (Laurillard, 2014)? Do MOOCs constitute a method which aims to reduce costs, to give mass access to academic information, to improve the learning process or make it more efficient? Are MOOCs designed to close gaps, or are they designed to encourage learning and excellence? There is often tension between these two important objectives -closing gaps and learning excellence, and it is very difficult to achieve both of these goals simultaneously.
At the pinnacle of the debate on MOOCs it seems that even if they could have a negative impact on higher education, there is a responsibility to examine their advantages and obstacles, and to make some decisions. TAU joined the Coursera initiative in order to appraise the benefits of MOOCs to the university and academic instruction. These benefits include the promotion of the institution's status on a global scale, attraction of worldwide students, and the promotion of the university's domestic objectives, which are related to online learning and web supported academic instruction at TAU. This paper presents TAU's experience in implementing MOOCs as part of the academic curriculum and tries to offer insights for further integration of MOOCs in higher education.

Method
Three courses were developed in Coursera and were offered to TAU students, as well as to the general public, worldwide. The main research goal was to examine the feasibility of using MOOCs as a learning environment in academic courses for undergraduate students. This was examined through the following aspects: a) the scope of student activity, b) the student learning intensity, c) the learner path during the online course, and d) the attitudes of TAU students who participated in these courses as part of their curriculum for their degree.

Participants and Data Collection
This study focuses on the first two courses, since the third is still ongoing. 47,691 students registered in the first two MOOCs courses during the year 2013. 121 of the students were TAU students, and were registered for accreditation. Data regarding the students' range of activities, their intensity of involvement in the course, and their attitudes were derived from two main sources: • Coursera log files -the first source was Coursera's database, which provides data from the learning system web logs regarding all participating students. During the courses, student activity data was automatically accumulated, documenting student participation in each activity of the course.
• University teaching survey -the second data source was TAU instructional surveys, which were conducted electronically at the end of each course and provide data on the attitudes of TAU's students. The survey included 16 questions and consisted of three sections: the first section included demographics questions (e.g., gender, education); the 85 second section asked students to rate each of nine specific pedagogical aspects (e.g., the lessons were clear, interesting, well organized, overall satisfaction from the course and instructor) on a 7-point Likert-type scale ranging from 1 (very low) to 7 (very high); and the third section included two open questions dealing with satisfaction from the instruction and suggestions for improvement.

Course Description and Delivery
The first two courses that were chosen for this study were: "What a plant knows (and other things you didn't know about plants)"; and "The fall and rise of Jerusalem -Judah under Babylonian rule". The development process and production of these MOOCs required tremendous attention and commitment from the instructional teams. The professors needed to acquire new teaching skills, such as how to lecture in front of a camera without students, which is very different from what they usually do. In addition, they had to familiarize themselves with the Coursera learning management system (LMS) and infrastructure, in order to adjust their pedagogy and course material. Each professor, along with their assistant, developed the course content in accordance to the pedagogical model, which was built around video lectures, quizzes, and forums. As the prerecorded lessons were put into use, content and assignments were adjusted and/or added gradually.
The duration of each course was six to eight lessons, based on the professor's preference, with course materials and insights taken from previous MOOCs (Andres, 2013). Students, who completed the courses with a grade of at least 78, comprised of 50% quizzes and 50% final exam, received a Statement of Accomplishment. It should be noted that these courses do not earn the student academic credit, unless they are TAU undergraduate students. TAU students are allowed to take these courses as part of their academic curriculum; however, they are required to take the final exam on campus, in addition to completing the assignments and the official online course exam.
"What a plant knows" was a course that intended to present an intriguing and scientifically valid look at how plants themselves experience the world-from the colors they see to the sensations they feel, highlighting the latest research in genetics and other relevant fields. The main goals were to introduce basic plant biology by exploring plant senses (sight, smell, hearing, touch, taste, balance), to introduce biological research and scientific methods, and to get the student to to the course forums and other sources. In addition, instructor messages were sent to students prior to each class along with reading recommendations. A final exam was conducted at the end of the course, using the peer review method for evaluation.

Findings
The scope of student activity -Data regarding the scope and intensity of activity was taken from Coursera's log files at the end of each course. Students from 126 different countries signed up for these courses; the highest rates of participation were from the United States and Canada (41%) and various European countries (28%). Table 1 presents the total number of students who registered for the courses, the number of active students and the number of students who completed the assignments for each course. Of the 32,009 students who signed up for the first course, 2,318 students fully completed it. 89 of those students were from TAU. This data shows that 10% of the total active students (those who accessed the course items at least once) completed the course, or 7% of those who registered.
These percentages match previously reported data in literature, showing that approximately 7% -10% of students who sign up for a MOOC actually complete it (Daniel, 2012;Kolowich, 2013;Koller, 2013). However, when examining the number of students who completed the course in comparison to those who registered for the "Signature Track" (and paid), the percentage was higher (62.5%). In regards to TAU students, the number of students who completed the course was even higher (97%), and their average final grade was 91.07. Focusing on the second course, only 287 of the 15,682 registered students completed the course and successfully submitted all of the assignments. 17 students were from TAU, and their average final grade was 88.88. This data shows that the second course had a relatively lower percentage of completion than the first course: approximately 2% of the total active students, 40% of those who registered for the 87 "Signature Track", and 60% of TAU students. Possible explanations could be the high-level subject, the depth of the material taught, and the peer-based final evaluation, which requires a greater time investment from the student. TAU students, who completed the second course, were required to take an additional final exam of open questions conducted at the University.
The intensity of usage was examined based on the following parameters: activity related to video lessons, scope of posts made on the forums, and rate of quiz submission. Table 2 presents the various activities by type of task as well as the student participation for each task. As shown, the highest volume of activity was in the video lessons. The total number of video lessons in both courses ranged from 50 to 53, which had been observed by 80% of the active students. Each student watched between 18 and 23 video lessons, on average, during the course. Examining student activity in the forums shows lower rates, compared to the video lessons. In each of the two courses, six forums were opened with various topics (e.g., general discussion, study groups, assignments and technical issues). In the first course, 9% -11% of the active students participated in the forums and posted comments and messages. Each student wrote an average of approximately 3 posts and 2 comments. In the second course, the rate of participation was even lower and only 3% -6% of the active students participated and posted messages. Each student wrote an average of approximately 3 posts and 5 comments. Looking at the quiz tasks in the first course, which included six quizzes, 40% of all active students participated. However, in the second course, which included five quizzes, only 18% of all active students participated. In both courses, each student submitted an average of four quizzes. Comparing student activity from both courses, we learned that although the total number of participants varied greatly, the average participation for a student in all activities was almost the same. The learner path was analyzed according to the various assignments during each course.   Final Assignment Period undergraduate students. In the first course, participants had a similar gender ratio, whereas the second course had a majority of male students (82%). Figure 3 presents the findings of the surveys from both courses: In general the students in both courses mentioned that they were satisfied from learning in the MOOCs. However, the students in the course, "What a plant knows", rated a higher level of satisfaction (very high) in all aspects (general average = 6.39 on a scale of 1 to 7) compared to the students in the course, "The rise and fall of Jerusalem" (overall average = 5.14). One explanation mentioned by the students was that the course, "The rise and fall of Jerusalem", was difficult to understand for students with no previous background in the subject. In analyzing the open questions, several interesting comments were mentioned by the students: The students in the course, "What a plant knows," indicated that the subject matter and content was clear, interesting, inspiring, well organized, and diverse. The video lesson learning method enabled them to experience activities which are not available in traditional classes, such as virtually visiting relevant sites and interviewing visiting lecturers. They also mentioned the valuable convenience of flexible learning -any place and any time, according to their schedule. In addition, several suggestions for improvement were made, such as receiving specific guidelines regarding course assignments and especially the final test, adding subtitles to videos to assist with any language issues, and addressing the imbalance between the difficulty level of the assignments and quizzes versus the final exam. Students mentioned their satisfaction with the lecturers of both courses, noting that the instructors were clear, interesting, engaging, stimulated thinking, and had an active presence in the forum tasks. Finally, the students in the course, "The fall and rise of Jerusalem," claimed that the course subject matter was difficult even for people who major in archeology.

Conclusions
In recent years, the use of MOOCs offered by leading universities to the general public has expanded. However, only 5% of higher education institutions in the USA offer such courses and only 9.3% report that they are still in a consideration phase. Moreover, only 25% of academic policy makers believe that MOOCs are a sustainable and reliable method for online courses over time (Allen & Seaman, 2014). In addition, fewer universities allow their students to take the MOOCs as part of their academic curriculum (Eaton, 2012;ACE, 2012;Masterson, 2013); nevertheless, more universities are increasingly exploring ways to incorporate MOOCs as part of their academic curriculum in different models (Firmin, Schiorring, Whitmer, Willett, Collins & Sujitparapitaya, 2014;Taneja & Goel, 2014;Joseph & Nath, 2013).
Although the debate concerning benefits and disadvantages of MOOCs to higher education is still ongoing (Borden, 2014), as well as the acceptance and accreditation of these courses by the universities, we cannot stop the "train" that has already left the station by ignoring the educational trends and the continuous penetration of emerging information and communication technologies (ICTs) into the education system. These new technologies will enable the development of innovative virtual learning environments, which will provide a variety of learning models such as MOOCs. These environments are focused on flexible learning any time anywhere, are context based, and are built up dynamically around content through learner participation, creation of user-generated content, and collaboration. Furthermore, they have the potential to give rise to communities of practice, enhance learning, and build personal learning networks (Chattopadhyay, 2014). These new models raise many questions concerning the transition from the physical space of the classroom, where the students and lecturer are present, to a virtual space where the students and the instructor use computers for learning, communicating, dialogue, encouraging learning, trying to prevent dropout, giving feedback, evaluating work, and so on.
One of the major challenges concerning the penetration of MOOCs is the university accreditation given to these courses. TAU took this challenge and developed three MOOCs in different fields of study (archeology, biology, and Middle Eastern studies). These courses are offered to the general, worldwide public, and are accredited to TAU students as part of their academic curriculum.
Additionally, a research and practicum group was created to accompany course development and gain critical experience in online instruction.
The pilot study presented in this paper illustrates the feasibility of implementing MOOCs as part of the academic curricula for undergraduate students, and describes the scope and intensity that exists in TAU courses in terms of learning, teaching, and assessing, especially during the early stages of a course. The preliminary data presented in this article indicate that the number of worldwide students who participated in these courses was very impressive (about 50,000 subscribers of which over 30,000 were active in two courses). The MOOCs penetration into the higher education system offers an alternative learning model, which includes a wide variety of activities, such as video lessons, interactive participation in forums, online tasks, and feedback.
The TAU MOOCs are considered to be a successful experience for all those involved: the students, who were very satisfied with their courses and their achievements; the lecturers, who were very enthusiastic and satisfied with the learning process, as well as the new experience; and the University policy makers, who took the challenge and integrated this new model of learning into the academic environment. From the academic point of view, following the MOOCs success at TAU, further activities will be considered, such as increasing the number of MOOCs, integrating them into the academic curricula, and creating an international academic program with other universities for special issues. Thus, integrating MOOCs in academic institutions for undergraduate learners could provide several advantages: flexible learning environments; enrichment with courses by leading instructors in various fields; and exposure to intercultural learning experiences from which 21 st century skills can be attained. On the other hand, we must take several issues into consideration: developed economical models, academic pedagogical standards, quality assurance, and student needs at the university.
Most recent studies Daniel, 2012;Rodriguez, 2012: Swan, Day, Bogle, & van Prooyen, 2014 on the MOOCs phenomenon mainly examine the benefits of this model from pedagogical, social, and technological aspects; however, future studies should also focus on the processes of running MOOCs, the advantages of integrating them into the academic curriculum, as well as on issues such as copyright, privacy, cultural differences (including language), and economic and organizational aspects.

Acknowledgement
This research was part of an evaluation undertaken by the authors for assessing the implementation of MOOCs at TAU. The authors follow Coursera's commitment to protect student privacy. As described in its working policy, student names and e-mail addresses are regarded as personally identifiable information (PII). This PII data is handled very carefully and is not included in research data exports. As outlined in the Coursera Company's Terms of Service and Privacy Policy, students who participate in Coursera's online classes do so with the expectation that Coursera will maintain the privacy of their academic records. In this research the authors used the data according to Coursera's ethical guidelines regarding the students of the two MOOCs. The data used in this research will be supplied upon request. There is no conflict of interest in the reported research.
The authors would like to thank TAU Financial Company for the MOOCs development, and Coursera for their invaluable support in obtaining permission and yielding access to the course data analyzed in this paper.