Constructing a Design Framework and Pedagogical Approach for Adaptive Learning in Higher Education: A Practitioner's Perspective

While adaptive learning is emerging as a promising technology to promote access and quality at a large scale in higher education (Becker et al., 2018), the implementation of adaptive learning in teaching and learning is still sporadic, and it is unclear how to best design and teach an adaptive learning course in a higher education context. As early adopters, a team of instructors, instructional designers, and administrators at the University of Central Florida (UCF) identified five key design features as an adaptive learning design framework to guide the unique course design process. These five features involve deliberate design and development efforts that could bring significant benefits to student learning. The purpose of this field note is to present a design framework and best practices for teaching from both a systems and a pedagogical approach in the context of implementation at UCF. We also share the rationale and classification framework UCF has adopted to ensure the term “adaptive learning” is universally understood across campus. This paper offers insights into the design, delivery, and implications of utilizing adaptive learning systems in higher education courses at a public research university and attempts to capture the intimacy of lessons learned and best practices gathered since the project’s inception in 2014.


Résumé de l'article
While adaptive learning is emerging as a promising technology to promote access and quality at a large scale in higher education (Becker et al., 2018), the implementation of adaptive learning in teaching and learning is still sporadic, and it is unclear how to best design and teach an adaptive learning course in a higher education context. As early adopters, a team of instructors, instructional designers, and administrators at the University of Central Florida (UCF) identified five key design features as an adaptive learning design framework to guide the unique course design process. These five features involve deliberate design and development efforts that could bring significant benefits to student learning. The purpose of this field note is to present a design framework and best practices for teaching from both a systems and a pedagogical approach in the context of implementation at UCF. We also share the rationale and classification framework UCF has adopted to ensure the term "adaptive learning" is universally understood across campus. This paper offers insights into the design, delivery, and implications of utilizing adaptive learning systems in higher education courses at a public research university and attempts to capture the intimacy of lessons learned and best practices gathered since the project's inception in 2014.

Introduction
Any cursory review of the digital learning marketplace or stroll through an EdTech conference exhibit hall will reveal the ubiquity of the term "adaptive learning." Whether the term refers to a specific platform, a publisher, or a pedagogical practice, it is clear that the last 5-10 years have seen a significant increase in its usage. But what does the term "adaptive learning" mean? As the usage of adaptive learning in higher education has advanced over the past few years, the research and practitioner communities seem to have coalesced around a few unifying concepts. For example, in 2013, the Bill and Melinda Gates Foundation launched the Adaptive Learning Market Acceleration Program (ALMAP) with nine platforms that "use learning model algorithms to track learner progress and recommend next steps in a learning path" (Yarnall, Means, & Wetzel, 2016, p.5). Similarly, another initiative funded by the Bill and Melinda Gates Foundation, the Association of Public and Land-Grant Universities' (APLU's) Personalizing Learning with Adaptive Courseware explains that "(a)daptive courseware collects student data through assessment, analyzes that data and uses it to offer personalized learning paths to each student or reports and recommendations to instructors to help personalize the learning experience" (Association of Public & Land-Grant Universities [APLU], 2017a, para.1).
However, with the increased attention and usage of the term "adaptive learning" there is also an increase in the inconsistency with which it is used. Due to its popularity and promotion by high-profile organizations such as the Bill and Melinda Gates Foundation, the term has also become something of a marketing buzzword. There are various adaptive learning systems available in today's educational technology market.
For example, the Association of Public and Land-Grant Universities (APLU; 2017b) approved 21 adaptive courseware providers and products, with more and more companies in the marketplace using the term to promote their products. Unfortunately, their products do not all function in the same way and may not offer the same feature sets. They adapt learning in many different forms, yet are being labeled under the same umbrella term of "adaptive learning." Adaptive learning remains elusive to define and continues to develop over time (Edsurge, 2016;Pugliese, 2016), and there are no specific guidelines or taxonomies for how the adaptive capabilities are described.
Some adaptive systems providers classify their adaptive systems according to the instructional activities where adaptivity occurs: the content, the assessment, or the sequence as an integrated approach (Edsurge, 2016). Others classify the systems based on the underlying adaptive algorithm (Khosravi, Sadiq, & Gasevic, 2020;Thompson, 2013). Pugliese (2016) categorized adaptive systems into four types: machine-learning systems, advanced algorithm systems, rule-based systems, and decision-tree systems (also see: Edwards et al., 2017). Yet, one specific adaptive algorithm is rarely identified with one system. As a matter of fact, many of the major adaptive learning players use a combination of the above adaptive algorithms in their systems.
At the same time, these algorithms are often protected as proprietary commercial secrets. In such cases, even experienced users do not have the capabilities to decode the "black box" and understand the specific rules of the adaptive learning systems.
The matter of how institutions of higher education design and deliver adaptive learning courses (using a variety of adaptive platforms) to ensure program objectives are being met becomes a paramount issue and has been so at the University of Central Florida (UCF) as well. As UCF expanded its adaptive learning initiative, it became increasingly difficult to manage the many platforms that were either being considered 175 for adoption or were already being used by faculty across campus. The companies behind these platforms (in many cases publishers) labeled their systems as "adaptive," yet the systems did not all function the same way. The underlying adaptive schemas differed, the feature sets varied, and the emphases between homework/practice/assessment and primary instructional content were not consistent. Therefore, as its adaptive learning initiative grew from a few pilot courses to a more institutional scale, it became necessary to ensure that the courses labeled as "adaptive" all referred to the same basic functionalities. This was important for two primary reasons: (1) to make sure that students understood what they were registering for when they selected a course with an adaptive learning indicator in the schedule, and (2) to ensure that institutional evaluation efforts "compared apples to apples" when assessing the efficacy of adaptive learning regarding student success.
In order for UCF to credential a course as "adaptive" in its course catalogue, regardless of platform, the course must provide a minimum of three adaptive design features, with two other features listed as preferred (the UCF Adaptive Learning Design Framework). These features are, in the order of a design sequence: 1. The course consists of objective-based learning bits/lessons.
2. It presents personalized content and assessments with timely feedback.
3. It offers an adaptive learning pathway that includes prerequisite learning materials, an acceleration or remediation capability that adapts to students' knowledge, provides learning analytics, and recommends personalized interventions.
4. It presents alternative adaptive content presentation (video, text, etc.) based on learning performance and learning characteristics (optional but preferred criterion). 5. It procedurally generates questions and content using variables and conditions (optional but preferred criterion).
To answer the question of how to design and teach adaptive courses, this paper will expand upon each of the above five design features to provide institutional context and rationale and discuss the implementation of the design framework and pedagogical practices that maximize the benefits of adaptive technologies.

The Digital Learning Context at UCF
UCF has a long history of successfully delivering online and blended learning, which was initiated in the mid-1990s. In the 2018-2019 academic year, UCF generated more than 47% of its annual student credit hours in online and blended modalities. Digital learning at UCF serves both on-and off-campus students and includes an exclusively online virtual campus called UCF Online. The university's adaptive learning initiative, consequently, grew out of this foundation of digital learning success.
UCF currently recognizes six official course delivery modalities (Center for Distributed Learning, 2019):

176
• World Wide Web -"W" courses are conducted via Web-based instruction and collaboration. Some courses may require minimal campus attendance or in-person/proctored examinations.
• Mixed Mode/Reduced Seat Time -"M" courses are blended and include both required classroom attendance and online instruction. Classes have substantial activity conducted online, which substitutes for some classroom meetings.
• Video Streaming -"V" courses are delivered over the web via streaming digital video, which may be supplemented by additional online activity, projects, or exams.
• Video Streaming/Reduced Seat Time -In these "RV" courses, classroom-based content is available over the web via streaming video and classroom attendance is not required. Other required activities that substitute for video instruction may include any of the following elements: web activity, in-person or proctored examinations, and labs.
• Active Learning/Reduced Seat Time -"RA" courses utilize Web-based learning technologies as the primary instructional medium within a blended course combining required face-to-face and online elements. Classes have substantial activity conducted online, and classroom activities are limited to no more than 20% of the instructional time over the course of the semester.
• Face-To-Face Instruction -"P" courses have required classroom attendance and meet on a regularly scheduled basis. Students may encounter online, video, or adaptive elements as part of the instruction, thus requiring a computer.
These modalities are coded into the university's student information system, allowing students to search for specific types of classes and the institution to track and evaluate by course type. Adaptive learning design and technology may then be applied to any of these modalities as illustrated by  In a PAL course, a portion of the overall instruction is delivered via an online adaptive learning system that customizes objective-driven content and assessments to create a personalized learning path for each student according to their knowledge, skills, and learning needs. PAL courses utilize one of several adaptive platforms that provides the previously defined adaptive design features. Some of the systems in active use on campus include Realizeit, ALEKS, Knewton Alta, and LearnSmart.
To support the development, delivery, and evaluation of its adaptive learning initiative, UCF established the PAL team. Consisting primarily of credentialed instructional designers, with assistance from technical and content experts, the PAL team is responsible for working with faculty to design and construct adaptive courses in all modalities, as well as support the course delivery and evaluation of its efficacy. In addition to direct faculty support through consultations, the PAL team may also assist faculty with course authoring within an adaptive platform, and this focus on faculty development and preparation has been key to the success of the university's adaptive learning initiative.
To further enhance the onboarding experience of faculty interested in designing and teaching an adaptive course, the PAL team has developed a training course called PAL6000. This self-paced course involves meeting with an assigned instructional designer at least six times, during the process of completing online course readings and a Build Your Course Project. The PAL6000 Certificate of Completion grants PAL credentials to design and teach using the Realizeit adaptive learning system. While a large percentage of certified PAL6000 faculty design their adaptive course(s) from scratch or some form of existing content, some alternatively adopt adaptive courseware from publishers. In these cases, the PAL team also partners with adaptive vendors to conduct workshops and ad hoc training for faculty to maximize the benefits of personalization and adaptivity for students. Now that a contextual base has been established, the remainder of this field note focuses on the design, delivery, and implications of utilizing PAL systems at UCF, capturing the lessons learned and best practices gathered since the first adaptive pilot in 2014.

An Adaptive Learning Design Framework
At UCF, many instructors choose to design their adaptive courses with self-authored content, open educational resources (OER), or publisher content. This is primarily due to the lack of existing adaptive courseware in most disciplines. When designing these new adaptive learning courses with individual faculty, the PAL instructional designers follow a systems approach using the five key adaptive design features-the Adaptive Learning Design Framework-as displayed in Figure 2. The first three design features are required components of any PAL designated course, while the last two (although not required) add important value to any PAL course experience. The designers work with instructors to incorporate these five features into course design. (These five design features will be discussed in further detail in the following sections).
178 Figure 2. UCF's adaptive learning design framework with five key features.

Objective-Based Learning Bits
Defining specific learning objectives as a "first-step" in adaptive course-design establishes the parameters by which a variety of content-trajectories can converge, diverge, and/or repeat (Willcox & Huang, 2017). In the process of authoring adaptive content, as a best practice, UCF course instructors, as the subject matter experts (SMEs), are guided to identify small knowledge units, called learning bits (i.e., lessons) that typically take students an average of 30 minutes to complete. This content structuring process typically takes on the form of breaking one learning objective into five or more concepts. For instance, instead of delivering 14 fully intact chapters of content, UCF's PAL courses might contain up to two hundred mini lessons derived from those 14 chapters where students are evaluated frequently (e.g., at the end of each lesson) to measure the level of mastery they have achieved related to one or more learning objectives.
Suppose one course objective reads as follows: "Students will be able to use simple linear regression as indications and trends of business and economic data" (Buhagiar, 2018). To support this objective, 10 lessons ( Figure 3) on concepts or component skills are identified and mapped back to that objective in the form of evidence-bearing assignments and/or assessments, which are then measured individually and collectively by the PAL system to determine which content and/or assessment item(s) to deliver next to increase the students' likelihood of achieving mastery on that objective.

Personalized Assessment and Content
After specifying learning bits or lessons at the concept or component skill level, the courseware authoring process involves drafting content materials, assessment items, and detailed feedback. The majority of adaptive systems are assessment-driven (Essa, 2016) as the platform delivers personalized instruction based on the results of pretests/posttests and practice and/or graded assessment(s). Compared to traditional online courses, an instructor spends considerably more time developing assessment items and feedback than writing content. During the process of designing an adaptive course, after the learning objectives are granularized, an instructor would likely identify learning bits that lack assessment items from the existing question pool, as it is recommended that each adaptive lesson includes at least five or more questions. The more questions a lesson includes, the more robust the learning experience. In some of UCF's completed adaptive courses, for example, instructors expanded their question pool from a couple of hundred (maybe 20 per chapter) to over 1,000 for the entire curriculum.

Constructing a Design Framework and Pedagogical Approach for Adaptive Learning in Higher Education
Cavanagh, Chen, Lahcen, and Paradiso

180
Writing detailed feedback is another key element in adaptive course design. Students improve their performance through continuous practice, feedback, correction, and enrichment in the formative assessments of each lesson. Students need to practice with timely feedback in order to identify specific areas they may need to improve. Therefore, instructors are highly recommended to write detailed feedback at the question level to scaffold student learning. This feedback could include the correct answer, why a particular response/option is correct (or incorrect), or recommendations of topics for the student to review (Chen, Bastedo, Kirkley, Stull, & Tojo, 2017). Figure 4 illustrates an example question (Chen, 2019) from an adaptive course with detailed feedback for both correct and incorrect responses. To meet each student's unique learning needs, a large number of learning activities must be developed and tagged, which creates significant workload for faculty SME and instructional designers (Khosravi, Sadig, & Gasevic, 2020). While the design and development work are time-consuming, this phenomenon is rarely 181 reported in the literature (Baker, 2016;Essa, 2016). However, when reported, such as in the case of Pavlik Jr., Brawner, Olney, & Mitrovic (2013), an estimate of 200 hours of development time was estimated to be spent for every one hour of instructional content design. In another study (Aleven, Mclaren, Sewal, & Koedinger, 2009), with the use of smart tools, it took the SME alone 25 hours to author one hour of content.
At UCF, each PAL instructional designer actively works with two to five faculty members who focus on completing one or two adaptive modules (objectives) each semester; therefore, due to resource limitations, one adaptive course might take six or more academic semesters to complete.

Adaptive Learning Path
The assessment-driven learning bits that were authored during the content development phase are then mapped into a hierarchical structure to ensure students master prerequisite skills before proceeding to more advanced topic areas in the hierarchy. The adaptivity starts with knowledge determination (in the form of a pre-determined set of questions) to allow the system to gather information about the students prior to having them engaging in the core material. As a caveat in regard to "pretesting," the degree to which an adaptive system can be configured varies across platforms. Pretesting determines preliminary questions a student sees, and based on students' performance, an adaptive system determines students' acceleration or remediation through the objective-based learning pathway. It is a very valuable system functionality for an adaptive system to determine students' knowledge prior to moving forward to their core learning task(s), particularly if it is developed thoughtfully.
To a varying extent (depending on the system), a learning path with feedback/remediation can be constructed, but the adaptivity only exists in theory until an agent (in this case a student) enters the system and interacts with it. At that point, the system begins to gather data about the learner-primarily structured around content preferences (possibly identity) and proficiency level. These bits of information then power the type and/or difficulty-level of material(s) a student encounters, and as the learner-profile begins to form related to the aforementioned items, the instructor can analyze those learner-centered data trends and intervene as appropriate to encourage content review and revision-reinforcing student mastery. Figures 5a and 5b illustrate two learning paths based on different adaptive course designs at UCF.  Learning analytics is another key component of the adaptive learning path. It is not a design feature but a key teaching feature once the instructor starts to teach with an adaptive system. In a number of courses at UCF, adaptive courseware delivers a robust web of content with personalized feedback that results in granularized data points for each student, which can then be acted upon by the instructor(s) in real-time.
How long has a student spent in a given learning space, and how much effort has been expended during that time? Has this student flagged any questions for review or made continuous attempts at certain questions to no avail? This can be viewed at the aggregate (class) level and domain level as well, and what is particularly helpful in each scenario is if an instructor actually possesses the flexibility to engage differently (based on that feedback) in the next face-to-face session, online component, office hours, or even email and/or a class announcement. This type of student-centered learning analytics can be used to create peer/mentoring groups and provide any other type of intervention before this academic concern becomes either irreparable or very challenging to resolve. Detailed examples of learning analytics are presented in the Pedagogy section of this paper.
The success of this adaptive pathway depends on the instructor and a few main system functionalities: prerequisite mapping, assessment variability (textual and numeric components), content preconditions, and alternative learning modalities (textual, interactive, multimedia). The latter of which will be expounded upon in the next section.

Alternative Content and Choices
In the process of organizing content into learning bits (lessons), UCF PAL instructors and instructional designers found that relative to traditional courses, adaptive courses need additional or alternative content (Chen et al., 2017). This feature is not discussed widely in adaptive learning literature (as far as the authors have observed), but anecdotal feedback indicates this enhancement augments the adaptive personalization of adaptive courses. For example, in adaptive courses with alternative content (Figure 6), the system will ask students if they would like an alternative version of an example or instruction during a lesson path. 185

Procedurally Generated Questions
While content and assessment development can be arduous and time-consuming, their payoff is in the potentiality of constructing a personalized (contextually relevant) and adaptive (evolving) learning experience. This adaptive experience can be further enhanced through leveraging content variables, groupings, and conditions.
Regarding content variables, groupings, and conditions, there are a few noteworthy examples from within the UCF PAL ecosystem. One that stands out is a set of mathematical (word) problems that have strings of variables for male and/or female names and a completely different scenario depending on a student's major (e.g., business, education, etc.) so each student will access content that is relevant to learner's background and characteristic (Muhs, 2018). This same design feature is applied to quantitative aspects of the course as well, where numbers are randomly generated (within predefined thresholds) for practice problems and other numeric assessments (including advanced data analysis using Microsoft Excel). Grouping and conditions are closely related and can be looked at simultaneously and, depending on the flexibility of the adaptive learning system, groupings of questions can also be set up to manifest upon certain conditions.
These conditions might relate to the variables of a given problem or case study and even to specific values appended to learning content so the content only appears under specific numerically defined circumstances (e.g., less than or equal to a score of 70% on the last assessment will offer learning item 1, whereas a score greater than 70% will offer learning item 2). Figure 7 presents a case study with embedded variables from a nursing undergraduate course. Each student is presented with a unique case study with varying correct answers and feedback. Students are motivated to practice the case study multiple times because a different case study is presented for each attempt. The five adaptive design features listed above can be arranged in a myriad of complex ways, but the content area itself (and the amount of content available), along with the subject matter expert/instructor and design team, may afford or restrict the adaptive system capacities due to a lack of systems expertise or simple time constraints. That being said, adaptive systems are continuously evolving, so the more involved a design team is with the build process-communicating directly with the software company, offering feedback, and proposing feature requests-the more willing these educational technology companies are to stretch and expand to create new and innovative ways to provide meaningful adaptive learning solutions.

A Pedagogical Approach
Regardless of the instructors' choice to create their own adaptive content or adopt existing courseware, teaching with an adaptive platform involves deliberate planning and management, and the importance of an instructor in the use of an adaptive platform cannot be stressed enough. Therefore, adaptive pedagogy is highlighted in our faculty training process to make sure instructors use the system, not only as a homework system, but also as an integrated instructional tool to improve student learning. The following sections discuss the best practices for teaching with adaptive technologies.

Change of Perspectives: From Lecturing to Personalization
As the literature (Chen et al., 2017;Dziuban, Moskal, Johnson, & Evans, 2017;Dziuban et al., 2018;Essa, 2016) suggests, adaptive learning is often linked with terms such as personalized learning, mastery-based learning, and student-centered learning. Unlike traditional lecturing, adaptive instruction is dynamic and personalized to meet the unique needs of individual learners. Since students come with different knowledge sets, the intention of adaptivity is to help each of them reach a desired level of mastery at their own pace by allowing them to be active and independent learners instead of passive listeners in traditional lectures.
Adaptivity is achieved by determining individual's prior knowledge and providing personalized learning recommendations. In adaptive courses, instructors release control of certain aspects of instruction, leaving some of the responsibility in the hands of students.
One of the misconceptions that comes with the adaptive system is that the technology will replace instructors in schools. Although adaptive technology facilitates the students' learning process, the successful implementation of adaptive learning still requires human planning, interactions, monitoring, and interventions. The role of an instructor remains crucial (Baker, 2016;Brusco, 2018;Essa, 2016;Essa & Laster, 2017) in adaptive learning because only the instructor can select learning objectives that fit with the overall course learning outcomes and targeted student population, align both online and face-to-face activities and assessment with selected learning objectives, orchestrate learning activities both online and in person, and provide individualized feedback and support for all learners (Essa & Laster, 2017). The instructor organizes various additional class activities around the adaptive practices, sets up course expectations and grading schemes, monitors students' progresses, and answers questions. It is the instructor's responsibilities to assist students in understanding the functionalities and the value of the adaptive system, and to help students transition from passive learners to active collaborators so they can begin to understand the rationale why frequent assessments provide guidance instead of hindrance to their progress. This level of awareness is critical, as Deslauriers, McCarty

Understanding the Adaptive System: Getting Ready to Teach
For instructors who adopt existing adaptive courseware, the first step is to understand what an adaptive system is and evaluate existing adaptive courseware to select the one that most supports the course learning outcomes. Some of the questions that the instructor can ask during the evaluation process include: Is it simple to navigate? Does it integrate with the institutional LMS? Is it compliant with the Americans with Disabilities Act (ADA)? How does it make learning recommendations to students? Does it provide good explanations and ample resources? Can the instructor customize, add, or edit content and questions? What kind of instructor and student support will the company provide? A complete list of technology evaluation criteria can be found on the Courseware in Context website. If none of the existing adaptive courseware suffices, the instructor still has the option to create their own adaptive courseware using an adaptive platform that permits original or 3 rd -party content to be integrated.
After selecting the courseware, it is essential for the instructor to take some time to learn how the adaptive system supports student learning, enlisting the support of publisher representatives and instructional designers as necessary. Only with a thorough understanding of the system will the instructor be able to select relevant content, take advantage of the system adaptivity, and remedy any existing system limitations with instructor-made supplementary resources and class activities. After the instructor understands how the system works and what content and questions the system offers, he/she can then help the students build trust in the system's recommendations, select objectives and learning activities that meet students' needs, and prepare additional learning materials that might be missing from the adaptive courseware.
In an adaptive course, instructors should provide students with an overarching picture of how the course works to help them understand and manage the workload. Most likely, adaptive assignments have a nontraditional grading scheme where scores are calculated based on a combination of factors, such as learning performance, time spent, effort, speed, and other data points. Again, it is the instructor's responsibility to help students translate the scores and guide them in the right direction to maximize their learning efforts.
Confusion about grading schemes could easily result in low student motivation, which will lead to poor learning performance.

Teaching With Adaptive Learning: Class Management Strategies
At the beginning of the semester, in adaptive courses, instructors should present clear syllabus documentation with explicit assignments, grading policies, and criteria for advancing if students are allowed to complete the course early to advance into the next class. In addition to a clear syllabus, we highly recommend that instructors prepare a syllabus quiz for students to complete so they read the syllabus carefully and do not miss important information.
As most of the adaptive assignments are self-paced individual learning activities, instructors should make recommendations to guide self-paced learning so learning is effective. As the learning path for each student is personalized, some students might have more objectives to learn or master than others. Thus, it is important to allocate adequate time for those students to learn and reflect before important milestones. In the situation where students pace their own learning, some might procrastinate and fall behind due to various reasons. Therefore, it is essential for instructors to intervene with reminders and online or inperson mentoring opportunities and to allow for extra time on milestone tests and reasonable opportunities for students to catch up.
It is critical for instructors to become knowledgeable about learning analytics presented in the adaptive system, as indicated in Figure 8a and 8b. Student-centered learning analytics, including learning rates/speed, login frequency and time, student progress, and learning performance, can offer insights to help instructors understand their students. An early progress feedback alert system can greatly help students focus on their tasks. For instance, instructors can set up automated reminders based on inactivity or abnormal learning rates. It is a good practice to check in with students with abnormally slow or fast learning rates to avoid procrastination or potential cheating/gaming practices.
189    As instructors review the students' performance and interact with them, it is easy to identify learning gaps, misconceptions, and challenging concepts among students. Depending on the results from these dashboards, instructors can prepare in-class mini-lectures, small-group discussions, or workshops to provide additional support for groups of students with common difficulties. Figure 10 documents an example of a mini-lecture and how it is delivered for students with low mastery of compound inequalities in the College Algebra course. For specific groups or students, instructors can also offer individualized cumulative reviews to help them set up connections between prior knowledge and new concepts. Providing automated and instructor-led feedback adds tremendous values to the adaptive learning process.
193 Figure 10. Sample in-class mini-lesson for students with low mastery of compound inequalities in the

Conclusion
As instructors, instructional designers, and administrators, we attempt to facilitate the adaptive learning process so that the benefits of adaptive technologies can be maximized in the design and delivery of adaptive courses. Following a systems approach to course design, we define adaptive courses as those which have a portion of the overall online learning content delivered via an adaptive learning system. It customizes objective-driven content and assessments to create a personalized learning path for each student according to their knowledge, skills, and learning needs. In the design process, the instructor should expect to spend a good amount of time 1) chunking the materials into learning bits based on granular objectives, 2) authoring assessment items and detailed feedback, 3) selecting and mapping objectives and lessons that are aligned with the course goals and student needs, and 4) enhancing the course with variables and alternative content.
As for teaching with adaptive courses, the following list highlights some pedagogical best practices. An instructor should 1. understand how adaptive systems work, especially with how grades are calculated; 194 2. review key domain-based learning analytics to get an overall understanding of student performances; 3. adopt a concept-based flexible teaching method that targets challenging concepts, not all concepts; and 4. provide personalized teaching interventions based on student-based learning analytics.
The use of adaptive learning in higher education is an emergent area for study. While the pedagogical approach is grounded in student-centered mastery learning theories, there is still limited evidence on how adaptive systems improve student performance and/or reduce learning gaps (Anderson, 2019;Dziuban et al., 2017Dziuban et al., , 2018Essa & Laster, 2017;Weber, 2019). Our goal is to document best practices for adaptive implementation from our design and teaching experiences, and we encourage further experimentations to be conducted on the effectiveness of these best practices. We hope that the adaptive learning design framework and best teaching practices proposed in this field note could be implemented in other higher education institutions with any assortment of adaptive platforms. We also welcome responses and invitations from other institutions for future collaboration and research opportunities.