Online Learning Efficacy Research Database

Aim
To compare ophthalmology teaching delivered by eLearning with traditional lectures, in terms of undergraduate performance and satisfaction.
Methods
Randomised controlled crossover study at King’s College London Medical School with 245 third year medical students. The ophthalmology syllabus was divided into ten topics. Five topics were randomised to be taught by traditional lectures and five by electronic learning (eLearning). For the second rotation of students the topics were crossed over, so that those topics taught by traditional lectures were taught by eLearning and vice versa. At the end of each rotation the students sat an optional online mock examination containing 100 questions (ten on each topic). Students’ examination performance was compared between the two teaching methods. Student satisfaction was assessed using an online satisfaction survey. Outcome measures were the mean percentage of correct answers across all ten topics, student satisfaction and self-assessed knowledge.
Results
The mean examination score for questions taught by eLearning was 58% (95% CI, 55.7–59.6), versus 55% (95% CI 53.1–56.8) for traditional lectures (P = 0.047). Across all topics students were more satisfied with eLearning than traditional lectures, with 87% (95% CI 84.5–88.4) rating eLearning as ‘excellent’ or ‘good’ versus 65% (95% CI 62.0–67.4) for lectures (p < 0.0001). Overall 180 (75.6%) preferred eLearning compared to traditional lectures, with 166 (69.7%) rating eLearning ‘much better’ or ‘better,’ 61 (25.6%) ‘neutral’ and 11 (4.6%) ‘worse’ or ‘much worse.’
Conclusions
Student satisfaction and examination performance are both enhanced by ophthalmology eLearning. Similar eLearning modules may be suitable for other specialties and postgraduate learning. 
[less]

This paper compares the effectiveness of e-learning and face-to-face education in the previously neglected context of Saudi Arabia. This is done by examining Najran University’s e-learning experience after the institution suspended traditional course delivery due to the ongoing war between Saudi Arabia, the Arab Coalition, and Yemeni rebel groups. The analysis also considers the potential benefits offered by e-learning in crisis zones such as the southern border region of Najran, Saudi Arabia. The results indicate that there is no statistical or practical difference between online and face-to-face learning with respect to student performance. This paper also demonstrated that e-learning is capable of delivering the educational goals of higher learning institutions to areas wrecked by wars. E-Learning offers students a safe learning environment, engaging platforms, and most importantly a quality education. The findings of this paper contribute to a growing body of scholarship on the effectiveness and implementation of e-learning in the Middle East. 
[less]

This study examined the effectiveness of 3 online courses compared with the same 3 courses in a face-to-face (F2F) format, which had the same characteristics (e.g., the same instructor and final exam content and place). Effectiveness was examined by utilizing a wide range of variables, including 2 objective measures (N = 968): grades and completion rate; and 9 subjective measures (N = 360): 7 measures include instructional aspects (course structure, learning content, lessons watched, assignments, communication), engagement, and satisfaction. Findings indicate significant differences between online and F2F courses in most of the examined variables. Students in the online courses reported better understanding of the course structure, better communication with the course staff, watching the videos lessens more, and higher engagement and satisfaction. Students in the F2F courses reported better contribution of the learning content. Students' final grades were higher in the online courses, and no differences were found in the completion rate. The findings suggest that in many of the examined effectiveness aspects, online courses are as effective as, or more effective than, F2F courses. Interpretations of the findings are discussed 
[less]

This study evaluates the effectiveness of an 18-month-long course in Family Health. The course was offered in two modalities, distance education and face-to-face learning. Dependent variables were as follows: self-regulation of learning, procrastination, the perception of self-efficacy, and academic performance. The course was attended by 27 health professionals (i.e., physicians, nurses, and dentists) working in the Brazilian Unified Health System. The investigation followed a quasi-experimental design. Participants in the two modalities achieved similar academic performance; and globally no statistically significant differences were found regarding the study variables. Findings, notwithstanding their importance for professional training in health, are preliminary and further research is needed on the effectiveness of training modalities distance education and face-to-face learning (e.g., focus groups, interviews, online monitoring). The educational implications of this study are discussed and analyzed considering specificities and differences of each modality. 
[less]

The purpose of this study was to conduct a three-way comparison of face-to-face, online, and blended teaching modalities in an undergraduate Child Development course to determine if there were differences in student academic outcomes and course satisfaction across modalities. Student academic outcomes were measured by three examinations, one research paper assignment, and the overall course total grade. Course satisfaction was measured by administering the Student Opinion Questionnaire (SOQ) across the three teaching modalities and the Constructivist On-Line Learning Environment Survey (COLLES) to online and blended modalities. Results indicated that students performed equally well on all three examinations, research paper, and the overall course total grade across three teaching modalities, allaying traditional reservations about online and blended teaching efficacy. The SOQ and COLLES analysis found students from the three modalities were equally satisfied with their learning experiences. A Two-Factor Model identifying Face-to-Face Interaction and Learn on Demand (Flexibility) as factors determining student academic outcomes was proposed. Implications, limitations, and future research direction were discussed. 
[less]

This study compared the achievement of male and female students who were enrolled in an online univariate statistics course to students enrolled in a traditional face-to-face univariate statistics course. The subjects, 47 graduate students enrolled in univariate statistics classes at a public, comprehensive university, were randomly assigned to groups that used either online instruction or traditional face-to-face instruction. The effects of the independent variables of online univariate statistics instruction versus traditional face-to-face instruction on the dependent variable of statistics achievement were analyzed with a two-way analysis of variance. There was a significant difference between the achievement of students who used online univariate statistics instruction and those who used traditional face-to-face instruction (p=.001). The traditional face-to-face group scored higher with an effect size of 0.979, indicating that, on the average, those who were enrolled in a traditional face-to-face univariate statistics class outperformed 83.4% of those enrolled in the online statistics course. Moreover, females using online instruction out-performed males using online instruction and males enrolled in a traditional face-to-face course scored higher than females, with an effect size of 0.651, indicating that, on the average, those males outperformed 74.22% of the females enrolled in a traditional face-to-face statistics course. 
[less]

This study compares the academic performance and perceptions of 114 undergraduate students enrolled in an abnormal psychology course. Specifically, this study focuses on whether face-to-face (F2F) or blended modalities are associated with student learning outcomes. In this study, data analysis was based upon the examination of end-of-course grades, final exams, and an end-of-course survey. The data revealed that the same course presented in a F2F and a hybrid modality was associated with nearly identical learning outcomes in terms of student evaluations and final exam scores. However, students did note differences in course delivery in terms of time, assessment, and overall structure. 
[less]

Background
Soft skills are essential for employee success in the global marketplace; however, many developing countries lack content experts to provide the requisite instruction to an emerging workforce. One possible solution is to use an online, open-access curriculum. To date, no studies on soft skills curricula using an online learning platform have been undertaken in Mongolia.
Objective
To evaluate the efficacy of an online versus classroom platform to deliver a novel soft skills course in Mongolia.
Methods
A series of eight lectures along with corresponding surveys and multiple-choice question tests were developed and translated into the Mongolian language. Two different delivery modalities, online and traditional classroom lectures, were then compared for knowledge gain, comfort level, and satisfaction. Knowledge gain and comfort level were assessed pre- and post-course, while satisfaction was assessed only post-course.
Results
Enrollment in the online and classroom courses was 89 students and 291 students, respectively. Sixty-two online students (68% female) and 114 classroom students (77% female) completed the entire course and took the post-test. The online cohort had higher pre-test scores than the classroom cohort (46.4% and 37.3%, respectively, p < 0.01). The online cohort’s overall knowledge gain was not significant (0.4%, p=0.87), but the classroom cohort’s knowledge gain was significant (13.9%, p < 0.01). Both the online and classroom cohorts demonstrated significant improvement in overall comfort level for all soft skills topics (p < 0.01). Both cohorts were also highly satisfied with the course, as assessed on a Likert scale (4.59 for online, 4.40 for classroom).
Conclusion
The study compared two cohorts of Mongolian college students who took either an online or classroom-based soft skills course, and it was found that knowledge gain was significantly higher for the classroom group, while comfort and satisfaction with individual course topics was comparable. 
[less]

Biology I is a required course for many science, technology, engineering, and mathematics (STEM) majors and is often their first college-level laboratory experience. The replacement of the traditional face-to-face laboratory experience with virtual laboratories could influence students’ content knowledge, motivation to learn biology, and overall course performance. Three hundred undergraduate STEM students in face-to-face or virtual laboratories in a Biology I course completed a laboratory content test and the Biology Motivation Questionnaire II at the beginning and end of the semester. Final course grades were also obtained. Analyses revealed no significant differences between STEM students in the face-to-face and virtual laboratories in learning gains on the content test and final course grades. Two thirds of the STEM students experienced a decline in motivation to learn biology over the semester, but no significant differences were found between the laboratory groups. Thus, virtual laboratories may offer an affordable alternative to resource intensive face-to-face laboratories in large-enrollment Biology I courses. 
[less]

The overall goal of this study was to evaluate student experiences in online laboratory courses in order to inform the design and improvement of lab activities in a distance education program. Students were surveyed about their satisfaction and perceptions of usability and learning in both hands-on (at home) and computer-based simulation (virtual) labs in a variety of natural science courses. We also attempted to evaluate the effectiveness of several online chemistry courses taught with either hands-on kits or virtual laboratory activities, and examined the performance of students concurrently enrolled in lecture and laboratory chemistry courses versus those enrolled in a lecture only courses. The majority of survey respondents felt their online laboratory experience was the same as or better than their prior experiences in the traditional setting. Survey data also show that students believe their laboratory experiences reinforced and improved their understanding of concepts presented in lectures and the textbook, and thus may have helped them perform better on course assessments. Our data on performance suggest that students enrolled in online science courses do as well or better than their peers enrolled in traditional courses. The data also suggest that students who take lecture and laboratory concurrently outperform their lecture-only peers, independent of course (i.e., general or organic chemistry) or delivery method (i.e., online or traditional).

The overall goal of this study was to evaluate student experiences in online laboratory courses in order to inform the design and
improvement of lab activities in a distance education program. Students were surveyed about their satisfaction and perceptions of
usability and learning in both hands-on (at home) and computer-based simulation (virtual) labs in a variety of natural science
courses. We also attempted to evaluate the effectiveness of several online chemistry courses taught with either hands-on kits or
virtual laboratory activities, and examined the performance of students concurrently enrolled in lecture and laboratory chemistry
courses versus those enrolled in a lecture only courses. The majority of survey respondents felt their online laboratory experience
was the same as or better than their prior experiences in the traditional setting. Survey data also show that students believe their
laboratory experiences reinforced and improved their understanding of concepts presented in lectures and the textbook, and thus
may have helped them perform better on course assessments. Our data on performance suggest that students enrolled in online
science courses do as well or better than their peers enrolled in traditional courses. The data also suggest that students who take
lecture and laboratory concurrently outperform their lecture-only peers, independent of course (i.e., general or organic chemistry)
or delivery method (i.e., online or traditional). 
[less]