Online Learning Efficacy Research Database

Online summer courses offer opportunities to catch-up or stay on-track with course credits for students who cannot otherwise attend face-to-face summer courses. While online courses may have certain advantages, participation patterns and student success in summer terms are not yet well understood. This quantitative study analyzed four years of institutional data cumulating in 72,441 course enrollments of 23,610 students in 433 courses during summer terms at a large public research university. Multi-level logistic regression models indicated that characteristics including gender, in-state residency, admission test scores, previous online course enrollment, and course size, among others, can influence student enrollment by course modality. Multi-way fixed effects linear regression models indicated that student grades were slightly lower in online courses compared to face-to-face courses. However, at-risk college student populations (low-income students, first-generation students, low-performing students) were not found to suffer additional course performance penalties of online course participation. 
[less]

There are growing trends in postsecondary education that emphasize the importance of online and technology-enabled learning. This study aims to investigate whether the use of virtual, interactive, real-time, instructor-led (VIRI) online learning can deliver the same student performance and engagement outcomes as a face-to-face (F2F) course. The data consist of 698 participants taught in eight sections, over two semesters, with two different instructors. An analysis of variance was used to compare the differences for both student performance and engagement outcomes. The findings show that a synchronous course delivered using VIRI classroom technology has the same level of student performance outcomes as F2F learning. This study suggests that VIRI technology is an effective synchronous learning environment. 
[less]

Although online courses are becoming increasingly popular in higher education, evidence is inconclusive regarding whether online students are likely to be as academically successful and motivated as students in face-to-face courses. In this study, we documented online and face-to-face students’ academic motivation and outcomes in community college mathematics courses, and whether differences might vary based on student characteristics (i.e., gender, underrepresented ethnic/racial minority status, first-generation college status, and adult learner status). Over 2,400 developmental mathematics students reported on their math motivation at the beginning (Week 1) and middle (Weeks 3, 5) of the semester. Findings indicated that online students received lower grades and were less likely to pass from their courses than face-to-face students, with online adult learners receiving particularly low final course grades and pass rates. In contrast, online and face-to-face students did not differ on incoming motivation, with subgroup analyses suggesting largely similar patterns of motivation across student groups. Together, findings suggest that online and faceto-face students may differ overall in academic outcomes but not in their motivation or differentially based on student characteristics. Small but significant differences on academic outcomes across modalities (Cohen’s ds = 0.17–0.28) have implications for community college students’ success in online learning environments, particularly for adult learners who are most likely to be faced with competing demands. 
[less]

Hybrid and online courses are gaining attention as alternatives to traditional face-to-face classes. In addition to the pedagogical flexibility afforded by alternative formats, these courses also appeal to campuses aiming to maximize classroom space. The literature, however, reports conflicting results regarding the effect of hybrid and online courses on student learning. We designed, taught, and assessed a fully online course (100% online) and a hybrid-and-flipped course (50% online 50% face-to-face) and compared those for¬mats with a lecture-based face-to-face course. The three formats also varied in the degree of structure; the hybrid course was the most structured and the face-to-face course was the least structured. All three courses were taught by the same instructor in a large His¬panic-serving research university. We found that exam scores for all students were lowest in the face-to-face course. Hispanic and Black students had higher scores in the hybrid format compared with online and face-to-face, while white students had the highest per¬formance in the online format. We conclude that a hybrid course format with high struc¬ture can improve exam performance for traditionally underrepresented students, closing the achievement gap even while in-person contact hours are reduced. 
[less]

Background: Despite the increasing reliance in counselor education on online teaching and learning, the efficacy is not well documented.
Objective: To investigate learning outcomes for master’s-level rehabilitation and mental health counseling students.
Methods: This study compared on-campus and online learning course delivery methods with pre-and post-tests using 41 participants across four courses.
Findings: Significant differences were found within both groups between the pre- and post-test, indicating significant gains in knowledge acquisition. No significant differences were found between group modalities in the magnitude of improvement in test scores.
Conclusions: Findings suggest that no differences exist in these learning outcomes when online and on-campus teaching modalities are compared and that both modalities produce positive learning outcomes. Continued research is needed to address additional questions in this area. 
[less]

Both large lectures and online formats are encouraged as viable options for the delivery of course material in higher education today, especially in large general education courses. However, how do such delivery formats impact student learning? In an effort to understand how lecture format impacts cognitive learning, this study investigated how the delivery format impacts the actual and perceived cognitive learning of students in a basic communication course in a midsized Midwestern university. Using one-way between-subjects ANOVA, earned exam grades, coded written reflections, and scores from a cognitive learning perception scale were compared across online, hybrid, and face-
to-face lecture delivery formats. As predicted, no significant differences on any of the dependent variables were identified, indicating a lack of influence of delivery format on actual or perceived levels of cognitive learning. However, aspects of teacher immediacy, student learning preferences, and degree of interaction in recitation sections is discussed, along with implications for future research. 
[less]

While educators and librarians have long been concerned with developing undergraduates’ ability to find credible sources, the abundance of unreliable information online has exponentially complicated the situation. In developing a new curriculum for English Composition 1001 classes, a first-year writing class at the University of Cincinnati, we developed new ways of engaging with student experiences before and beyond the class sessions to address source analysis through active peer learning. Using an action research framework to position ourselves as both practitioners and researchers, we considered our own practice as teachers as much as student outcomes. We compared the use of flipped content with in-class instruction. By capturing students’ research process through pre-class and post-class surveys, we could better understand the online ecosystem they must navigate and help them reflect critically on their progress. Our analysis of student survey responses allowed us to measure progress in three areas: source quality, search strategy, and topic relevance. Flipped class activities had the same result on student behavior as did in-class delivery. 
[less]

Midwives and general practice nurses are ideally positioned to provide nutrition education to pregnant women. However, it appears that they do not receive sufficient nutrition training to enable them to fulfil this role. This study aimed to develop, implement and evaluate a suite of learning resources developed specifically for midwives, general practice nurses and student nurses. A four-module suite of learning resources was developed based on recommendations in the Australian Antenatal Care Clinical Guidelines as well as formative evaluation with stakeholders. The feasibility of these modules was tested using a pre-test and post-test quasi-experimental design with three arms using convenient sampling (face-to-face with midwives; online with student nurses; and online with midwives, nurses and practice nurses). Completion rates across the three study arms were poor (n=40 participants in total). For the combined data, there was a significant increase in knowledge scores across all modules from the pretest score (median (IQR): 3.46 (2.09–4.13)) to the post-test score (5.66 (4.66–6.00)) (p<0.001). Studies of high quality are required to determine if changing the nutrition knowledge and confidence in delivering nutrition care of health professionals results in sustainable changes to their clinical practice. 
[less]

Assembling and curating specimen collections is a valuable educational exercise that integrates subject-specific skills such as field collection, curation, identification, organization, and interpretation of relationships. Collection projects have been used primarily in face-to-face classes, but they can be readily adapted for distance education. The primary challenges to using collection projects in distance education center on two concerns: (1) whether distance students learn as much as their face-to-face peers and (2) whether academic dishonesty occurs more often in distance education than face to face. This study addressed both concerns by assessing learning outcomes in two entomology courses with both face-to-face and distance sections and evaluating the frequency of specimen-based plagiarism (submitting specimens collected by someone else). An ungraded survey testing students’ insect identification knowledge found equivalent learning outcomes in face-to-face and distance classes. Insect collections were monitored for plagiarized (resubmitted or purchased) specimens in a 5-year “mark-release-recapture’ investigation. Academic dishonesty was detected in fewer than 2% of collections; cheating was more than 12 times more likely in distance than in face-to-face classes. This study’s findings raise the possibility that distance learning assessments can be artificially inflated by cheating, suggesting that evaluations of distance learning should be considered in light of academic dishonesty. These results highlight the benefits and challenges of collections as teaching tools in distance education and underscore the need for instructors to be vigilant about academic integrity. 
[less]

Objective
Online education is effective for knowledge acquisition, but its effect on clinical skill development is not well characterized. Weaimed to compare communication skills of 50 first-year medical students who learned to assess and treat patients through an online learning module vs an in-class lecture.
Methods
Twenty-six students were randomized to learn about antidepressant-induced sexual dysfunction in class and 24 learned the same content through an online module. Students were individually observed conducting an interview with a standardized patient with antidepressant-induced sexual dysfunction. Students were assessed by faculty raters blinded to the student’s learning mode. Standardized patients were asked about their willingness to have the student as their physician.
Results
More students who learned in class vs online demonstrated appropriate verbal empathy (18 [69%] vs 8 [33%]; P = 0.01), defined as completing each task in the “verbal empathy” assessment domain, as measured by a faculty rater. Other assessed variables were not significantly different. Standardized patients’ willingness (vs unwillingness; P = 0.01) to have the student as their physician was associated with the demonstration (by faculty appraisal) of a number of basic skills: using open-ended questions, asking one question at a time, using gender-neutral terminology when asking about the patient’s relationship, and using appropriate sexual-health terminology.
Conclusions
This study, although limited by a single-site design and the small number of participants, offers preliminary evidence that, if confirmed, may suggest that in-class learning from a psychiatrist (vs from an online module) is associated with greater verbal empathy in the assessment of SSRI-related sexual dysfunction 
[less]