Online Learning Efficacy Research Database

Objective: To describe and evaluate the transition of a pharmacy residency and fellowship (PRF) elective course to a hybrid online platform. Innovation: In 2016, the 1-credit hour PRF elective was transitioned from a live, synchronous course to a hybrid online platform. Over the course of the semester, students completed eight modules along with assignments that pertained to a different component of PRF. Course grades and evaluations, as well as PRF placement rates, were compared between 2015 (live, synchronous course) and 2016 (hybrid online course). There were no differences in overall course grades or student evaluations of individual relevant course objectives between the two course formats. However, more students rated the course as excellent during the 2015 live, synchronous course. Placement rates were similar between students who took the course in 2015 and 2016. Critical Analysis: Following the transition of a PRF elective to a hybrid online platform, course grades, evaluation of individual relevant course objectives, and PRF placement rates remained similar to previous years. Creative educational venues can help meet the student demand while simultaneously allowing faculty to manage their time. However, instructors should balance this with desire of students to have more face-to-face in class time. 
[less]

This paper examines the effectiveness of adding an online component to the general chemistry laboratory in which students view prelaboratory instructional materials through online videos prior to completing general chemistry laboratory activities. Using a quasi-experimental design, we compared the performance of 1089 general chemistry students who viewed online prelaboratory videos for two laboratory activities and attended face-to-face prelaboratory lectures for two additional laboratory activities. Students were assessed on their understanding of the rationale for specific laboratory procedures, their efficiency at completing each activity in the allotted time, and their help-seeking behavior during laboratory sessions. Students were more efficient and demonstrated a greater understanding of the rationale for procedures for the two laboratory activities that used online prelaboratory videos than those that used prelaboratory lectures. No differences were observed in help-seeking behavior between the two conditions. These results suggest that online prelecture videos have significant potential for improving student learning in the general chemistry laboratory and for reducing demand on institutional resources for associated courses. 
[less]

Objective:
We describe a change in teaching method from extended face-to-face instruction to a blended classroom environment in a research methods course and compare student scores following a change in assessment from mid-term examination to weekly quizzes.
Methods:
The course traditionally had been taught using a weekly 2-hour lecture for each academic term. A change in teaching methods was designed to include 20 minutes of lecture followed by 30 minutes of topic-specific in-class group discussions. The students then continued group work for an additional hour at an alternative location of their choice, such as the library, cafe ´, student study areas, or at home. Student homework/reading assignments were given as topics for weekly group discussions. In addition, the midterm examinations were replaced with weekly quizzes. Using t-test and analysis of variance, scores for four student cohorts in two successive academic terms were compared using identical multiple-choice questions from the midterms and quizzes for two topics. Student verbal feedback was elicited at the end of each term.
Results:
Quiz scores showed significant improvement over midterm scores for the more challenging statistics multiple-choice questions (t[371]=-2.21, p=.03, d=0.23) with no significant improvement in multiple-choice questions about the safety of human subjects (t[374]=-.401, p=.69, d=0.04). Student verbal feedback indicated higher satisfaction with the blended classroom and experiential learning style.
Conclusion:
Assessment using quizzes in an early and often format, instead of a midterm examination, was associated with higher scores on identical questions. Students preferred the blended classroom environment with experiential learning exercises and weekly quizzes. 
[less]

The purpose of this study was to conduct a three-way comparison of face-to-face, online, and blended teaching modalities in an undergraduate Child Development course to determine if there were differences in student academic outcomes and course satisfaction across modalities. Student academic outcomes were measured by three examinations, one research paper assignment, and the overall course total grade. Course satisfaction was measured by administering the Student Opinion Questionnaire (SOQ) across the three teaching modalities and the Constructivist On-Line Learning Environment Survey (COLLES) to online and blended modalities. Results indicated that students performed equally well on all three examinations, research paper, and the overall course total grade across three teaching modalities, allaying traditional reservations about online and blended teaching efficacy. The SOQ and COLLES analysis found students from the three modalities were equally satisfied with their learning experiences. A Two-Factor Model identifying Face-to-Face Interaction and Learn on Demand (Flexibility) as factors determining student academic outcomes was proposed. Implications, limitations, and future research direction were discussed. 
[less]

Combining elements of online and face-to-face education, blended learning is emerging as an important teaching and learning model in higher education. In order to examine the effectiveness of blended learning, as compared to the traditional face-to-face learning mode, this research investigated the learning outcomes of students following English as a Second Language (ESL) course under the two learning modes in a comprehensive university in Beijing, China. A large database was analyzed including student variables (gender, grade and knowledge domain), the different learning modes, and student performance in this study (N=5376). The results show that students following blended learning had better academic achievements in their ESL courses compared to students following the traditional face-to-face learning mode. Student factors (gender, grade, knowledge domain and pre-test) were taken as covariates in order to assess the differences of student performance (dependent variable) in blended learning and traditional F2F learning. 
[less]

This study compared the achievement of male and female students who were enrolled in an online univariate statistics course to students enrolled in a traditional face-to-face univariate statistics course. The subjects, 47 graduate students enrolled in univariate statistics classes at a public, comprehensive university, were randomly assigned to groups that used either online instruction or traditional face-to-face instruction. The effects of the independent variables of online univariate statistics instruction versus traditional face-to-face instruction on the dependent variable of statistics achievement were analyzed with a two-way analysis of variance. There was a significant difference between the achievement of students who used online univariate statistics instruction and those who used traditional face-to-face instruction (p=.001). The traditional face-to-face group scored higher with an effect size of 0.979, indicating that, on the average, those who were enrolled in a traditional face-to-face univariate statistics class outperformed 83.4% of those enrolled in the online statistics course. Moreover, females using online instruction out-performed males using online instruction and males enrolled in a traditional face-to-face course scored higher than females, with an effect size of 0.651, indicating that, on the average, those males outperformed 74.22% of the females enrolled in a traditional face-to-face statistics course. 
[less]

This study compares the academic performance and perceptions of 114 undergraduate students enrolled in an abnormal psychology course. Specifically, this study focuses on whether face-to-face (F2F) or blended modalities are associated with student learning outcomes. In this study, data analysis was based upon the examination of end-of-course grades, final exams, and an end-of-course survey. The data revealed that the same course presented in a F2F and a hybrid modality was associated with nearly identical learning outcomes in terms of student evaluations and final exam scores. However, students did note differences in course delivery in terms of time, assessment, and overall structure. 
[less]

Using a quasi-experimental mixed methods concurrent design, this study measured the science self-efficacy of pre-service elementary teachers before and after a survey of science content course. Further, this course was delivered in two different formats: face-to-face and hybrid (approximately 50% online), and compared pre-and post-science self-efficacy of students in the two different course formats. Our quantitative results showed increases in personal efficacy, but not outcome expectancy for both formats, and no significant differences between the increases for either format. Our qualitative data showed that participants attributed their increased levels of personal efficacy to the hands-on components of the course, as well as perceived teacher attitudes toward science, both of which would be challenging to replicate in a purely online format, as opposed to the hybrid format included in this study. 
[less]

Background
Soft skills are essential for employee success in the global marketplace; however, many developing countries lack content experts to provide the requisite instruction to an emerging workforce. One possible solution is to use an online, open-access curriculum. To date, no studies on soft skills curricula using an online learning platform have been undertaken in Mongolia.
Objective
To evaluate the efficacy of an online versus classroom platform to deliver a novel soft skills course in Mongolia.
Methods
A series of eight lectures along with corresponding surveys and multiple-choice question tests were developed and translated into the Mongolian language. Two different delivery modalities, online and traditional classroom lectures, were then compared for knowledge gain, comfort level, and satisfaction. Knowledge gain and comfort level were assessed pre- and post-course, while satisfaction was assessed only post-course.
Results
Enrollment in the online and classroom courses was 89 students and 291 students, respectively. Sixty-two online students (68% female) and 114 classroom students (77% female) completed the entire course and took the post-test. The online cohort had higher pre-test scores than the classroom cohort (46.4% and 37.3%, respectively, p < 0.01). The online cohort’s overall knowledge gain was not significant (0.4%, p=0.87), but the classroom cohort’s knowledge gain was significant (13.9%, p < 0.01). Both the online and classroom cohorts demonstrated significant improvement in overall comfort level for all soft skills topics (p < 0.01). Both cohorts were also highly satisfied with the course, as assessed on a Likert scale (4.59 for online, 4.40 for classroom).
Conclusion
The study compared two cohorts of Mongolian college students who took either an online or classroom-based soft skills course, and it was found that knowledge gain was significantly higher for the classroom group, while comfort and satisfaction with individual course topics was comparable. 
[less]

The study investigated the impact of blended e-learning on pre-service teachers’ achievement in Mathematics. The sample consists of 280 level I pre-service teachers in school of sciences of Alvan Ikoku Federal College of Education Owerri. The quasi-experimental research design adopting the pre-test, post-test non-equivalent type was used in carrying out the study. A researcher made objective test questions titled “Mathematics Achievement Test (MAT)” was used for data collection. It had reliability coefficient of 0.83 determined using Kuder-Richardson (KR20) formula. The control group was taught mathematics using the traditional method while the experimental group was taught using blended e-learning method (traditional and e-learning). The data generated were analysed using mean and standard deviation to answer the research questions while ANCOVA was used to test hypotheses at 0.05 level of significance. The result of the study revealed that blended e-learning is an effective method of teaching mathematics among pre-service teachers. Based on the result it was recommended that blended e-learning method should be applied in teaching Mathematics education of pre-service teachers. 
[less]