Online Learning Efficacy Research Database

Each year, Oakland library faculty provide information literacy instruction for Rhetoric 160, a first-year writing course, through a combination of WebCT-based online tutorials and in-class teaching. For this study, twelve sections of RHT 160 during the winter 2005 term were selected to compare three instructional methods: online instruction only, live instruction, and the current “hybrid” combination of live instruction and online tutorials. The sections were assigned to one of the instructional methods and, to assess student learning, all students (n=224) completed identical pre- and post-tests. Results of the study, including differences in student performance in relation to pedagogy, are discussed. 
[less]

This study compared student learning outcomes and student perceptions of and satisfaction with the learning process between two sections of the same class--a web-based section and a traditional face-to-face (f2f) section. Using a quasi-experimental design, students were randomly assigned to the two course sections. Group equivalency was established using an instrument designed to determine learning preferences and both versions of the course were delivered by the same instructor. Student learning outcomes compared student test grades and overall grades (included all assignments). To measure student perceptions of student-teacher interactions as well as satisfaction with the course as a whole, identical, end-of-semester evaluations were completed and compared. Finally, to provide an unbiased measure of student-teacher interaction, a modified interaction analysis instrument based upon the work of N. Flanders was used. Findings revealed that student performance on tests was equivalent; however student final grades were lower in the web-based course due to incomplete assignments. Classroom interaction analysis found differences due to delivery methods. Finally, while all student perceptions of the course and the instructor were above average, the f2f group rated both variables statistically significantly higher. Conclusions suggest that the f2f encounter motivates students to a higher degree and also provides students with another layer of information concerning the instructor that is absent in the web-based course. 
[less]

The end of the twentieth century and the beginning of the twenty-first century are marked by technology revolution and strategic changes in organizations. Strategies such as the e-learning, has been used for training human resources. This study aimed to compare the knowledge acquired among groups of nurses who used e-learning and those who undergone a traditional classroom training. The true-experimental design was used followed by a quantitative analysis. This study was performed at the Hospital and Maternity São Luiz. The study population was composed by 60 nurses, randomly assigned to two groups, named A and B. Group A received the traditional classroom training and group B received the computer-assisted training. In the data collection, participants filled in a questionnaire before and after the training to evaluate their knowledge and to characterize the population. Results showed there was an equal acquisition of knowledge in both groups; confirming the efficacy of both methods. 
[less]

The technology known as virtual microscopy is now widely available to medical students. A number of medical school histology and pathology course directors, including those at the Eastern Virginia Medical School, are exploring the question of how best to make use of this new tool. The current study compared the efficacy of teaching and testing one unit of histology, bone and cartilage, using two technologies, namely, virtual microscopy and traditional microscopy. Additionally, the study examined whether low, moderate, high moderate, or high achieving students perform more effectively in any of the learning/testing formats. In a completely randomized block design, 96 first semester, first-year medical students were grouped by previous exam quartiles then subsequently randomly assigned to one of four groups. Using identical laboratory exercises with highly comparable slides for each experimental group, half of the subjects learned the exercise with traditional microscopy and half learned with virtual microscopy. Subjects were further randomly subdivided into virtual or actual testing groups. The authors found no significant differences in test scores when they examined effects by learning group or by testing group, nor were there significant interaction effects. Student performance evaluated by previous exam quartile was significant (P < 0.001). That is, students who had scored in a particular quartile on a previous test tended to score in the same quartile on the bone and cartilage test regardless of learning or testing method. In a short opinion survey, students were polled to evaluate their experience. Student preferences for both learning and testing method varied widely. 
[less]

Case-based e-learning may allow effective teaching of veterinary radiology in the field of equine orthopedics. The objective of this study was to investigate the effectiveness of a new case-based e-learning tool, compared with a standard structured tutorial, in altering students’ knowledge and skills about interpretation of radiographs of the digit in the horse. It was also designed to assess students’ attitudes toward the two educational interventions. A randomized, single-blinded, controlled trial of 96 fourth-year undergraduate veterinary students, involving an educational intervention of either structured tutorial or case-based e-learning, was performed. A multiple-choice examination based on six learning outcomes was carried out in each group after the session, followed by an evaluation of students’ attitudes toward their session on a seven-point scale. Text blanks were available to students to allow them to comment on the educational interventions and on their learning outcomes. Students also rated, on a Likert scale from 1 to 7, their performance for each specific learning outcome and their general ability to use a systematic approach in interpreting radiographs. Data were analyzed using the Mann-Whitney test, the t-test, and the equivalence test. There was no significant difference in student achievement on course tests. The results of the survey suggest positive student attitudes toward the e-learning tool and illustrate the difference between objective ratings and subjective assessments by students in testing a new educational intervention. 
[less]

The purpose of this paper is to measure and compare the effectiveness of a Web-based course delivery system to a traditional course delivery system. The results indicate that a web-based course is effective and equivalent to a traditional classroom environment. As with the implementation of all new technologies, there are some pros and cons that should be considered. The significant pro is the element of convenience which eliminates the constrictive boundaries of space and time. The most notable con involves the impersonal nature of the online environment. Overall, we found the web-based course delivery system to be very successful in terms of learning outcomes and student satisfaction. 
[less]

The purpose of this study was to investigate value of combining Real Experimentation (RE) with Virtual Experimentation (VE) with respect to changes in students' conceptual understanding of electric circuits. To achieve this, a pre–post comparison study design was used that involved 88 undergraduate students. The participants were randomly assigned to an experimental (45 students) and a control group (43 students). Each group attended a one semester course in physics for preservice elementary school teachers. Both groups used the same inquiry-based curriculum materials. Participants in the control group used RE to conduct the study's experiments, whereas, participants in the experimental group used RE in the first part of the curriculum and VE in another part. Conceptual tests were administered to assess students' understanding of electric circuits before, during and after the teaching intervention. Results indicated that the combination of RE and VE enhanced students' conceptual understanding more than the use of RE alone. A further analysis showed that differences between groups on that part of the curriculum in which the experimental group used VE and the control group RE, in favour of VE. 
[less]

Background
Previous research has shown that internet education can lead to short-term improvements in clinicians' knowledge, confidence and communication practices. We wished to better understand the duration of these improvements and whether different curriculum delivery strategies differed in affecting these improvements.

Methods
As previously described, we conducted a randomized control trial comparing four different strategies for delivering an e-curriculum about herbs and other dietary supplements (HDS) to clinicians. The four strategies were delivering the curriculum by: a) email over 10 weeks; b) email within one week; c) web-site over 10 weeks; d) web-site within one week. Participants were surveyed at baseline, immediately after the course and 6–10 months after completing the course (long-term). Long-term outcomes focused on clinicians' knowledge, confidence and communication practices.

Results
Of the 780 clinicians who completed the course, 385 (49%) completed the long-term survey. Completers and non-completers of the long-term survey had similar demographics and professional characteristics at baseline. There were statistically significant improvements from baseline to long-term follow-up in knowledge, confidence and communication practices; these improvements did not differ by curriculum delivery strategy. Knowledge scores improved from 67.7 ± 10.3 at baseline to 78.8 ± 12.3 at long-term follow-up (P < 0.001). Confidence scores improved from 53.7 ± 17.8 at baseline to 66.9 ± 12.0 at long term follow-up (P < 0.001); communication scores improved from 2.6 ± 1.9 at baseline to 3.6 ± 2.1 (P < 0.001) at long-term follow-up.

Conclusion
This e- curriculum led to significant and sustained improvements in clinicians' expertise about HDS regardless of the delivery strategy. Future studies should compare the impact of required vs. elective courses and self-reported vs. objective measures of behavior change. 
[less]

This multi-semester (eight semesters), multi-course study compared student performance in undergraduate online and traditional sections of “Organization and Management” with sample sizes of 380 and 213, respectively. Concurrent online and traditional sections of “Strategic Management” courses with sample sizes of 298 and 456, respectively, were also comparatively analyzed. Similar to previous research (Borthick & Jones, 2000; Gagne & Shepherd, 2001; Piccoli, Ahman, Ives, 2001), this study found no statistically significant difference in student performance between online and traditional classes in both management courses after examining eight semesters of data. However, this study found gender differences with both management courses. 
[less]

This naturally occurring quasi-experiment examined how learning goal orientation (LGO), delivery mode (classroom vs. blended learning), and the perception of barriers and enablers related to motivation to learn and course outcomes. Study participants were 600 students enrolled in either classroom or blended learning courses. As hypothesized, learners in the blended learning condition, high in LGO, and who perceived environmental features as enablers rather than barriers had significantly higher motivation to learn. Motivation to learn, in turn, was significantly related to course outcomes (satisfaction, metacognition, and grades). The mediation hypotheses received partial support. Finally, exploratory analyses revealed 3 significant interactions between delivery mode, LGO, and perceived barriers and enablers on motivation to learn and course satisfaction. 
[less]