Category Archives: Resources, Tools & Trends

Take Your Blended Course Design to the Next Level

Posted on by

As described in an earlier post, Use a Mix Map for Blended Learning, the blended learning mix map is a widely used tool to visualize and design hybrid (or “blended”) courses that integrate scheduled face-to-face meetings with online elements. The two overlapping circles in this planning template provide space to list online learning activities, face-to-face learning activities and possibly activities that occur in both learning environments.

Blended Learning Mix Map

Where Does Learning Actually Occur?

Oregon State University faculty have found utility in drafting mix maps while in the early phases of hybrid course development. Many of those faculty suggested that the traditional two-circle mix map needed one improvement, namely a third circle! In response, the Center for Teaching and Learning and Ecampus created the Three-Disc Hybrid Design Mix Map.

Three-Disc Hybrid Design Mix Map

Does your blended course have learning activities that extend beyond the online and classroom environments (for example, service-learning, field or clinical experiences)? If so, this three-disc mix map is an ideal course planning tool. The “Other” circle is the place to list learning activities that principally take place somewhere other than the classroom and the online course site.

Sketch a Three-Disc Mix Map in Three Steps

You could create one mix map for your entire course, but many instructors prefer to focus on a single representative week of the course. There are three steps to sketching out your blended course vision on the three-disc mix map:

1 – List each learning activity in the appropriate circle. Consider these activities from the student perspective. For instance, collaborating on a group poster project, taking a quiz or making a presentation. Be sure to include “other” learning that occurs beyond the online and in-class environments. Consider the balance between learning activities in the three circles.

As to which learning activities fit where, that’s a topic to carefully consider and to converse about with your teaching colleagues as well as an instructional designer. For instance, think about the positioning of weekly discussions in your course. In terms of student learning outcomes, do discussions work best for you and your students in the classroom, online or possibly in both places? Can discussions be structured to bridge the gap between learning environments? Remember to consider how the timing of discussions will be woven into the broader, ongoing flow of blended learning in your course. And remember that classroom meeting time is finite and measured to the nearest minute in a hybrid course, so be judicious in using that time strategically!

2 – Use arrows to draw functional connections between the learning activities. For example, a weekly quiz is based on narrated online lectures, or an in-class discussion applies information from online readings. Aim to link every activity to at least one other activity. Be especially attentive to linkages between the online and face-to-face activities.

3 – List the average amount of time per week that you expect students will spend on each learning activity. For instance, two hours of reading or 90 minutes of problem solving. Check to see if the weekly total make sense in light of the Oregon State University credit hour policy, which states, “One credit is generally given for three hours per week of work in and out of class.”

Speaking of time expectations, 15 minutes is a reasonable amount of time for you to create a first draft of a mix map.

Mixing and Remixing

I recommend that you periodically revisit—and possibly redraw—your mix map, perhaps a week later, then a month later, to see how your blended course vision has evolved. A mix map is a malleable vision of a blended course at a given moment in the course design and development process; it’s not an end point. As the design and development process moves forward, remixing the map comes naturally.

In working with mix maps and more broadly with blended course design and teaching, focus on deeply interweaving the various course elements. Hybrid courses can truly be “the best of both worlds” of online and on-the-ground teaching and learning, by building on the strengths of each of these educational modalities, but only with intentional design that explicitly, and seamlessly, meshes the online, in-class and “other” elements of the course!

Resources

The OSU Hybrid Learning website provides downloadable mix map templates and sample mix maps. For more about blended learning, refer to these earlier blog posts: Blended Learning: What Do the Faculty Say? – Part 1 and Part 2, and Susan Fein’s excellent Blended Learning: What Does the Research Show?

If you’d like to take a deeper dive into blended learning, see the Blended Learning Toolkit and Kathryn Linder’s superb guide, The Blended Course Design Workbook.

Digital Storytelling for Higher Education

Video

About halfway through earning a master’s in education, I took a summer session class on digital storytelling. It ran over the course of three half-day sessions during which we were required to complete two digital stories. I had no great academic ambitions in my approach to these assignments. I was trying to satisfy a degree requirement in a way that worked with my schedule as a single mother of two teenagers working full time while earning a graduate degree.

My first story was a self-introduction. I loved this assignment. Even though I had one evening to complete it, I spent hours tweaking it. I enjoyed learning the tools. I enjoyed sharing my story with my classmates. Even after it was graded, I kept finding ways to improve it.

After completing the course, I began to study the use of digital stories in education. My personal experience had shown me that in completing my assignment I had to become comfortable with technology as well as practiced my writing, speaking and presentation skills. I also felt a stronger connection to my classmates after sharing my video and watching their videos.

Literature

The research on digital storytelling echoes my own experience. Dr. Bernard Robin, an Associate Professor of Learning, Design, & Technology at the University of Houston, discussed the pedagogical benefits of digital storytelling assignments in a 2016 article,  The Power of Digital Storytelling to Support Teaching and Learning. His research found that both student engagement and creativity increased in higher education courses when students were given the opportunity to use multimedia tools to communicate their ideas. Students “develop enhanced communication skills by learning to organize their ideas, ask questions, express opinions, and construct narratives” (Robin, 2016). Bernard’s experience also finds that by sharing their work with peers, students learn to give and accept critique, fostering social learning and emotional intelligence.

Digital Storytelling as Educators

Digital Storytelling in online education shouldn’t be thought of as only a means of creating an engaging student assignment. Educators who are adept at telling stories have a tremendous advantage in capturing their student’s attention. In the following short video, Sir Ian McKellen shares why stories have so much power. Illustrated in the form of a story, he shares that stories are powerful for four reasons. They are a vessel for information, create an emotional connection, display cultural identity, and gives us happiness.

The Power of Storytelling, with Sir Ian McKellen

McKellen is a compelling narrator with a great voice. This story is beautifully illustrated. It reminds me of how I want my learners to feel when they are consuming the content I create. Even if for a moment, so engrossed, that they forget that they are learning. Learning becomes effortless. As he points out, a good storyteller can make the listener feel as if they are also living the story.

Digital Storytelling Assignments

There are lots of ways to integrate digital stories across a broad set of academic subjects. Creating personal narratives, historical documentaries, informational and instructional videos or a combination of these styles all have educational benefits. One of the simplest ways to introduce this form of assessment to your course is to start with a single image digital story assignment.

Here’s an example I created using a trial version of one of many digital story making tools available online:

Single Image Digital Story Example

Digital Story Making Process

The process of creating a digital story lends itself well for staged student projects. Here’s an example of some story making stages:

  1. Select a topic
  2. Conduct research
  3. Find resources and content
  4. Create a storyboard
  5. Script the video
  6. Narrate the video
  7. Edit the final project

I created an animated digital story to illustrate the process of creating a digital story using another freely available tool online.

Digital Storytelling Process Movie link

Recommended Resources & Tools

You will find hundreds of tools available for recording media with a simple search. Any recommended tool should be considered for privacy policies, accessibility and cost to students.

Adobe Express (previously Adobe Spark)

Adobe offers a free online video editor which provides easy ways to add text, embed videos, add background music and narration. The resulting videos can be easily shared online via a link or by downloading and reposting somewhere else. While the tool doesn’t offer tremendous flexibility in design, the user interface is very friendly.

Canvas

Canvas has built-in tools to allow students to record and share media within a Canvas course. Instructions are documented in the OSU Ecampus student-facing quick reference guide.

Audacity

Audacity is a free, open-source cross-platform software for recording and editing audio. It has a steeper learning curve than some of the other tools used for multimedia content creation. It will allow you to export your audio file in a format that you can easily add to a digital story.

Padlet

Padlet allows you to create collaborative web pages. It supports lots of content types. It is a great place to have students submit their video stories. You have a lot of control during setup. You can keep a board private, you can enable comments, and you can choose to moderate content prior to posting. Padlet allows for embedding in other sites – and the free version at the time of writing allows users to create three padlets the site will retain.

Storyboarding Tools

A note first about storyboarding. Storyboarding is an essential step in creating a digital story. It is a visual blueprint of how a video will look and feel. It is time to think about mood, flow and gather feedback.
Students and teachers alike benefit from visualizing how they want a final project to look. It doesn’t have to be fancy. It is much easier to think about how you want a shot to look at this stage than while you are shooting and producing your video. A storyboard is also a good step in a staged, longer-term project in a course to gauge if students are on the right track.

Storyboard That

This is a storyboard creation tool. The free account allows for three and six frame stories. In each frame, you can choose from a wide selection of scenes, characters, and props. Each element allows you to customize color, position, and size. Here’s a sample I created:

The Boords

This site has several free to use templates in multiple formats to support this process. Here is one that I have used before:

A4-landscape-6-storyboard-template

Looking for Inspiration?

Start with Matthew Dicks. Dicks is the author of Storyworthy: Engage, Teach, Persuade and Change Your Life through the Power of Storytelling. He is a teacher. He is a five-time winner of the Moth GrandSlam championship.
His book is wonderful, but to just get a taste, start with the podcast he cohosts with his wife. Each week they include a well-vetted and rehearsed story told during a competition. They then highlight the strengths and areas for improvement. You will walk away with ideas and the motivation to become a better storyteller. Here’s the first episode, and one of my favorites.

Conclusion

When pressed for time to develop course content, we tend to over-rely on text-based assignments such as essays and written discussion posts. Students, when working on Digital Storytelling assignments, get the opportunity to experiment, think creatively and practice communication and presentation skills.

For educators, moving away from presenting learning materials in narrated bulleted slides is likely to make classes more engaging and exciting for their students leading to better learning outcomes. Teachers work every day to connect with students and capture their attention. A good story can inspire your students and help them engage with the content.

I was uncomfortable when I received my first digital storytelling assignment. I didn’t really know how to use the tools, wasn’t confident I knew how or what to capture. I was sure it would feel awkward to narrate a video. But These assignments turned out to be engaging, meaningful, and the process is pretty straight forward. Introduce digital storytelling into your courses, even by starting small, and you are sure to feel the same way.

Adaptive Learning: What Does the Research Show?

Posted on by

This is the final segment in a three-part series summarizing conclusions and insights from research of active, blended, and adaptive learning strategies. Part one covered active learning, part two focused on blended learning, and today’s article discusses research assessing the value of adaptive learning.

Diverse Definitions

Five young people studying with laptop and tablet computers on white desk.

The University of Maryland writes that “Adaptive learning is an educational method which uses computers as interactive teaching devices” that allocate resources according to the needs of each learner. Educause Learning Initiative describes adaptive learning as systems that “use a data-driven…approach to instruction.” Wikipedia’s definition focuses on technology as the distinguishing characteristic.  Smart Sparrow, an adaptive learning platform vendor, emphasizes the learning experience, noting that adaptive learning “address the unique needs of an individual through just-in-time feedback, pathways, and resources (rather than providing a one-size-fits-all learning experience).” And though each of these is accurate and helpful, they fail to inspire a vision for the true value and benefits of adaptive learning.

What’s special about adaptive learning? Why should you consider using it? One answer is succinctly summarized by Dale Johnson, manager of the Adaptive General Education Program for EdPlus at Arizona State University, who said, “The traditional approach of presenting the same lesson to all students at the same time is being replaced by the adaptive model of delivering the right lesson to the right student at the right time.” Johnson cuts to the heart of the matter; focusing on the value and benefits of adaptive learning rather than describing the technologies that make it work. For today’s blog post, that’s the more relevant framework for our discussion.

Game Changer

Although adaptive learning can be successfully implemented in any discipline, this article cites research from STEM (science, technology, engineering, and mathematics) disciplines. The classic, one-size-fits-all lecture model is commonly used in STEM courses. Historically, those classes tend to have the highest rates of attrition and failure. As a result, educators are looking for ways to increase student success and reduce failure and withdraw rates. Many have turned to adaptive learning as that solution.

Adaptive learning uses specialized computer programs to create a customized, student-centered learning path (Kerr, 2016). These systems establish a baseline of knowledge that estimates the student’s degree of mastery for a topic. As the student progresses and gives new information to the adaptive learning platform, it re-evaluates the student’s proficiency and knowledge (Scalise, Bernbaum, & Timms, 2007) and comes to “know” the student, customizing and adjusting the feedback, practice questions, and support materials to match that student’s skills. Although all students ultimately arrive at the same learning destination, the path traveled by an individual might differ from that of classmates, depending on prior knowledge, learning style, and other factors (Canfield, 2001).

Course Design and Instructor Approach

Effective use of adaptive learning requires a well-designed, pedagogically-sound course structure. Adaptive learning may fail if technology is simply added as an extra element or after-thought. To fulfill the promise of adaptive learning, it must be aligned with the learning outcomes, topics, activities, and organization of the course (Scalise, Bernbaum, & Timms, 2007).

When adaptive learning is used as part of a well-structured course design (or redesign), it harmonizes with the benefits of active and blended learning, to deliver powerful, personalized guidance and support.

Instructors will want to re-evaluate course design and activities from the ground up to ensure successful adoption of adaptive learning. This includes discipline-specific choices as well as non-academic influences such as motivation, time management, psychological and social aspects, emotions, learning abilities, and fostering an inclusive environment. These added elements play a key role in the successful implementation of adaptive learning (Martinez, 2001).

Does Adaptive Learning Work?

Yes! There is substantial evidence to conclude that adaptive learning improves student success.

A study in an introductory chemistry class compared post-test results of two student groups. The group using adaptive learning out-performed the control group by an average of nearly 21% (Scalise, Bernbaum, and Timms, 2007). Research from a basic algebra class noted higher final grade averages with adaptive technologies (Stillson & Alsup, 2003). And another study from college algebra showed that students using adaptive learning scored higher than the control group on pre- and post-test assessments (Hagerty and Smith, 2005).

Here at OSU, several undergraduate courses, including college algebra and introduction to statistics, have reported improved results after redesigning courses to include adaptive learning software.

Benefits to Students and Instructors

Students

Research indicates that under-achieving students gain the most from adaptive learning. But this customized approach improves study habits and attitudes for all learners (Walkington, 2013). Students report feeling like they could succeed in the topic, many for the first time, because of the added support provided through adaptive learning (Canfield, 2001). A research study reported that 61% of students said they learned more mathematics than in previous traditional math classes (Stillson and Alsup, 2003).

Students report benefits in exit surveys from courses using adaptive learning:

  • Able to work at their own pace, using adaptive content as an extension of course materials, concepts, and activities (Stillson & Alsup, 2003).
  • Learned more with adaptive learning (Canfield, 2001).
  • Liked the support of step-by-step explanations, immediate feedback, and customized practice problems (Canfield, 2001; Stillson & Alsup, 2003).
  • Motivated to strive for completion when viewing graphical charts showing progress (Canfield, 2001).
  • Developed better study skills and were willing to devote time to learn, recognizing that these investments brought the rewards of a deeper understanding of course content and, ultimately, a passing grade (Stillson & Alsup, 2003).
  • Less stress and worry because of the self-paced, just-in-time nature of adaptive learning, where new topics or practice problems are only presented when the student is ready for them (Canfield, 2001).

Most students said they would take another class using adaptive learning and would recommend the adaptive format to others (Canfield, 2001).

Instructors

Since adaptive learning uses sophisticated technology, most platforms generate reports and data that inform instructors about individual student performance, including details about the skills achieved, remaining progress to achieve mastery, problem areas, and other critical information. At a glance, instructors can use these vital metrics to monitor student performance and, as needed, intervene and provide additional guidance (Scalise, Bernbaum, & Timms, 2007).

If Adaptive Learning is so Great, Why Isn’t Everyone Using It?

As with any technology, adaptive learning is not a panacea. It has drawbacks and may not be well-suited for every student or every situation.

Those lacking adequate internet speed or easy access may be frustrated. Learners who do not own computers may have difficulty finding systems in campus labs or libraries. Students with minimal prior knowledge may spend more time reaching baseline skill levels than classmates. Those who are employed, have extensive family obligations, or juggle other responsibilities may have challenges effectively managing their time to complete the adaptive learning segments (Canfield, 2001; Stillson & Alsup, 2003).

Administrators and teachers uncertain about how to incorporate adaptive learning may have challenges. When not well-integrated into course design, adaptive learning can create confusion. Course instruction and activities must align with the learning materials delivered by the adaptive system. Since adaptive learning is personalized, students may be working in different sections or topics from peers. When lectures or topics don’t match the adaptive content, students perceive this as two classes, with double the work. When course structure lacks cohesion, students might ignore the adaptive support or conclude that it hinders, rather than helps, their ability to study (Stillson & Alsup, 2003).

Finally, adaptive learning is most often used in classes already known to be difficult. The introduction of a new technology could add a layer of confusion and frustration, especially if its been inserted as an add-on component. Courses that haphazardly integrate adaptive learning might even experience an increase in drops or failures due to poor design. Students less confident using technology might be worried about learning this way (Stillson & Alsup, 2003).

In Summary

Adaptive learning has the potential to increase learning, especially in STEM disciplines. The ability to customize material and content to fit the needs of individual learners is a powerful shift from the more common one-size-fits-all lectures. Although more research is needed to realize the full scope of benefits of adaptive learning, results indicate that adaptive learning may better support universal and inclusive learning goals (Scalise, Bernbaum, & Timms, 2007). Adaptive learning gives instructors valuable information about student performance, and these technologies help students more easily grasp complex concepts and content. The ability to closely match topics to a student’s readiness and knowledge may increase their willingness and motivation to learn (Canfield, 2001).

What’s Next?

If you are interested in learning more about adaptive learning and whether it might benefit your teaching and success of your students, check out these OSU Ecampus resources:

Susan Fein, Oregon State University Ecampus Instructional Designer

susan.fein@oregonstate.edu | 541-747-3364

References

  • Canfield, W. (2001). ALEKS: A Web-based intelligent tutoring system. Mathematics and Computer Education, 35(2), 152-158.
  • Hagerty, G., & Smith , S. (2005). Using the web-based interactive software ALEKS to enhance college algebra. Mathematics and Computer Education, 39(3), 183.
  • Kerr, P. (2016, January). Adaptive learning. ELT Journal, 70, 88-93.
  • Martinez, M. (2001). Key design considerations for personalized learning on the web. Educational Technology & Society, 4(1), 21.
  • Scalise, K., Bernbaum, D. J., & Timms, M. (2007). Adaptive technology for e-learning: Principles and case studies of an emerging field. Journal of the American Society for Informaton Science and Technology, 58(14), 2295–2309.
  • Stillson, H., & Alsup, J. (2003). Smart ALEKS… or not? Teaching basic algebra using an online interactive learning system. Mathematics and Computer Education, 37(3).
  • Walkington, C. A. (2013). Using adaptive learning technologies to personalize instruction to student interests: The impact of relevant contexts on performance and learning outcomes. Journal of Educational Psychology, 105(4), 932–945.

Games as a Model for Motivation and Engagement, Part 2

Posted on by

Narrative and World-Building

For this post, I will focus on two simple strategies you can use to improve motivation and engagement in your online course, narrative and world building. These terms are used frequently in games, as well as in literature, film and other domains. They are a powerful tool, easily applied to your existing course material or as you develop new content.puzzle world

If you want some background about where my thinking is coming from, check out my last blog post, Games as a Model for Motivation and Engagement, Part 1, where I take a deeper dive into gaming and Self-Determination Theory. I would also recommend a post by Dr. Meghan Naxer, Self-Determination Theory and Online Education: A Primer.

There are two kinds of world building I’d like to talk about; instructor-created narrative and student-created narrative. To set the tone for our thinking about this, I’ll start with a quote from Designing for Motivation.

“… if you increase autonomy then engagement will improve, if you increase competence then motivation will increase, and if you increase relatedness then wellbeing will be enhanced–these needs become the controllers we tweak and adjust to iterate on and improve experience.”
(Peters, D., Calvo, R. A., & Ryan, R. M. (2018) Designing for Motivation, Engagement and Wellbeing in Digital Experience. Frontiers in Psychology, 28 May 2018. DOI: 10.3389/fpsyg.2018.00797)

So how can we use world building to ‘tweak’ these three controllers?

Instructor-Created Narrative

role-playing game diceInstructor-created narrative refers to the world or environment created by the course builder and determined by the story they are telling about that world. This world building can be for a particular course activity, but also keep in mind that your entire online course is a learning environment and you, as the course builder, have significant influence over how that world is curated. A colleague recently described how an instructor begins their course with the phrase, “Welcome scholars”. This sets a tone that is a competence-supportive environment with just two words. Tone is a commonly used tool for world building across many domains.

As a simple entry point for world building, I’ll start with a classic type of game, role-playing.

Brainstorm Exercise

Consider setting up a role-playing scenario for one of your existing activities or assignments. What is the outcome you expect students to achieve from this activity? Imagine a situation (or world) where that outcome exists or can be applied. What does that situation look like? Now, imagine you are a student in that situation, what does this world look like? (See what I did there? Role playing!) How will your student interact with that world to achieve your outcome? Take a minute or two to note your answers to these questions. This is a good way to begin sketching out your narrative. Once your sketch is complete, you can begin moving the parameters and rubrics of your existing activity into this world.

The world you create for your scenario can be the ‘real world’ in a particular time period, a hypothetical political situation, a business/client relationship regarding a product, or a hypothetical world to resolve a physics problem. Here are some ways you can frame your thinking as you practice the above exercise:

  • Take the tools you have provided in the course content (competence) and use them to analyze the following situation (world building). “How would you apply what you learned this week to the following situation?”
  • Even better, “How will the situation change as a result of your decisions?”

A small change in wording can provide big changes in thinking. In the second bullet point, we have moved from applying the week’s content to a given situation to a personalized critical analysis.

Student-Created Narrative

The other side of the coin is allowing students to build on your narrative, or create their own. This is where you significantly impact autonomy. This is your world, you create the rules. You set the parameters that will focus student thinking toward the outcomes you hope for them to reach. The rules you set will determine the level of autonomy the student experiences.

Brainstorm Exercise

For this exercise, you can continue with the role-playing scenario you built in the previous Brainstorm Exercise or choose another existing activity from a course. Let’s brainstorm some ways you can add autonomy to this activity.

A simple addition to the role-playing scenario we built previously would be to allow students to choose the role they will play. You have built a narrative, now let the student choose the character they will play to build on that narrative. If you need to keep things more focused, it is totally acceptable to restrict the roles to a list of options. Even with restrictions, is it possible for students to choose the gender, race or economic background of their character? What other characteristics can you think of that will help a student take ownership of the role?

For other kinds of activities, consider giving students the creative freedom to choose and build their own narrative. The instructor still defines the rules of the world and sets the outcome and rubrics for the activity. Can you open up the choices a student has to meet these outcomes? Allow students the autonomy to take ownership of how they get to your outcome, using your rubric as a guide.

For example, select a concept that was covered in the course. In your activity, allow students to choose where and how that concept can be applied. Let them build the narrative around the concept. Conversely, select a setting in the world, much like you would for the role-playing scenario. Allow students to choose the course concepts they want to apply in that setting and build a narrative around that. This strategy lends itself well to case studies. Rather than taking on a specific role, students become story creators, while still working with instructional concepts and within the rules defined by the instructor.

Group World Building

As I mentioned in my previous post, group work and community building (as modeled by gaming communities) are great ways to increase relatedness in a course. Community members are able to share their competence and, in turn, feel valued by that community. This is another great support of motivation.

All of the strategies discussed above can be applied to group work. You can set up the same role-playing scenarios, but this time multiple students will take on different roles and interact in those roles within their group community. Relatedness is impacted as decisions and actions taken by one student will affect the world that is being collaboratively built. Here are two examples from a media course I recently helped develop. They both reflect the range of complexity group world building can undertake.

Pitch Game (Group Discussion)

For your Initial Post in this discussion, pitch a new television show. Follow the parameters presented in class; including X+Y claims, audience description, sketch of the show’s audience and the ideal network for the show. For your Peer Response, you will take on the role of media buyer. Choose which network or streaming service you work for. Review all available show pitches. Decide which show you will purchase. Reply to the show you wish to purchase; identify the network you represent and write your reasoning why you want to make the purchase. Use course material to support your decision.

Trial Simulation (Group Project)

To better understand the ways in which civil law shapes the media ecosystem, we will enact a short trial simulation. The court of the Honorable Judge is an appeals court: this means that the FACTS of the case were decided by the TRIAL court. The question that will be litigated in class regards the law and the interpretation of those facts.

One student will take on the role of Plaintiff, another will be Defense and a third member of the group will be the Judge. Over the next two weeks, you will follow the posted schedule to present your arguments and answer questions from the Judge. Before proceeding, review the Debate Rules and Trial Facts documents. You will be expected to cite actual Supreme Courts cases to support your claims.

Hopefully, this blog has provided some simple entry points for using world building to increase autonomy, build competence, and improve relatedness in a course to improve motivation and engagement. I would love to hear what you come up with in the Brainstorm Exercises.

Dice Image: “DSCF5108” by joelogon is licensed under CC BY-SA 2.0
World Building Image: puzzle-ball-1728990_1920 from Pixabay

Blended Learning: What Do the Faculty Say? – Part 2

Posted on by

Oregon State University has more than 570 hybrid-designated courses. These hybrid (“blended”) courses integrate regularly scheduled on-site classroom meetings with significant online, out-of-classroom components that replace regularly scheduled class meeting time. In this blended learning format, face-to­ face meeting time is generally reduced by 30 to 80% compared to a traditional on-campus course.

Hybrid courses range from large-enrollment general education courses to seminar-style graduate courses. Since 2012 when OSU formally established the hybrid course schedule type, the total enrollment in hybrid courses has exceeded 42,000 students.

OSU Portland Center

Ecampus has recently expanded hybrid course offerings through the new OSU Portland Center, including undergraduate hybrid programs in business, psychology, cybersecurity and human development and family sciences. Portland-based graduate programs include the Master of Arts in Teaching, MBA and graduate certificate in business analytics.

As Susan Fein noted in the previous post, Blended Learning: What Dose the Research Show?, the literature provides a wealth of evidence for the efficacy of hybrid education. But what can instructors who design and teach hybrid courses tell us? Here are some valuable highlights from posts of the most recent Hybrid Faculty Learning Community cohort in the OSU Hybrid Faculty Blog. The members of this cohort were each engaged in the redesign of a more traditional on-campus course into a hybrid course that will be offered during the 2019-20 academic year.

Collaboration: Jillian St. Jacques – Applied Journalism: “Our students are thirsty to work with each other because it is stimulating, plain and simple. . . . They find their own interpersonal relationships incredibly exciting, as they agree, disagree, admire and/or square off with each other in the Arena of the Intellect.”

Creativity: Alina Padilla-Miller – New Media Communications: “Through activities, experiments and use of everyday media, there are a lot of opportunities to fold in the creation process. The process of creating is not only necessary to include in active learning but it’s also incredibly engaging and dare I say it, fun! Whether the class is face-to-face, online or hybrid, incorporating active learning will enrich the course and ultimately the student’s experience with the curriculum. Let the creating begin!”

Excitement: Susan Rodgers – Writing: “This is what’s exciting to me about the hybrid format: instead of simply assigning readings and hoping the students will come in prepared, they’ll do quizzes, discussions, and collaborations before they come to class . . . we can take the conversation very quickly to a deeper and more meaningful level during our f2f time.”

Students working together in class

Flexibility: Dennis Adams – Business: “Students can more easily sort out the variance in their individual ability in this format. Students who require more time and exposure can reread/re-watch the material on their own time.”

Ownership: Michelle Maller – Forestry – “One of the most effective ways for a student to really master a concept is to present/teach that topic to their peers. . . . Creating ways for the students to interact with the content in a way that builds ownership of it can affect the overall learning. A good example of this is to use a discussion board to have each student “teach” their peers about a specific topic covered in that module.”

Roles: Irene Rolston – Anthropology: “Rather than students relying on their ‘sage’ to inform them, we have the ability to transform the classroom from unidirectional communication into multilateral communications between instructor to student and student to student. Approaching this from a hybrid design perspective, using the initial collection and deciphering of data online prior to use in the classroom as, for example, small group discussions, moves the omnipotent sage into the role of facilitator, one who directs the flow of the classroom rather than dominating the stage.”

Skills: Inara Scott – Business : “In a blended classroom, we have a unique opportunity to rethink the structure and content of our courses. . . . Rather than delivering content, we should be thinking about what unique skills we are building in students, and how we can engage them in the process of finding, interpreting, and creating their own content.”

To summarize, intentional hybrid course design and delivery afford opportunities for faculty to create engaging learning experiences that effectively interweave the classroom and online learning environments. This may involve rethinking the roles of the instructors and students, redesigning learning activities and even reconsidering learning outcomes to optimize the teaching-and-learning experience!

What are your perspectives on blended learning? How does this teaching modality compare to fully online or traditional classroom approaches?

Thank you!

Blended Learning: What Does the Research Show?

Posted on by

This post is the second in a three-part series that summarizes conclusions and insights from research of active, blended, and adaptive learning practices. Part one covered active learning, and today’s article focuses on the value of blended learning.

First Things First

What, exactly, is “blended” learning? Dictionary.com defines it as a “style of education in which students learn via electronic and online media as well as traditional face-to-face learning.” This is a fairly simplistic view, so Clifford Maxwell (2016), on the Blended Learning Universe website, offers a more detailed definition that clarifies three distinct parts:

  1. Any formal education program in which at least part of the learning is delivered online, wherein the student controls some element of time, place, path or pace.
  2. Some portion of the student’s learning occurs in a supervised physical location away from home, such as in a traditional on-campus classroom.
  3. The learning design is structured to ensure that both the online and in-person modalities are connected to provide a cohesive and integrated learning experience.

It’s important to note that a face-to-face class that simply uses an online component as a repository for course materials is not true blended learning. The first element in Maxwell’s definition, where the student independently controls some aspect of learning in the online environment, is key to distinguishing blended learning from the mere addition of technology.

You may also be familiar with other popular terms for blended learning, including hybrid or flipped classroom. Again, the common denominator is that the course design intentionally, and seamlessly, integrates both modalities to achieve the learning outcomes.

Let’s examine what the research says about the benefits of combining asynchronous, student-controlled learning with instructor-driven, face-to-face teaching.

Does Blended Learning Offer Benefits?

Blended Learning Icon

The short answer is yes.

The online component of blended learning can help “level the playing field.” In many face-to-face classes, students may be too shy or reluctant to speak up, ask questions, or offer an alternate idea. A blended environment combines the benefit of giving students time to compose thoughtful comments for an online discussion without the pressure and think-on-your-feet demand of live discourse, while maintaining direct peer engagement and social connections during in-classroom sessions (Hoxie, Stillman, & Chesal, 2014). Blended learning, through its asynchronous component, allows students to engage with materials at their own pace and reflect on their learning when applying new concepts and principles (Margulieux, McCracken, & Catrambone, 2015).

Since well-designed online learning produces equivalent outcomes to in-person classes, lecture and other passive information can be shifted to the online format, freeing up face-to-face class time for active learning, such as peer discussions, team projects, problem-based learning, supporting hands-on labs or walking through simulations (Bowen, Chingos, Lack, & Nygren, 2014). One research study found that combining online activities with in-person sessions also increased students’ motivation to succeed (Sithole, Chiyaka, & McCarthy, 2017).

What Makes Blended Learning So Effective?

Five young people studying with laptop and tablet computers on white desk. Beautiful girls and guys working together wearing casual clothes. Multi-ethnic group smiling.

Nearly all the research reviewed concluded that blended learning affords measurable advantages over exclusively face-to-face or fully online learning (U.S. Department of Education, Office of Planning, Evaluation, and Policy Development, 2009). The combination of technology with well-designed in-person interaction provides fertile ground for student learning. Important behaviors and interactions such as instructor feedback, assignment scaffolding, hands-on activities, reflection, repetition and practice were enhanced, and students also gained advantages in terms of flexibility, time management, and convenience (Margulieux, McCracken, & Catrambone, 2015).

Blended learning tends to benefit disadvantaged or academically underprepared students, groups that typically struggle in fully online courses (Chingosa, Griffiths, Mulhern, and Spies, 2017). Combining technology with in-person teaching helped to mitigate some challenges faced by many students in scientific disciplines, improving persistence and graduation rates. And since blended learning can be supportive for a broader range of students, it may increase retention and persistence for underrepresented groups, such as students of color (Bax, Campbell, Eabron, & Thomson, 2014–15).

Blended learning  benefits instructors, too. When asked about blended learning, most university faculty and instructors believe it to be more effective (Bernard, Borokhovski, Schmid, Tamim, & Abrami, 2014). The technologies used often capture and provide important data analytics, which help instructors more quickly identify under-performing students so they can provide extra support or guidance (McDonald, 2014). Many online tools are interactive, fun and engaging, which encourages student interaction and enhances collaboration (Hoxie, Stillman, & Chesal, 2014). Blended learning is growing in acceptance and often seen as a favorable approach because it synthesizes the advantages of traditional instruction with the flexibility and convenience of online learning (Liu, et al., 2016).

A Leap of Faith

Is blended learning right for your discipline or area of expertise? If you want to give it a try, there are many excellent internet resources available to support your transition.

Though faculty can choose to develop a blended class on their own, Oregon State instructors who develop a hybrid course through Ecampus receive full support and resources, including collaboration with an instructional designer, video creation and media development assistance. The OSU Center for Teaching and Learning offers workshops and guidance for blended, flipped, and hybrid classes. The Blended Learning Universe website, referenced earlier, also provides many resources, including a design guide, to support the transformation of a face-to-face class into a cohesive blended learning experience.

If you are ready to reap the benefits of both online and face-to-face teaching, I urge you to go for it! After all, the research shows that it’s a pretty safe leap.

For those of you already on board with blended learning, let us hear from you! Share your stories of success, lessons learned, do’s and don’ts, and anything else that would contribute to instructors still thinking about giving blended learning a try.

Susan Fein, Oregon State University Ecampus Instructional Designer
susan.fein@oregonstate.edu | 541-747-3364

References

  • Bax, P., Campbell, M., Eabron, T., & Thomson, D. (2014–15). Factors that Impede the Progress, Success, and Persistence to Pursue STEM Education for Henderson State University Students Who Are Enrolled in Honors College and in the McNair Scholars Program. Henderson State University. Arkadelphia: Academic Forum.
  • Bernard, R. M., Borokhovski, E., Schmid, R. F., Tamim, R. M., & Abrami, P. C. (2014). A meta-analysis of blended learning and technology use in higher education: From the general to the applied. J Comput High Educ, 26, 87–122.
  • Bowen, W. G., Chingos, M. M., Lack, K. A., & Nygren, T. I. (2014). Interactive learning online at public universities: Evidence from a six-campus randomized trial. Journal of Policy Analysis and Management, 33(1), 94–111.
  • Chingosa, M. M., Griffiths, R. J., Mulhern, C., & Spies, R. R. (2017). Interactive online learning on campus: Comparing students’ outcomes in hybrid and traditional courses in the university system of Maryland. The Journal of Higher Education, 88(2), 210-233.
  • Hoxie, A.-M., Stillman, J., & Chesal, K. (2014). Blended learning in New York City. In A. G. Picciano, & C. R. Graham (Eds.), Blended Learning Research Perspectives (Vol. 2, pp. 327-347). New York: Routledge.
  • Liu, Q., Peng, W., Zhang, F., Hu, R., Li, Y., & Yan, W. (2016). The effectiveness of blended learning in health professions: Systematic review and meta-analysis. Journal of Medical Internet Research, 18(1). doi:10.2196/jmir.4807
  • Maxwell, C. (2016, March 4). What blended learning is – and isn’t. Blog post. Retrieved from Blended Learning Universe.
  • Margulieux, L. E., McCracken, W. M., & Catrambone, R. (2015). Mixing in-class and online learning: Content meta-analysis of outcomes for hybrid, blended, and flipped courses. In O. Lindwall, P. Hakkinen, T. Koschmann, & P. Tchoun (Ed.), Exploring the Material Conditions of Learning: Computer Supported Collaborative Learning (CSCL) Conference (pp. 220-227). Gothenburg, Sweden: The International Society of the Learning Sciences.
  • McDonald, P. L. (2014). Variation in adult learners’ experience of blended learning in higher education. In Blended Learning Research Perspectives (Vol. 2, pp. 238-257). Routledge.
  • Sithole, A., Chiyaka, E. T., & McCarthy, P. (2017). Student attraction, persistence and retention in STEM programs: Successes and continuing challenges. Higher Education Studies, 7(1).
  • U.S. Department of Education, Office of Planning, Evaluation, and Policy Development. (2009). Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies. Washington, D.C.

Image Credits

  • Blended Learning Icon: Innovation Co-Lab Duke Innovation Co-Lab [CC0]
  • Leap of Faith: Photo by Denny Luan on Unsplash
  • School photo created by javi_indy – www.freepik.com

Report Reader Checklist

Posted on by

""

Are you interested in reading about research in the field of online teaching and learning? Could you use some help in reading and digesting the results of various research reports in the field? Would you like to be able to identify the strengths and weakness of the study reports that you read? If you answered “yes” to one or more of these questions then you might be interested in the  Ecampus Research Unit’s new resource: the Report Reader Checklist.

The Report Reader Checklist includes a comprehensive set of criteria that offers you a guide to evaluate the quality and rigor of study reports. The checklist is intended to provide an overview of the foundational elements that should be included when reporting on the results of a study. You can apply each checklist criterion to a report to see whether that element has been included or not.

Here is an overview of the six areas of the checklist and the criterion in each area:

  1. Context: Does the report describe the larger purpose of the study? Does it explain the history or theoretical framework? Does the report include research goals and suggestions for further research?
  2. Methodology: Does the report have a methodology section? Is it clear how data were collected and analyzed? If the study used statistics, were they named? If coding was used, was the procedure described?
  3. Sample: Are the study participants described in detail? Is it clear how participants were recruited? Does the sample represent an appropriate level of diversity? Are subgroups appropriately identified?
  4. Reporting Results: Are all numbers in the report easy to comprehend? Is the “N” provided? Does the report identify missing data? Is it clear where study findings fit with the study’s purpose? Do data visualizations enhance your understanding of the results?
  5. Transparency: Are raw data included in the report? Are instruments or study protocols provided in the report? Are the authors clear about any conflicts of interest? Is the discussion rooted in data results?
  6. Reader Experience: Does the report use language that is easy to understand? Is the report ADA accessible? Does it include a summary or abstract? Is the study an appropriate length?

There are no “points” or “weighting” within the checklist, but if you find one area (e.g., “Context” or “Methodology”) that is missing several criteria within a report, that would indicate that a report is weaker in that particular area.

You can download a one-page PDF of the checklist or visit our supplementary website that provides more details on each of the criterion. Further, the site includes sample reports for each criterion so that you can learn more about areas that you are unfamiliar with.

We hope you find this resource useful for reading and evaluating reports in the field. We also hope it helps you make data-driven decisions for your work.

About the Oregon State University Ecampus Research Unit: The Oregon State University Ecampus Research Unit makes research actionable through the creation of evidence-based resources related to effective online teaching, learning and program administration. The OSU Ecampus Research Unit is part of Oregon State Ecampus, the university’s top-ranked online education provider. Learn more at ecampus.oregonstate.edu/research.

 

Rubrics Markers of Quality –Tips and Best Practices (Part 2)

Posted on by

There are many benefits to using rubrics for both instructors and students, as discussed in Rubrics Markers of Quality Part 1 – Unlock the Benefits. Effective rubrics serve as a tool to foster excellence in teaching and learning, so let’s take a look at some best practices and tips to get you started.

Best Practices

Alignment

Rubrics should articulate a clear connection between how students demonstrate learning and the (CLO) Course Learning Outcomes. Solely scoring gateway criteria, the minimum expectations for a task, (e.g., word count, number of discussion responses) can be alluring. Consider a rubric design to move past minimum expectations and assess what students should be able to do after completing a task.

Detailed, Measurable, and Observable

Clear and specific rubrics have the potential to communicate to how to demonstrate learning, how performance evaluation measures, and markers of excellence. The details provide students with a tool to self-assess their progress and level up their performance autonomously.

Language Use

Rubrics create the opportunity to foster an inclusive learning environment. Application of clear and consistent language takes into consideration a diverse student composition. Online students hail from around the world and speak various native languages. Learners may interpret the meaning of different words differently. Use simple terms with specific and detailed descriptions. Doing so creates space for students to focus on learning instead of decoding expectations. Additionally, consider the application of parallel language consistently. The use of similar language (e.g. demonstrates, mostly demonstrates, and doesn’t demonstrate) across each criterion can be helpful to differentiate between each performance level.

Tips of the Trade!

Suitability

Consider the instructional aim, learning outcomes, and the purpose of a task when choosing the best rubric for your course.

  • Analytic Rubrics: The hallmark design of an analytic rubric evaluates performance criteria separately. Characteristically this rubric’s structure is a grid, and evaluation of performance scores are on a continuum of levels. Analytic rubrics are detailed, specific, measurable, and observable. Therefore, this rubric type is an excellent tool for formative feedback and assessment of learning outcomes.
  • Holistic Rubrics: Holistic rubrics evaluate criteria together in one general description for each performance level. Ideally, this rubric design evaluates the overall quality of a task.  Consider the application of a holistic rubric can when an exact answer isn’t needed, when deviation or errors are allowed, and for interpretive/exploratory activities.
  • General Rubrics: Generalized rubrics can be leveraged to assess multiple tasks that have the same learning outcomes (e.g., reflection paper, journal). Performance dimensions focus solely on outcomes versus discrete task features.

Explicit Expectations

Demystifying expectations can be challenging.  Consider articulating performance expectations in the task description before deploying a learning task. Refrain from using rubrics as a standalone vehicle to communicate expectations. Unfortunately, students may miss the rubric all together and fail to meet expectations. Secondly, make the implicit explicit! Be transparent. Provide students with all the information and tools they need to be successful from the outset.

Iterate

A continuous improvement process is a key to developing high-quality assessment rubrics. Consider multiple tests and revisions of the rubric. There are several strategies for testing a rubric. 1) Consider asking students, teaching assistants, or professional colleagues to score a range of work samples with a rubric. 2) Integrate opportunities for students to conduct self-assessments. 3) Consider assessing a task with the same rubric between course sections and academic terms. Reflect on how effectively and accurately the rubric performed, after testing is complete. Revise and redeploy as needed.

Customize

Save some time, and don’t reinvent the wheel. Leverage existing samples and templates. Keep in mind that existing resources weren’t designed with your course in mind. Customization will be needed to ensure the accuracy and effectiveness of the rubric.

Are you interested in learning more about rubrics and how they can enrich your course? Your Instructional Designer can help you craft effective rubrics that will be the best fit for your unique course.

References

Additional Resources

The Basics
Best Practices
Creating and Designing Rubrics

Ten Course Design Strategies to Minimize Cheating

Posted on by

One of the most common questions I get as an Instructional Designer is, “How do I prevent cheating in my online course?” Instructors are looking for detection strategies and often punitive measures to catch, report, and punish academic cheaters. Their concerns are understandable—searching Google for the phrase “take my test for me,” returns pages and pages of results from services with names like “Online Class Hero” and “Noneedtostudy.com” that promise to use “American Experts” to help pass your course with “flying grades.” 1 But by focusing only on what detection measures we can implement and the means and methods by which students are cheating, we are asking the wrong questions. Instead let’s consider what we can do to understand why students cheat, and how careful course and assessment design might reduce their motivation to do so.

A new study published in Computers & Education identified five specified themes in analyzing the reasons students provided when seeking help from contract cheating services (Amigud & Lancaster, 2019):

  • Academic Aptitude – “Please teach me how to write an essay.”
  • Perseverance – “I can’t look at it anymore.”
  • Personal Issues – “I have such a bad migraine.”
  • Competing Objectives – “I work so I don’t have time.”
  • Self-Discipline – “I procrastinated until today.”

Their results showed that students don’t begin a course with the intention of academic misconduct. Rather, they reach a point, often after initially attempting the work, when the perception of pressures, lack of skills, or lack of resources removes their will to complete the course themselves. Online students may be more likely to have external obligations and involvement in non-academic activities. According to a 2016 study, a significant majority of online students are often juggling other obligations, including raising children and working while earning their degrees (Clinefelter & Aslanian, 2016).

While issues with cheating are never going to be completely eliminated, several strategies have emerged in recent research that focus on reducing cheating from a lens of design rather than one of punishment. Here are ten of my favorite approaches that speak to the justifications identified by students that led to cheating:

  1. Make sure that students are aware of academic support services (Yu, Glanzer, Johnson, Sriram, & Moore, 2018). Oregon State, like many universities, offers writing help, subject-area tutors and for Ecampus students, a Student Success team that can help identify resources and provide coaching on academic skills. Encourage students, leading up to exams or big assessment projects, to reach out during online office hours or via email if they feel they need assistance.
  2. Have students create study guides as a precursor assignment to an exam—perhaps using online tools to create mindmaps or flashcards. Students who are better prepared for assessments have a reduced incentive to cheat. Study guides can be a non-graded activity, like a game or practice quiz, or provided as a learning resource.
  3. Ensure that students understand the benefits of producing their own work and that the assessment is designed to help them develop and demonstrate subject knowledge (Lancaster & Clarke, 2015). Clarify for students the relevance of a particular assessment and how it relates to the weekly and larger course learning outcomes.
  4. Provide examples of work that meets your expectations along with specific evaluation criteria. Students need to understand how they are being graded and be able to judge the quality of their own work. A student feeling in the dark about what is expected from them may be more likely to turn to outside help.
  5. Provide students with opportunities throughout the course to participate in activities, such as discussions and assignments, that will prepare them for summative assessments (Morris, 2018).
  6. Allow students to use external sources of information while taking tests. Assessments in which students are allowed to leverage the materials they have learned from to construct a response do a better job of assessing higher order learning. Memorizing and repeating information is rarely what we hope students to achieve at the end of instruction.
  7. Introduce alternative forms of assessment. Creative instructors can design learning activities that require students to develop a deeper understanding and take on more challenging assignments. Examples of these include recorded presentations, debates, case studies, portfolios, and research projects.
  8. Rather than a large summative exam at the end of a course, focus on more frequent smaller, formative assessments (Lancaster & Clarke, 2015). Provide students with an ongoing opportunity to demonstrate their knowledge without the pressure introduced by a final exam that accounts for a substantial portion of their grade.
  9. Create a course environment that is safe to make and learn from mistakes. Build into a course non-graded activities in which students can practice the skills they will need to demonstrate during an exam.
  10. Build a relationship with students. When instructors are responsive to student questions, provide substantive feedback throughout a course and find other ways to interact with students — they are less likely to cheat. It matters if students believe an instructor cares about them (Bluestein, 2015).

No single strategy is guaranteed to immunize your course against the possibility that a student will use some form of cheating. Almost any type of assignment can be purchased quickly online. The goal of any assessment should be to ensure that students have met the learning outcomes—not to see if we can catch them cheating. Instead, focus on understanding pressures a student might face to succeed in a course, and the obstacles they could encounter in doing so. Work hard to connect with your students during course delivery and humanize the experience of learning online. Thoughtful design strategies, those that prioritize supporting student academic progress, can alleviate the conditions that lead to academic integrity issues.

1 This search was suggested by an article published in the New England Board of Higher Education on cheating in online programs. (Berkey & Halfond, 2015)

References

Amigud, A., & Lancaster, T. (2019). 246 reasons to cheat: An analysis of students’ reasons for seeking to outsource academic work. Computers & Education, 134, 98–107. https://doi.org/10.1016/j.compedu.2019.01.017

Berkey, D., & Halfond, J. (2015). Cheating, student authentication and proctoring in online programs.

Bluestein, S. A. (2015). Connecting Student-Faculty Interaction to Academic Dishonesty. Community College Journal of Research and Practice, 39(2), 179–191. https://doi.org/10.1080/10668926.2013.848176

Clinefelter, D. D. L., & Aslanian, C. B. (2016). Comprehensive Data on Demands and Preferences. 60.

Lancaster, T., & Clarke, R. (2015). Contract Cheating: The Outsourcing of Assessed Student Work. In T. A. Bretag (Ed.), Handbook of Academic Integrity (pp. 1–14). https://doi.org/10.1007/978-981-287-079-7_17-1

Morris, E. J. (2018). Academic integrity matters: five considerations for addressing contract cheating. International Journal for Educational Integrity, 14(1), 15. https://doi.org/10.1007/s40979-018-0038-5

Yu, H., Glanzer, P. L., Johnson, B. R., Sriram, R., & Moore, B. (2018). Why College Students Cheat: A Conceptual Model of Five Factors. The Review of Higher Education, 41(4), 549–576. https://doi.org/10.1353/rhe.2018.0025

What can we learn from the success of CANVAS LMS?

Posted on by

Oregon State University’s Learning Management System (LMS) migrated to Canvas in 2014-2015. The Canvas migration was based not only on the company’s feature alignment with our learning platform needs but also on the outstanding customer service Canvas Instructure has provided to our LMS user community including students, faculty, instructional designers, and administrators. How Canvas provides customer service offers an example we can model to continue to exceed student expectations.

According to Michael Feldstein’s July 8, 2018 report, major players in US LMS market include Blackboard, Canvas, Moodle, Bright Space, Sakai, Schoology, and others (Feldstein, 2018).

LMS Market share in North America

Figure 1: US Primary LMS Systems, July 6th, 2018 (Feldstein, 2018)

 

Of these major players in the LMS field, Canvas is most noticeable with fastest growth in market share among U.S. and Canadian higher education institutions.

LMS history and Market Share

Figure 2. LMS Market Share for US and Canadian Higher Ed Institutions (Feldstein, 2018)

 

Different people suggest different criteria when comparing LMSs. Udutu.com provided a list of 7 things to think about before purchasing a LMS:

  1. Be clear on your learning and training objectives;
  2. Don’t be fooled by the high costs of an LMS;
  3. Know the limitations of your internal team and users;
  4. Pay for the features you need, not for what you might need;
  5. The latest new technology is not necessarily the best one;
  6. Customer support is everything; and
  7. Trust demos and trials over reviews, ratings and “industry experts”

(Udutu, 2016).  Noud (2016) suggested the following ten factors to consider when selecting a LMS:

  1. Unwanted Features;
  2. Mobile Support;
  3. Integrations (APIs, SSO);
  4. Customer Support;
  5. Content Support;
  6. Approach to pricing;
  7. Product roadma;
  8. Scalability, Reliability and Security;
  9. Implementation Timeframe; and
  10. Hidden costs.

Christopher Pappas (2017) suggested 9 factors to consider when calculating your LMS budget:

  1. Upfront costs;
  2. LMS training;
  3. Monthly Or Annual Licensing Fees;
  4. Compatible eLearning Authoring Tools;
  5. Pay-per-User/Learner Fee;
  6. Upgrades and Add-Ons;
  7. Learning and Development Team Payroll;
  8. Online Training Development Costs; and
  9. Ongoing Maintenance.

Of all of the above lists, I like Udutu’s list the best because it matches with my personal experiences with LMS migrations.

I first used WebCT between 2005 and 2007, participated in migrating from WebCT Vista to Blackboard in 2008, and Angel to Blackboard migration in 2013-2014.  During my seven years of using Blackboard as instructional designer and faculty support staff, my biggest complaint with Blackboard was its unexpected server outages during peak times such as beginning of the term and final’s weeks. In 2014, I moved to Oregon State University (OSU). The OSU community was looking for a new LMS in 2013 and started piloting Canvas in 2014. At the end of the pilot, instructor and student feedback was mostly positive. Not subject to local server outages, the cloud-based system was stable and had remained available to users throughout the pilot. Of course no LMS is perfect. But after careful comparison and feedback collection, we migrated from Blackboard to Canvas in 2015. So far in my four years of using Canvas, there has not been a single server outage. Canvas has the basic functionality of a LMS.

Canvas wanted to expand their market share by building up positive customer experiences. They were eager to please OSU and they provided us with 24/7 on-call customer service during our first two years of using Canvas, at a relatively reasonable price. The pilot users were all super satisfied with their customer service. Several instructors reported that they contacted Canvas hotline on Thanksgiving or Christmas, and their calls were answered immediately, and their issues were resolved.

Michael Feldstein (2018) summarized that Canvas’ “cloud-based offering, updated user interface, reputation for outstanding customer service and brash, in-you-face branding” have helped its steady rise in the LMS market share. As instructors and instructional designers, we can learn a lot from the CANVAS INSTRUCTURE’s success story and focus on improving the service we provide to our students, such as student success coaching, online recourses, online learning communities, etc. Would you agree with me on this? If you have specific suggestions on how to improve the way we serve our students, feel free to let us know (Tianhong.shi@oregonstate.edu ; @tianhongshi) !

 

References:

Goldberg, M., Salari, S. & Swoboda, P. (1996) ‘World Wide Web – Course Tool: An Environment for Building WWW-Based Courses’ Computer Networks and ISDN Systems, 28:7-11 pp1219-1231

Feldstein, Michael. (2018). Canvas surpasses Blackboard Learn in US Market Share. E-Literate, July 8, 2018. Retrieved from https://mfeldstein.com/canvas-surpasses-blackboard-learn-in-us-market-share/ on February 2, 2019.

McKenzie, Lindsay. (2018). Canvas catches, and maybe passes, Blackboard. InsideHigherEd. July 10, 2018. Retrieved from https://www.insidehighered.com/digital-learning/article/2018/07/10/canvas-catches-and-maybe-passes-blackboard-top-learning on February 2, 2019.

Moran, Gwen (October 2010). “The Rise of the Virtual Classroom”. Entrepreneur Magazine. Irvine, California. Retrieved July 15, 2011.

Noud, Brendan. (February 9, 2016). 10 Things to consider when selecting an LMS. Retrieved from https://www.learnupon.com/blog/top-10-considerations-when-selecting-a-top-lms/ on February 2, 2019.

Pappas, Christopher. (June 13, 2017). Top 9 Factors to consider when calculating Your LMS Budget. Retrieved from https://blog.lambdasolutions.net/top-9-factors-to-consider-when-calculating-your-lms-budget on February 2, 2019.

Udutu. (May 30, 2016). How to choose the best Learning Management System. Retrieved from https://www.udutu.com/blog/lms/ on February 2, 2019.

Wikipedia. (n.d.). WebCT. Retrieved from https://en.wikipedia.org/wiki/WebCT on February 2, 2019.