What can we do to help?

Oregon State University has prioritized diversity, equity and inclusion efforts, and it is up to us as educators and those who support teaching and learning to actively co-create a culture that promotes tolerance and inclusion, for our students, our staff, and our community. To do this, we must challenge exclusion and commit to inclusive practices that promote real equity and extend opportunity to all students. University staff and instructors may be intentionally or unintentionally signaling their institution’s, their department’s, or their own levels of inclusion by the policies, rules, statements, systems, symbols, and representations they choose and use, so it is important to reassess what messages we are sending to students. While students may develop feelings of belonging on their own, it is more likely when the community actively, publicly, and earnestly offers a place at the table for everyone.

Ecampus strives to understand the unique issues faced by our online students and implement research-based solutions and strategies for increasing our students’ sense of belonging. Our commitment begins with high-quality, collaborative course design that enables instructors to work directly with the instructional design team to build interaction into course content, supplemented with faculty training opportunities to expose Ecampus instructors to a wide range of facilitation strategies that complement good design. 

There are a few general conditions that provide a foundation for belonging that we should be aware of, backed by extensive research. 

Support and flexibility

Online students choose our program for the flexibility it offers, and this often means that they are studying outside of business hours, at night and on the weekends. Likewise, their student support needs are likely to come at non-traditional times, so anticipating this and offering support services on demand and for extended times becomes important. Being aware of these needs and creating policies and practices that allow students to get the support they need in a timely manner can be a critical factor in online student success. 

Representation

Students need to see themselves represented, both amongst the staff and faculty they interact with and in the course materials they use. When students from marginalized groups see people who openly share their identity or background, they are reassured that they, too, belong. OSU is committed to building and retaining a diverse workforce and has implemented several strategies towards this goal, including a suite of trainings including the Social Justice Education Initiative (SJEI) and Search Advocate program, among others. Faculty and course designers can contribute to these efforts by considering how course content serves to further amplify previously ignored or excluded voices by choosing to include rather than exclude diverse voices, images, perspectives, and ideas.  

A safe environment that supports the conditions for learning

We support a safe learning environment when we actively challenge unhealthy beliefs about who can be successful and become more aware of behaviors that may harm others. In practice, this translates into making it clear that our school is a safe space and is not accepting of intolerance, bullying, stereotyping, or harassment. This effort is supported when faculty are knowledgeable about online learning best practices and work to welcome, inspire, engage, and mentor students learning online.

Encouragement and acknowledgement 

When we create learning environments that combine high expectations and rigor, we can support students’ achievement by affirming their ability to excel. Recognizing barriers and helping students overcome hurdles helps them build strong identities as scholars. Acknowledging students’ intersecting identities, celebrating diversity, and fostering respectful relationships between students lets students know that they are a valued part of our community. 

Additionally, we can help online students create a sense of community and connection to OSU, their peers, and their instructors. Small acts of inclusion can go a long way toward creating a warm, friendly, welcoming space for students. 

Connecting with the university

Online students may identify more strongly as an online learner than an OSU student. They may feel unseen in comparison to on-campus students. This may be compounded when multiple, intersecting identities further this sense of disconnection. To combat this, we can strive to reinforce to our online students’ that they are indeed an important part of our community by welcoming new students, celebrating milestones and successes, and providing coaching, tutoring, and resources to support advancement and matriculation. Ecampus sends incoming students an OSU graduation tassel as a reminder that they are part of the OSU community and to encourage them to persevere throughout their studies. 

Connecting with other students 

Campus affinity organizations, such as OSU’s seven unique cultural centers, and clubs can offer students the chance to meet and become involved with students and staff who share their identity and/or interests. Peer mentorship programs can be another way of providing direct supportive connections to fellow students. 

Connecting with support staff

Oftentimes, the first OSU representatives new students interact with are support staff who handle welcome or orientation programs, so they play a large role in setting the stage for belonging by being explicitly inclusive and communicating OSU’s commitment to DEI. Academic Advisors can be crucial to success, helping navigate the policies, procedures, and schedules online students must be aware of. Another key support role is that of the Success Coach, who works closely with students to identify barriers to success, find available resources, develop good study habits, and collaboratively build out plans to achieve academic goals. Online open houses, info sessions, newsletters and engagement events can strengthen online students’ sense of belonging, as can sharing relevant social media channels with online students, providing a substitute experience for on-campus visits and activities. Overall, it is important that university staff meet online students where they are, bringing the campus experience to them as much as possible via the LMS, social media, email, and Zoom. 

Connecting with faculty

Undoubtedly, the group that has the most significant impact on online students’ experience of belonging is the faculty they learn from. Students resoundingly report that instructor interaction and feedback are the most influential aspects of online course satisfaction. This is reflective of the reality that instructors play several roles in online classrooms, serving as course manager, technical support, and social facilitator in addition to subject matter experts. This gives instructors of online courses many opportunities to influence how welcome students feel in their online courses, and they communicate this via the implicit and explicit tone of their communications, the learning materials and activities they choose, their course policies, and the feedback they provide. 

complex bar chart showing student responses in the Student Academic Experience Survey 2022
The chart above, from the Student Academic Experience Survey 2022, echoes our internal Ecampus student survey results, with a large proportion of students indicating that instructor access is key to success and happiness in online courses.

Beginning with the syllabus, an instructor signals their own beliefs and attitude towards learning by both what they say and how they say it. If the course lacks face-to-face or synchronous meetings, online students must look at course design, learning materials, and instructor communications for clues about how included they can expect to be. Syllabi written in a warm, welcoming tone serves as an indicator that an instructor first and foremost cares about students, and simple tweaks to syllabus language can go a long way toward conveying this to students. Using language that references learning together, respecting differences, and building of community can reassure students that their instructor cares about them and wants them to succeed. Ecampus recently released updated online and hybrid syllabus templates for the 23-24 academic year, with some sections rewritten in a more inclusive and welcoming tone. 

This short video by Ana Lu Fonseca, OSU Assistant Director of Diversity, highlights the importance of using inclusive and affirming language.

Course design and content is another area where instructors can have direct influence on students’ sense of belonging. Ecampus courses are designed via collaboration between an instructional designer and faculty developer, using our Ecampus Essentials as a guideline. Instructors who want to improve their online courses can ensure that they meet not only the essential standards but also the exemplary ones, which represent research-based best practices that help students have better outcomes when learning online. 

Creating courses that are accessible for all students is a priority at Ecampus, and our designers often turn to the Universal Design for Learning (UDL) guidelines, which outline concrete steps to make courses more learner friendly for all students. Our OSU Canvas LMS also has built-in accessibility tools, including the UDOIT checker for faculty and Canvas’ own checker in the Rich Content Editor box, that can assist instructors in finding and fixing accessibility issues. We also have Ally, which checks the accessibility of course content, helps fix the content, and helps students by generating alternative forms of content. 

Representation is another important factor related to belonging where faculty can have a significant influence. Instructional materials that reflect diverse perspectives can help students understand whose voices, perspectives, and contributions are deemed worthy, valued, and legitimate. Acknowledging and helping students understand how certain groups have contributed to or been left out of certain fields and areas of study is an important facet of challenging and countering negative stereotypes. Instructors can choose to include a wide range of images, stories, and voices in the learning materials for their courses. When students see themselves represented in the course in positive and inclusive ways, they are more likely to be engaged and willing to learn. If materials in a course present a limited viewpoint or show only a small fraction of human races, genders, nationalities, and experiences, students may struggle to find them relevant to their own lives. 

Creating a sense of community within a course has a positive effect on students’ sense of belonging, and instructors have opportunities to foster community throughout the term. Structuring courses so that students have varied opportunities to interact with the instructor and fellow students is an important part of community building, especially in asynchronous courses. Group work, peer review, and collaborative projects can help students get to know their classmates, which is another component of belonging. Consider giving students chances to interact both academically and socially. This might include not just offering but actively inviting them to synchronous study sessions, happy hours, or office hours, assigning some group or pair work or peer reviews, or providing forums such as discussion boards or chat tools like Teams or Slack where students can informally interact. 

An significant but often unstated role of an instructor in online courses is that of guide, helping students make sense of the course layout, format, and flow as well as framing the big picture when it comes to content and learning outcomes. This can take many overlapping and complementary forms, such as making announcements that recap the prior week or assignments and remind students what is coming and how it connects to the prior lessons, providing study guides, timelines, flowcharts or other big-picture supports, or helping steer online discussions in the right direction. Rubrics are another meaningful way to convey relative importance and weight of different aspects of graded work, with the added benefits of communicating clear expectations and making it easier to grade work fairly. 

Related to serving as a guide to course materials, instructors can help students connect to their field of study in more personal and comprehensive ways. How an instructor chooses to address students can facilitate them seeing themselves as practitioners and experts, and by addressing them as future scientists (or artists or historians), can instill a measure of confidence in their self image. Course content can also be adapted to include clear connections to professionals in the field and professional organizations that might be of interest. Helping students become cognizant of the norms, vocabulary, and typical work conditions they can expect can help motivate and prepare students for life and work after graduation, and sets a foundation for belonging within their discipline and track. 

Perhaps most important ways an instructor impacts student belonging is how they facilitate a course in progress. Regular communication and clear presence of the instructor within the online course site, along with timely and meaningful feedback on assignments, consistently rise to the top as critical for online student success. These findings underpin many of our Online Teaching Principles, a guide for faculty focusing on the art of facilitating courses online, developed in 2022 to complement our Ecampus Essentials. These principles include suggestions aligned with best practices that support creating an inclusive environment.

Feedback is one of the most critical ways instructors influence students’ learning, and research supports a 24-hour turnaround time for responding to questions during the week and a five-day turnaround for grading and feedback, both essential for online students to be able to progress through course content in a timely manner. How feedback is given is equally important- comments for improvement should be couched in positive and encouraging language, focusing on improvement rather than perfection. Carol Dweck’s concept of growth mindset can be a powerful lens through which to view providing feedback, as it focuses on attitudes towards failure as a part of learning, stressing potential and improvement rather than perfection. Multiple studies confirm that promoting a growth mindset can empower students to take initiative in their learning, build self-efficacy, be more resilient when facing difficulties, better regulate emotions, and persevere through stress and challenges. Instructors can encourage this mindset by framing failure as part of the learning process, praising effort over intelligence, avoiding negative language and insults, and reassuring students of their own capabilities. 

Oregon State University’s commitment to diversity, equity, and inclusion requires the entire OSU community to commit to understanding how belonging can be nurtured and how inclusion can be extended or denied. When all students, employees, and community members have a seat at the table and feel welcomed, valued, and included, then we are succeeding. A recent update from Executive Director of Student Experiences & Engagement Damoni Wright and Associate Provost & Dean of Students Kevin Dougherty, sums it up well, “Social justice work cannot be done in a vacuum and cannot be done only in one or two departments, it must be understood, committed to, and integrated into every facet of our work, and we are dedicated to continuing our efforts to make this happen… Through our work together, we will continue to positively change our campus and support student success.” This is a goal we all contribute to daily, in many large and small ways, and is work that must continue to be prioritized and supported.


Sources

Ally for Canvas | Learn@OregonState

Belonging and Emotional Safety – Casel Schoolguide 

Building Inclusivity and Belonging | Division of Student Affairs

College Student’s Sense of Belonging

Creating a Safe and Respectful Environment in Our Nation’s Classrooms 

Cultural Centers | Oregon State University

Decades of Scientific Research that Started a Growth Mindset Revolution

Ecampus Essentials – Standards and Principles – Faculty Support | Oregon State Ecampus | OSU Degrees Online

Establishing Community in Online Courses: A Literature Review 

Growth Mindset in the Higher Education Classroom | Center for Learning Experimentation, Application, and Research

Innovate & Integrate: Plan for Inclusive Excellence | Institutional Diversity 

Mission, Vision and Values | Oregon State Ecampus | OSU Degrees Online

Online Teaching Principles – Standards and Principles – Faculty Support | Oregon State Ecampus | OSU Degrees Online

Oregon Department of Education 

OSU Search Advocate Program

Peer Mentor Program | TRiO | Oregon State University

Social Justice Education Initiative 

State of Oregon Diversity, Equity, and Inclusion Action Plan

Student Academic Experience Survey 2022

The UDL Guidelines

Update Syllabus – Term Checklist and Forms – Faculty Support | Oregon State Ecampus | OSU Degrees Online

Using a warmer tone in college syllabi makes students more likely to ask for help, OSU study finds | Oregon State University

Utilizing Inclusive and Affirming Language | Institutional Diversity

“Belonging is a universal human need that is fundamentally linked to learning and well-being. It describes an individual’s experience of feeling that they are, or are likely to be, accepted and respected as a valued contributor in a specific environment.”           

Structures for Belonging: A Synthesis of Research on Belonging-Supportive Learning Environments
image of Maslow's pyramid of needs

Maslow’s Hierarchy of Needs is a helpful framework when discussing belonging, which falls in the middle, at level three, just above the basics for survival (level one: air, water, food, shelter) and safety (level 2: health, employment, family, security). 

Image from Wikimedia Commons

Have you heard the word belonging recently in reference to students and employees? At OSU, it seems to be popping up frequently in conversations and discussions, onboardings and trainings, online and off, becoming a buzzword for those concerned with teaching and learning, recruitment and outreach, employee satisfaction, and student success, and has become a focal point of our ongoing efforts towards diversity, equity, and inclusion. This increased focus on the concept of belonging at OSU is reflected in the university’s 2018 Innovate & Integrate: Plan for Inclusive Excellence, and is echoed by the 2021 Oregon Department of Education’s passing of the Every Student Belongs rule, which states, “It is the policy of the State Board of Education that all students, employees, and visitors in public schools are entitled to learn, work, and participate in an environment that is safe and free from discrimination, harassment, and intimidation.” These initiatives reflect a growing understanding that traditionally prevailing systems of power have historically marginalized certain groups and excluded them from many realms of life, including education, and prioritize a commitment to changing the status quo explicitly and with intention. 

At Ecampus, belonging is an area of active study, and our effort to extend the feeling of belonging to our online students is an important part of our mission, vision, & values and our own Inclusive Excellence Strategic Plan’s goals. We realize that our Ecampus students come from a wide range of backgrounds, seek online learning for a variety of reasons, and comprise higher numbers of students from historically marginalized backgrounds, and thus, combined with the nature of online learning, can feel increased isolation and less of a sense of belonging than their on-campus peers. 

What is belonging and why is it important?

Belonging is a complex, multi-layered, and changeable quality that is nonetheless very important for student success. Maslow’s Hierarchy of Needs places belonging in the category of psychological needs, just above the basic needs including food, water, air, safety, and shelter. While there are many definitions, the concept of belonging generally encompasses feeling safe, appreciated, welcomed, valued, and respected in a given situation. Humans learn to search for and interpret signals that they belong or do not belong when entering into new situations or contexts. Marginalized groups have had to learn to be cognizant of where and when they could expect to be excluded and on the alert for cues signaling such. Traditionally, educational institutions have been places of exclusionary practices, often closed to large groups in both policy and practice. Students from marginalized populations, facing this problematic history of exclusion, may be looking for signals and signs that indicate the extent to which they are valued and respected as members of the school community. Students may not be sure they will be accepted in institutions, departments, courses, and other school environments and may be consciously or unconsciously searching for such clues as reassurance that they do, in fact, belong. 

Belonging is important for student success because it conveys a host of positive benefits and is a crucial aspect of educational accomplishment. When students find welcoming, inclusive attitudes, see others like themselves being accepted and thriving, and are made to feel safe, protected, supported, and valued, their sense of belonging increases, which in turn allows them to relax and be confident sharing more of their full selves. Students who have a strong sense of belonging show increased academic performance, better attendance, persistence, retention, and motivation, and less likelihood of dropping out. Dr. Terrill Strayhorn, Professor of Urban Education and Vice President for Academic and Student Affairs at LeMoyne-Owen College, in his book College Student’s Sense of Belonging, concludes that “deprivation of belonging in college prevents achievement and wellbeing, while satisfaction of college students’ sense of belonging is a key to educational success for all students.” 

In education, as in our society at large, belonging is often related to larger systems that privilege and prefer certain groups and their ideas, beliefs, and ways of being. Those whose race, ethnicity, sexual identity, gender, class, indigeneity, language, or ability are not of the majority are especially likely to be anxious and “on alert” to othering, exclusion, bullying, and stereotyping. This can have dramatic negative short and long term effects, including lowered cognitive capacity, increased stress, and reduced persistence and achievement. Students who lack a sense of belonging may feel uncomfortable in class or group work, unable to concentrate, and may experience self-consciousness and worry, which makes it that much more difficult to attain higher-level needs such as self-confidence, recognition, respect, fulfillment, and achievement. When students face active discrimination, bullying, or other forms of harassment, they may become depressed, choose to disengage, drop courses, or discontinue studying. With such dire consequences, taking the time to understand and assist in ensuring all OSU students are made to feel welcomed and accepted is well worth the effort. 

Why do online students sometimes feel less of a sense of belonging? 

There are many contributing factors to the disparity between online and traditional students’ development of a sense of belonging, starting with the very nature of the modality in which they study. Students living and studying on campus often have more frequent contact with instructors, campus staff, and other students, both structured and impromptu, providing opportunities to build relationships that can enhance their sense of community and belonging. The pacing of on-campus courses tends to be predictable, with regular meetings during which students often have the chance to ask questions (and receive answers quickly) and get to know fellow students and instructors. Instructors have dedicated class time to review important concepts, check understanding, and provide opportunities for students to get to know them and their fellow students. The traditional on-campus experience is geared towards taking a diverse group of students and building a cohesive community in many ways- students have a wide array of support services available to them, many activities, sports, and clubs they can join, and have a host of opportunities to participate in the rich culture of OSU and in academic and social communities, most of which are easily accessible on campus. Indeed, the very nature of on-campus learning seeks to provide a community for traditional students, many of whom are young and leaving their own homes and communities for the first time.

In contrast, Ecampus courses are asynchronous, featuring no scheduled meeting times, as our students live around the USA and the world. While this format allows for increased access for students who cannot attend in person, the lack of face-to-face interaction can make it difficult for both students and instructors to make personal connections. Unless their courses are carefully designed to provide chances for interaction, conversation, collaboration, and community building, online students may not often interact with their instructors or peers. Online students can experience feelings of isolation, loneliness, and disengagement, which can greatly affect their sense of belonging as an OSU student as well as their success and performance. 

Complicating things even further is the tendency to experience digital miscommunication, the concept that humans are less able to infer tone, underlying sentiment, and in general not understand nuance when communicating by text and online, to some extent due to the lack of context and/or visual clues one gets when interacting face to face. A 2016 literature review on the topic of establishing community in online courses found digital communication to be a consistent issue, noting “…the absence of visual meaning-making cues such as gesture, voice tone, and immediate interaction can frustrate students and lead to feelings of isolation and disconnectedness in an online classroom” and recommended that instructors who teach online learn the nuances of these different communication needs. 

It must be noted that some online students, who may be older, working full or part time, caring for family, or otherwise already leading (sometimes overly) full lives do not particularly want or need the sense of community that younger traditional students may seek out from their university. They may have little time to devote to community building and little interest in superfluous interaction, shying away from an increased social burden they may not have time and energy to fully commit to. Since we cannot know in advance the detailed makeup of our student body, planning with an assumption that creating belonging is an important aspect of our approach serves online students best.

Stay tuned for Part 2: What can we do to help? for research-based strategies you can use to improve belonging and inclusion.


Sources

Ally for Canvas | Learn@OregonState

Belonging and Emotional Safety – Casel Schoolguide 

Building Inclusivity and Belonging | Division of Student Affairs

College Student’s Sense of Belonging

Creating a Safe and Respectful Environment in Our Nation’s Classrooms 

Cultural Centers | Oregon State University

Decades of Scientific Research that Started a Growth Mindset Revolution

Ecampus Essentials – Standards and Principles – Faculty Support | Oregon State Ecampus | OSU Degrees Online

Establishing Community in Online Courses: A Literature Review 

Growth Mindset in the Higher Education Classroom | Center for Learning Experimentation, Application, and Research

Innovate & Integrate: Plan for Inclusive Excellence | Institutional Diversity 

Mission, Vision and Values | Oregon State Ecampus | OSU Degrees Online

Online Teaching Principles – Standards and Principles – Faculty Support | Oregon State Ecampus | OSU Degrees Online

Oregon Department of Education 

OSU Search Advocate Program

Peer Mentor Program | TRiO | Oregon State University

Social Justice Education Initiative 

State of Oregon Diversity, Equity, and Inclusion Action Plan

Student Academic Experience Survey 2022

The UDL Guidelines

Update Syllabus – Term Checklist and Forms – Faculty Support | Oregon State Ecampus | OSU Degrees Online

Using a warmer tone in college syllabi makes students more likely to ask for help, OSU study finds | Oregon State University

Utilizing Inclusive and Affirming Language | Institutional Diversity

by Greta Underhill

Are you interested in qualitative research? Are you currently working on a qualitative project? Some researchers find it helpful to use a computer-assisted qualitative data analysis software (CAQDAS) program to help them organize their data through the analysis process. Although some programs can perform basic categorization for researchers, most software programs simply help researchers to stay organized while they conduct the deep analysis needed to produce scientific work. You may find a good CAQDAS program especially helpful when multiple researchers work with the same data set at different times and in different ways. Choosing the right CAQDAS for your project or team can take some time and research but is well worth the investment. You may need to consider multiple factors before determining a software program such as cost, operating system requirements, data security, and more.

For the Ecampus Research Unit, issues with our existing CAQDAS prompted our team to search for another program that would fit our specific needs: Here’s what we were looking for:

NeedsReasoning
General qualitative analysisWe needed a program for general analysis for multiple types of projects; Other programs are designed for specific forms of analysis such as Leximancer for content analysis
Compatibility across computer operating systems (OS)Our team used both Macs and PCs
Adherence to our institution’s IRB security requirementsLike many others, our institution and our team adhere to strict data security and privacy requirements, necessitating a close look at how a program would manage our data
Basic coding capabilitiesAlthough many programs offer robust coding capabilities, our team needed basic options such as coding one passage multiple times and visually representing coding through highlights
Export of codes into tables or Excel booksThis function is helpful for advanced analysis and reporting themes in multiple file formats for various audiences
A low learning-curveWe regularly bring in temporary team members on various projects for mentorship and research experience, making this a helpful function
A one-time purchaseA one-time purchase was the best fit for managing multiple and temporary team members on various projects

Testing a CAQDAS

I began systematically researching different CAQDAS options for the team. I searched “computer-assisted qualitative data analysis software” and “qualitative data analysis” in Google and Google Scholar. I also consulted various qualitative research textbooks and articles, as well as blogs, personal websites, and social media handles of qualitative researchers to identify software programs. Over the course of several months, I generated a list of programs to examine and test. Several programs were immediately removed from consideration as they are designed for different types of analysis: DiscoverText, Leximancer, MAXQDA, QDA Miner. These programs are powerful, but best suited for specific analysis, such as text mining. With the remaining programs, I signed up for software trials, attended several product demonstrations, participated in training sessions, borrowed training manuals from the library, studied how-to videos online, and contacted other scholars to gather information about the programs. Additionally, I tested whether programs would work across different operating systems. I kept recorded details about each of the programs tested, including how they handled data, the learning curve for each, their data security, whether they worked across operating system, how they would manage the export of codes, and whether they required a one-time or subscription-based payment. I started with three of the most popular programs, NVivo, Dedoose, and ATLAS.ti. The table below summarizes which of these programs fit our criteria.

NVivoDedooseATLAS.ti
General Qualitative Analysis
Cross-OS Collaboration
Data security
Basic coding capabilities
Export codes
Low learning curve
One-time purchase
A table demonstrating whether three programs (NVivo, Dedoose, and ATLAS.ti) meet the team’s requirements. Details of requirements will be discussed in the text of the blog below.

NVivo

I began by evaluating NVivo, a program I had used previously. NVivo is a powerful program that adeptly handled large projects and is relatively easy to learn. The individual license was available for one-time purchase and allowed the user to maintain their data on their own machine or institutional servers. However, it had no capabilities for cross-OS collaboration, even when clients purchased a cloud-based subscription. Our team members could download and begin using the program, but we would not be able to collaborate across operating systems.

Dedoose

I had no prior experience with Dedoose, so I signed up for a trial of the software. I was impressed with the product demonstration, which significantly helped in figuring out how to use the program. This program excelled at data visualization and allowed a research team to blind code the same files for interrater reliability if that suited the project. Additionally, I appreciated the options to view code density (how much of the text was coded) as well as what codes were present across transcripts. I was hopeful this cloud-based program would solve our cross-OS collaboration problem, but it did not pass the test for our institution’s IRB data security requirements because it housed our data on Dedoose servers.

ATLAS.ti

ATLAS.ti was also a new program for me, so I signed up for a trial of this software. It is a well-established program with powerful analysis functions such as helpful hierarchical coding capabilities and institutive links among codes, quotations, and comments. But the cross-OS collaboration, while possible via the web, proved to be cumbersome and this too did not meet the data security threshold for our institution’s IRB. Furthermore, the price point meant we would need to rethink our potential collaborations with other organizational members.

Data Security

Many programs are now cloud-based, which offer powerful analysis options, but unfortunately did not meet our IRB data security requirements. Ultimately, we had to cut Delve, MAXQDA, Taguette, Transana, and webQDA. All of these programs would have been low-learning curve options with basic coding functionality and cross-OS collaboration; however, for our team to collaborate, we would need to purchase a cloud-based subscription, which can quickly become prohibitively expensive, and house our data on company servers, which would not pass our institutional threshold for data security.

Note-taking programs

After testing multiple programs, I started looking beyond just qualitative software programs and into note-taking programs such as DevonThink, Obsidian, Roam Research, and Scrintal. I had hoped these might provide a work around by organizing data on collaborative teams in ways that would facilitate analysis. However, most of them did not have functionalities that could be used for coding or had high learning curves that precluded our team using them.

It seemed like I had exhausted all options and I still did not have a program to bring back to the Research Unit. I had no idea that a low-cost option was just a YouTube video away. Stay tuned for the follow-up post where we dive into the solution that worked best for our team.

 

By: Julie Jacobs, Jana King, Dana Simionescu, Tianhong Shi

Overview

A recent scenario with our course development team challenged our existing practices with lecture media. Formerly, we had encouraged faculty to include only slides with narration in their lecture videos due to concerns about increasing learners’ cognitive load. Students voiced their hope for more instructor presence in courses, and some instructors started asking about including video of themselves inserted into their lectures. This prompted us to begin thinking about instructor presence in lecture videos more deeply: why were we discouraging faculty from including their faces in lecture videos? While our practices were informed by research-based media theory, we also recognized those theories might be outdated. 

We began to explore the latest research with the following question in mind: does visual instructor presence in lectures increase extraneous cognitive load in learners? We use the phrase “visual instructor presence” to refer to lecture videos where an instructor’s moving image is seen giving the lecture, composited together with their slides. This technique is also commonly referred to as “picture-in-picture”, as seen in the image below.

Image 1: Adam Vester, instructor in College of Business, in his lecture design for BA 375 Applied Quantitative Methods.

A task force was created to review recent research on visual instructor presence and cognitive load, specifically in lecture-type videos. Our literature review included a look at leading multimedia learning scholar Richard E. Mayer’s newest group of principles. We also reviewed more than 20 other scholarly articles, many of which were focused on learner perception, motivation & engagement, and emotion. 

Findings

According to recent work in multimedia learning, research in this area should focus on three areas, namely learning outcomes (“what works/ what does not work?”), learning characteristics (“when does it work?”), and learning process (“how does it work?”) (Mayer, 2020). Below are our conclusions from the 23 research articles we reviewed regarding instructional videos, attempting to answer the above questions of “what works”, “when does it work”, and “how does it work”.  

  1. This review of recent literature shows no evidence that visual instructor presence increases extraneous cognitive load. 
  2. Students tend to prefer lectures with visual instructor presence – they report increased satisfaction and better perceived learning, which can boost motivation and engagement. 
  3. While some studies find no difference in performance outcomes when visual instructor presence is utilized, others found increased performance outcomes with visual instructor presence. Proposed explanations: embodiment techniques such as gestures, eye contact, and body movement which fosters generative processing (the cognitive processes required for making sense of the material); social cues can help direct the learners’ attention; increased motivation (as per point 2 above) contributes to better learning. 
  4. The effects may depend on the specific type of visual instructor presence (e.g., small picture-in-picture, green-screen, or lightboard) and the characteristics of the content (complex/difficult vs simpler/easier). 

Recommendations

Based on these findings, our team has decided to remove the default discouragement of instructors wishing to use picture-in-picture in lectures. If an instructor is interested in having their visual presence in the lectures, we encourage them to discuss this option with their Instructional Designer and Lecture Media Coordinator to determine if this style is a good fit for them and their content.

Image 2: Bryony DuPont, associate professor of Mechanical Engineering, utilizing visual instructor presence in her lecture design for ME 382 Introduction to Design.

We recommend considering the following points:

  • What is their presentation style? Do they tend to spend a lot of time talking over a slide or is there a lot of text or other action (e.g. software demo) happening in the video? If there’s a lot happening on the screen, perhaps it’s better to not put their video on top of it (the instructor video could be placed only at the beginning and/or end instead).
  • What type of content? Is it simple or more complex? For more visually complex content, a lightboard or digital notation without picture-in-picture may work better, to take advantage of the dynamic drawing principle and the gaze guidance principle. 
  • Is it a foreign language course? If so, it’s likely helpful for the learners to see the instructor’s mouth and body language. 
  • Is the instructor comfortable with being on video? If they’re not comfortable with it, it may not add value. This being said, our multimedia professionals can help make instructors more comfortable in front of the camera and coach them on a high-embodied style of lecturing. 

Since implementing these guidelines and working with an increased number of lectures with visual instructor presence, we also noticed that it works best when the instructor does not look and sound like they’re reading. Therefore, for people who like working with a script, we recommend practicing in advance so they can sound more natural and are able to enhance their presentation with embodiment techniques.

We would love to hear about your opinions or experiences with this type of video. Share them in the comments!

For a detailed summary of our findings and full citation list, please see the full Literature Review.


Some form of group work is a common activity that I help design with faculty every term. Oftentimes, faculty ask how to consider the different levels of engagement from individual group members and how to assess group work, often in the form of a group grade. Improving group work in asynchronous courses and group contracts to promote accountability are some of many ways to guide students into collaborative work. However, collaborative work may require offering equitable opportunities to all students to succeed. Based on the work by Feldman (2019), I’d like to outline some suggestions for assessment design through an equity lens.

Before jumping into assessing group work, Feldman outlines three pillars of equitable grades:

  1. “They are mathematically accurate, validly reflecting a student’s academic performance.
  2. They are bias-resistant, preventing biased subjectivity from infecting our grades.
  3. They motivate students to strive for academic success, persevere, accept struggles and setbacks, and to gain critical lifelong skills” (Feldman, p. 71).

With these three pillars in mind, let’s examine some potential issues with a group receiving one grade for their work.

  1. Accuracy: a collective group grade does not necessarily reflect an individual’s contribution to the group work or assess an individual student’s learning in terms of outcomes. For example, if a group splits up sections of a project into individual responsibilities, a student who did their assigned section very well may not have had an opportunity to gain new knowledge or build on their learning for aspects where they were struggling. And a group grade does not accurately capture their individual work or learning.
  2. Bias: Many times peer evaluations of group work come with some kind of group contract or accountability measure. However, there is a possibility for bias in how students evaluate their peers, especially if that evaluation is based on behaviors like turning things in on time and having strong social skills instead of learning. For example, maybe one of the group members had a job with a variable schedule from week to week, making it difficult to join regular group discussions and complete work at the same pace every week for the duration of the project. Other group members may perceive them as difficult to work with or inconsistent in their commitment and award them fewer points in a peer evaluation, especially if other group members did not have outside factors noticeably impacting their performance.
  3. Motivation: Group contracts and using evaluation as a way to promote productivity is an external motivator and does not instill a sense of internal relevance for students participating in group work. Instead, students may feel resentful that their peers may evaluate them harshly for things outside of their control, which can quickly snowball into a student disengaging from group work entirely.

“The purpose of group work is not to create some product in which all members participate, but for each student to learn specific skills or content through the group’s work together.”

Feldman, p. 104

So how do we assess this learning? Individually. If we can reimagine group work as a journey toward an individual reaching a learning outcome, then instead of assessing a behavior (working well and timeliness in a group) or what a group produces, we can instead create an assessment that captures the individual impact of the group work instead. Feldman outlines some tips for encouraging group work without a group grade:

  1. Have a clear purpose statement and overview for the group work that outlines the rationale and benefit of learning that content in a group context.
  2. Have clear evaluation criteria that shows the alignment of the group work with a follow-up individual assessment.
  3. If possible, include students in the process by having a brainstorm or pre-work discussion ahead of time about what makes groups productive, how to ensure students learn material when working in groups, and what kinds of collaborative expectations can be set for a particular cohort of students.
  4. Be patient with students navigating a new assessment strategy for the first time and offer ample feedback throughout the process so students are set up for success on their assessments.
  5. Ensure the follow-up individual assessment is in alignment with learning outcomes and is focused on the content or skills students are expected to gain through group work.

As an added bonus, assessing group work individually in this way is often simpler than elaborate group work rubrics with separate peer evaluations factored in, making it both easier for the instructor and easier for the student to understand how their grade is calculated. Additionally, it will be important to design this group work with intention—if an individual could learn the material on their own, then what is the purpose of the group interaction? Think about a group project you may have assigned or designed in the past. What was the intention for that journey as a group? And how might you reimagine it if there was an individual assessment after its completion? I hope these questions are great starting points for reflecting on group work assessments and redesigning with equity in mind!

References

Feldman, J. (2019). Grading for equity: What it is, why it matters, and how it can transform schools and classrooms. Thousand Oaks, CA: Corwin.

An illustration of a person kneeling and question marks around

Have you ever been assigned a task but found yourself asking: “What’s the point of this task? Why do I need to do this?” Very likely, no one has informed you of the purpose of this task! Well, it likely was because that activity was missing to show a critical element: the purpose. Just like the purpose of a task can be easily left out, in the context of course design, a purpose statement for an assignment is often missing too.

Creating a purpose statement for assignments is an activity that I enjoy very much. I encourage instructors and course developers to be intentional about that statement which serves as a declaration of the underlying reasons, directions, and focus of what comes next in an assignment. But most importantly, the statement responds to the question I mentioned at the beginning of this blog…why…?

Just as a purpose statement should be powerful to guide, shape, and undergird a business (Yohn, 2022), a purpose statement for an assignment can guide students in making decisions about using strategies and resources, shape students’ motivation and engagement in the process of completing the assignment, and undergird their knowledge and skills.  Let’s look closer at the power of a purpose statement.

What does “purpose” mean?

Merriam-Webster defines purpose as “something set up as an object or end to be”, while Cambridge Dictionary defines it as “why you do something or why something exists”. These definitions show us that the purpose is the reason and the intention behind an action.

Why a purpose is important in an assignment?

The purpose statement in an assignment serves important roles for students, instructors, and instructional designers (believe it or not!).

For students

The purpose will:

  1. answer the question “why will I need to complete this assignment?”
  2. give the reason to spend time and resources working out math problems, outlining a paper, answering quiz questions, posting their ideas in a discussion, and many other learning activities.
  3. highlight its significance and value within the context of the course.
  4. guide them in understanding the requirements and expectations of the assignment from the start.

For instructors

The purpose will:

  1. guide the scope, depth, and significance of the assignment.
  2. help to craft a clear and concise declaration of the assignment’s objective or central argument.
  3. maintain the focus on and alignment with the outcome(s) throughout the assignment.
  4. help identify the prior knowledge and skills students will be required to complete the assignment.
  5. guide the selection of support resources.

For instructional designers

The purpose will:

  1. guide building the structure of the assignment components.
  2. help identify additional support resources when needed.
  3. facilitate an understanding of the alignment of outcome(s).
  4. help test the assignment from the student’s perspective and experience.

Is there a wrong purpose?

No, not really. But it may be lacking or it may be phrased as a task. Let’s see an example (adapted from a variety of real-life examples) below:

Project Assignment:

“The purpose of this assignment is to work in your group to create a PowerPoint presentation about the team project developed in the course. Include the following in the presentation:

  • Title
  • Context
  • Purpose of project
  • Target audience
  • Application of methods
  • Results
  • Recommendations
  • Sources (at least 10)
  • Images and pictures

The presentation should be a minimum of 6 slides and must include a short reflection on your experience conducting the project as a team.”

What is unclear in this purpose? Well, unless the objective of the assignment is to refine students’ presentation-building skills, it is unclear why students will be creating a presentation for a project that they have already developed. In this example, creating a presentation and providing specific details about its content and format looks more like instructions instead of a clear reason for this assignment to be.

A better description of the purpose could be:

“The purpose of this assignment is to help you convey complex information and concepts in visual and graphic formats. This will help you practice your skills in summarizing and synthesizing your research as well as in effective data visualization.”

The purpose statement particularly underscores transparency, value, and meaning. When students know why, they may be more compelled to engage in the what and how of the assignment. A specific purpose statement can promote appreciation for learning through the assignment (Christopher, 2018).

Examples of purpose statements

Below you will find a few examples of purpose statements from different subject areas.

Example 1: Application and Dialogue (Discussion assignment)

Courtesy of Prof. Courtney Campbell – PHL /REL 344

Example 2: An annotated bibliography (Written assignment)

Courtesy of Prof. Emily Elbom – WR 227Z

Example 3: Reflect and Share (Discussion assignment)

Courtesy of Profs. Nordica MacCarty and Shaozeng Zhang – ANTH / HEST 201

With the increased availability of language learning models (LLMs) and artificial intelligence (AI) tools (e.g., ChatGPT, Claude2), many instructors worry that students would resort to these tools to complete the assignments. While a clear and explicit purpose statement won’t deter the use of these highly sophisticated tools, transparency in the assignment description could be a good motivator to complete the assignments with no or little AI tools assistance.

Conclusion

Knowing why you do what you do is crucial” in life says Christina Tiplea. The same applies to learning, when “why” is clear, the purpose of an activity or assignment can become a more meaningful and crucial activity that motivates and engages students. And students may feel less motiavted to use AI tools (Trust, 2023).

Note: This blog was written entirely by me without the aid of any artificial intelligence tool. It was peer-reviewed by a human colleague.

Resources:

Christopher, K. (02018). What are we doing and why? Transparent assignment design benefits students and faculty alike. The Flourishing Academic.

Sinek, S. (2011). Start with why. Penguin Publishing Group.

Trust, T. (2023). Addressing the Possibility of AI-Driven Cheating, Part 2. Faculty Focus.

Yohn, D.L. (2022). Making purpose statements matter. SHR Executive Network.

I have always struggled with test anxiety. As a student, from first-grade spelling tests through timed essay questions while earning my Masters of Science in Education, I started exams feeling nauseous and underprepared. (My MSEd GPA was 4.0). I blame my parents. Both were college professors and had high expectations for my academic performance. I am in my 50s, and I still shutter remembering bringing home a low B on a history test in eighth grade. My father looked disappointed and told me, “Debbie, I only expect you to do the best you can do. But I do not think this is the best you can do.” 

I am very glad my parents instilled in me a high value of education and a strong work ethic. This guidance heavily influenced my own desire to work in Higher Ed. Reflecting on my own journey and the lingering test anxiety that continues to haunt me, it has become evident that equipping students with comprehensive information to prepare for and navigate quizzes or exams holds the potential to alleviate the anxiety I once struggled with.

Overlooking the instructions section for an exam, assignment, or quiz is common among instructors during online course development. This might seem inconsequential, but it can significantly impact students’ performance and overall learning experience. Crafting comprehensive quiz instructions can transform your course delivery, fostering a more supportive and successful student learning environment.

The Role of Quizzes in Your Course

Quizzes serve as diagnostic and evaluative tools. They assess students’ comprehension and application of course materials, helping identify knowledge gaps and areas for additional study. The feedback instructors receive through student quiz scores enables instructors to evaluate the effectiveness of the course learning materials and activities and understand how well students are mastering the skills necessary to achieve the course learning outcomes. This enables instructors to identify aspects of the course design needing improvement and modify and adjust their teaching strategies and course content accordingly. By writing thorough and clear quiz instructions, you support students’ academic growth and improve the overall quality of your course.

Explain the Reason

Explain how the quiz will help students master specific skills to motivate them to study. The skills and knowledge students are expected to develop should be clearly defined and communicated. Connect it to course learning outcomes and encourage students to track their progress against them (Align Assessments, Objectives, Instructional Strategies – Eberly Center – Carnegie Mellon University, n.d.).

Why did you assign the quiz? Would you like your students to receive frequent feedback, engage with learning materials, prepare for high-stakes exams, or improve their study habits?

Equipping Students for Successful Quiz Preparation

Preparing for a quiz can be daunting for students. To help them navigate this process, provide a structured guide for preparation. Leading up to the quiz, you may want to encourage your students to:

  1. Review the lectures: Highlight the importance of understanding key concepts discussed.
  2. Review the readings: Encourage students to reinforce their understanding by revisiting assigned readings and additional materials.
  3. Engage in review activities: Suggest using review materials, practice questions, or study guides to cement knowledge.
  4. Participate in discussions: Reflecting on class discussions can offer unique insights and deepen understanding.
  5. Seek clarification: Remind students to contact their instructor or teaching assistant for any questions or clarifications. You add a Q&A discussion forum for students to post questions leading up to the quiz.

Crafting Clear and Detailed Quiz Instructions 

When taking the quiz, clear instructions are vital to ensure students understand what is expected of them. Here’s a checklist of details to include in your quiz instructions:

  1. Time Limit: Explicitly mention the duration of the quiz, the amount of time students have to complete the quiz once they have started it, or if it’s untimed. Suggest how they may want to pace the quiz to ensure they have time to complete all the questions.
  2. Availability Window: You should specify an availability window for asynchronous online students. It refers to the time frame during which the quiz can be accessed and started. By giving an extended window, you allow students to take the quiz at a time that suits them. Once they begin, the quiz duration will apply.
  3. Number of Attempts: Indicate whether students have multiple attempts or just a single opportunity to take the quiz.
  4. Question Format: Provide information about the types of questions included and any specific formatting requirements. 
  5. Quiz Navigation: Have you enforced navigational restrictions on the quiz, such as preventing students from returning to a question or only showing questions one at a time? Share this information in the instructions and explain the reasoning.
  6. Point Allocation: Break down how points are distributed, including details for varying point values and partial credit.
  7. Resources: Specify whether students can use external resources, textbooks, or notes during the quiz.
  8. Academic Integrity Reminders: Reinforce the importance of academic integrity, detailing expectations for honest conduct during the quiz.
  9. Feedback and Grading: Clarify how and when students will receive feedback and their grades.
  10. Showing Work: If relevant, provide clear guidelines on how students present their work (solving equations, pre-writing activities, etc.) or reasoning for particular question types.

End with a supportive “Good Luck!” to ease students’ nerves and inspire confidence.

Crafting comprehensive quiz instructions is a vital step in ensuring successful course delivery. Providing students with clear expectations, guidelines, and support enhances their quiz experience and contributes to a positive and productive learning environment (Detterman & Andrist, 1990). As course developers and designers, we are responsible for fostering these optimal conditions for student success. Plus, as my father would say, it is satisfying to know you have “done the best you can do.”

References

Align Assessments, Objectives, Instructional Strategies—Eberly Center—Carnegie Mellon University. (n.d.). Eberly Center: Carnegie Mellon University. Retrieved June 28, 2023, from https://www.cmu.edu/teaching/assessment/basics/alignment.html

Detterman, D. K., & Andrist, C. G. (1990). Effect of Instructions on Elementary Cognitive Tasks Sensitive to Individual Differences. The American Journal of Psychology, 103(3), 367–390. https://doi.org/10.2307/1423216

Footnote: My son called as I was wrapping up this post. I told him I was finishing up a blog post for Ecampus. “I kind of threw Grandpa under the bus,” I said. After I shared the history test example, he said, “you didn’t learn much.” He and his sister felt similar academic pressure; I may have even used the same line about the best you can do. In my defense, he is now. Ph.D. candidate in Medicinal Chemistry and his sister just completed a Masters in Marine Bio.

Image by: pingebat, licensed from Adobe Stock

As higher-ed professionals involved in course design, we have the honor, privilege, and responsibility of shaping the learning experiences for countless students. Among the many tools at our disposal, course mapping stands out as a fundamental technique that deserves a spotlight. Couse mapping fosters clarity, and showcases alignment between the learning outcomes/objectives and course materials, assessments and activities. In this blog post, we will explore the importance of course mapping in online higher-ed courses, highlighting its role in meeting the new requirements in the recently updated Quality Matters (QM) rubric 7th edition. Join us as we delve into the transformative power of course mapping, benefiting course developers, instructors, instructional designers, and learners alike.

The Big-Picture:

The updated QM rubric (7th edition) recognizes the strength of course maps as a design tool, and has now made them a required element for course review. To quote the QM rubric update workshop (2023), “the course map must include all of the following components mapped to one another so the connection between them is apparent: course learning [outcomes/] objectives, module learning outcomes/objectives, assessments, materials, activities, and tools.” At its core, course mapping involves creating a visual representation of the entire course curriculum, breaking it down into manageable units, and illustrating the relationships between various components. This visual often takes the form of a table, but many variations exist. Course mapping is a holistic approach, which provides a roadmap for instructors, course developers, and designers to create a comprehensive, cohesive and well-structured learning experience; and for students to easily navigate and find the content and assignments. By explicitly relating the aforementioned course components, course maps simply demonstrate alignment and make clear the purpose of each element as part of the larger picture. 

Orchestrating a Symphony of Learning & Student Success:

With the implementation of the new QM rubric (7th edition), course mapping has gained significant prominence as a means of ensuring alignment and coherence across the curriculum.  By mapping out the weekly outcomes/objecives, learning activities, materials, tools, and assessments, instructors can ensure that each component of the course aligns with the overall outcomes/objetcives. This process can highlight pathways for students to progress logically through the content. Additionally, course mapping facilitates coordination among multiple instructors or instructional designers involved in a course, enabling a consistent design and a more harmonic learning experience for students. Much like a conductor of an orchestra, a course map provides the nuanced direction to each section. Harmony in a design means that elements are unified. Learners benefit from this because they more clearly connect their learning activities with a specific purpose. 

By imbuing the many learning activities with clear purpose (alignment to the outcomes/objectives), learners understand the work they are being asked to complete.  Mapping out course activities also provides instructors with a high-level view of their course, which helps ensure a balanced distribution of learning strategies, which can help accommodate a variety of learning needs. As a result, students are more likely to be engaged, motivated, and empowered to take ownership of their learning, which can lead to improved learning. Course maps act as a first step towards transparent course design, which empowers learners to take initiative and work through problems independently. If we give them all the pieces and help them make connections, they can forge their own pathway to success.

Efficiency and Continuous Improvement:

Course mapping also acts as a vehicle for efficiency and continuous improvement in higher education courses. By visualizing the entire course, instructors and instructional designers can identify potential gaps, redundancies, or misalignments, leading to more effective course revisions. Moreover, the iterative nature of course mapping promotes reflection and collaboration among course developers, instructors, instructional designers, and course reviewers, fostering a culture of continuous improvement. 

Additionally, for instructors the course map then acts as a blue print for the course, which can enhance the connection between the course elements, which can also be helpful if course outcomes/objectives need to change. For instance, courses with detailed maps might be more efficiently adapted, as instructors can easily identify parts of their courses that will need to change and know where to focus their energy.

Assessment and Accreditation – Meeting Quality Standards:

Accreditation bodies and quality assurance agencies like QM place a strong emphasis on clearly defined learning outcomes/objectives and assessment strategies. Course mapping provides a comprehensive framework for demonstrating alignment with quality standards or accreditation competencies. By mapping learning outcomes/objectives to assessments, instructors can provide evidence of student achievement and ensure that all necessary areas are adequately covered. This not only satisfies accreditation requirements but also enhances transparency and accountability within the course, program, and even the institution. At OSU Ecampus, we use the Ecampus Essentials list to ensure we are creating high-quality online and hybrid learning experiences. All Ecampus courses are expected to meet the essential standards and are strongly encouraged to meet the exemplary standards.

Conclusion:

As higher education professionals, we have a shared responsibility to provide transformative courses and programs that prepare learners for the challenges of the future. Course mapping stands as a crucial tool in achieving this goal by fostering alignment, engagement, and continuous improvement. As the new Quality Matters (QM) rubric (7th edition) recognizes, course mapping is an essential practice in creating intentional and effective courses. By investing time and effort in course mapping, instructors and instructional designers can craft coherent and purposeful learning experiences that empower students and maximize their potential for success.

Let’s embrace course mapping as a tool for success in online higher education, ensuring that our courses are meticulously crafted, intentional, and impactful. 

Course Mapping Tools:

  1. The Online Course Mapping Guide
  2. OSU Ecampus Course Planning Chart
  3. Berkeley Digital Learning Services Course Map Template (Public Use)
  4. University of Arizona Course Map Templates

Course Map Samples Shared in the QM Rubric Update:

  1. ACCT 3551 Course Map
  2. Course Alignment Map for HIS 121 American History to 1865

References:

Beckham, R., Riedford, K., & Hall, M. (2017). Course Mapping: Expectations Visualized. Journal for Nurse Practitioners, 13(10), e471–e476. https://doi.org/10.1016/j.nurpra.2017.07.021 

Digital Learning Hub in the Teaching + Learning Commons at UC San Diego. (n.d.). What is a Course Map? The Online Course Mapping Guide. Retrieved July 5, 2023, from https://www.coursemapguide.com/what-is-a-course-map

Quality Matters. (2023, May 22). QM Course Worksheet, HE Seventh Edition. Retrieved July 5, 2023, from https://docs.google.com/document/d/16d1mDaII_kgXvyjeT_brn-TKqACnr_OY_D_r5SnJlC0/edit 

This month brings the new and improved QM Higher Education Rubric, Seventh Edition! To see the detailed changes, you can order the new rubric or take the Rubric Update Session, which is a self-paced workshop that will be required for all QM role holders. In the meantime, if you’d like a short summary of the revisions, continue reading below.

The main changes include:

  • The number of Specific Review Standards has increased from 42 to 44.
  • The points value scheme was also slightly revised, with the total now being 101.
  • A few terminology updates were implemented.
  • The descriptions and annotations for some of the general and specific standards were revised.
  • The instructions were expanded and clarified, with new additions for synchronous and continuous education courses.

Most of the standards (general or specific) have undergone changes consisting of revised wording, additional special instructions, and/or new examples to make the standards clearer and emphasize the design of inclusive and welcoming courses. In addition, some standards have received more substantial revisions – here are the ones that I found the most significant:

Standard 3: There is a new Specific Standard: SRS 3.6: “The assessments provide guidance to the learner about how to uphold academic integrity.” This standard is met if “the course assessments incorporate or reflect how the institution’s academic integrity policies and standards are relevant to those assessments.” SRS 3.6 is the main addition to the 7th edition, and a very welcome one, especially considering the new complexities of academic integrity policies.

Standard 4: SRS 4.5 (“A variety of instructional materials is used in the course.”) has received an important annotation revision – this standard is met if at least one out of three of the following types of variety are present in the course: variety of type of media; different perspectives/representations of ideas; diverse, non-stereotypical representations of persons or demographic groups. I was really happy to see this clarification, since it’s always been a little difficult to evaluate what constitutes “variety”, and reviewers will certainly appreciate the recognition of diversity of people and ideas.

Standard 8: SRS 8.3 was divided into two separate Specific Standards: SRS 8.3 “Text in the course is accessible.” and SRS 8.4 “Images in the course are accessible.” At the same time 8.5 (former 8.4) was turned into “Video and audio content in the course is accessible.” This should allow for a more nuanced evaluation of the various accessibility elements, and it is nice to see the focus on captions for both video and audio materials. Moreover, these three standards (SRS 8.3, 8.4, and 8.5) now include publisher-created content – this is an important step forward in terms of advocating for all educational materials to be made accessible upfront.

In addition to the standards themselves, some changes were made to the Course Format Chart, the Course Worksheet, and the Glossary. Notably, a course/alignment map is now required with the Course Worksheet – a change that is sure to spark delight among QM reviewers. The definitions of activities and assessments were also revised to clarify the distinction between the two – another much-needed modification that should eliminate a common point of confusion.

Overall, the new edition brings about clearer instructions, more relevant examples, and a deeper inclusion of diversity, accessibility, and academic integrity. Reviewers and course designers should find it easier to evaluate or create high quality courses with this updated guidance.

track late assignments with a simple Canvas quiz

This fall and winter I worked with two instructors from very different disciplines to achieve a common goal – making their courses inclusive through a flexible assignment policy. Both courses gave students opportunities to recover without penalty from what would otherwise be a setback – a late, missed, or low-scoring assignment. Flexible assignment policies aren’t new, but instructors are now extending grace to students without the requirement to ask in advance, provide an excuse, or share official documentation, such as a doctor’s note. Our collective pandemic experience has revealed the inequity of having the instructor adjudicate the validity of the excuse, as well as the impracticality of producing documentation on demand. (Can you readily access a doctor when you’re too sick to work? If you could, wouldn’t that take up time and energy you’d rather use to complete the work itself?) Finally, as a third instructor commented to me, simply reading the traumatic narratives that students share voluntarily (let alone requiring these excuses) implicates her in a form of voyeurism. Discomfort aside, students’ entreaties take up time, requiring at least one exchange of emails, and that can fill up the inbox and prove hard to track over the course of the term.

As an elegant fix, the courses I’ve worked on explicitly state in their syllabi and assignments that no reason is required and that permission is granted automatically – eliminating the need for email back and forth and the inequitable requirement for justification. This policy fit the goals of both instructors – one who was interested in student retention in a difficult course, and the other who had implemented a labor-based grading approach to extend greater agency to 100-level, Gen Ed students.

But the instructors still needed a way to track the excused assignments. So what’s clever and new (to me) about these courses is how the instructors and I executed the policy in our LMS – a graded Canvas quiz (in a 0% weighted assignment group so as not to interfere with the final grade) that inquires only about the logistics:

  • What is the assignment? (Be as specific as possible.) 
  • How are you using this particular opportunity for flexibility (of the three opportunities granted)? (The assignment is late/missing/requires revision.) 
  • When will you turn it in? (This helps me grade it promptly.)

Because the quiz is set to accept just 3 attempts, the instructor doesn’t need to manually tally the number of permissions already granted. And once the student fills out the quiz, safe in the assumption that permission has been secured, they can get down to the business of completing their work, without shame or delay.

One instructor framed these opportunities as “tokens,” like the tokens you spend at Chuck E Cheese — they’re only good when you’re in the establishment, so while it’s great if you finish the term without needing to use them, there’s no particular reason to save them up! “Tokens are my acknowledgment that we all make mistakes, misread instructions, and that life things come up. We falter. Use a token!” (“What are tokens in this class?”, Dr. Jenna Goldsmith). The Canvas quiz was termed a “Token Tracker,” complete with a cartoonish golden coin icon. By week 6 of the term, just short of half the students had availed themselves of it.

I was excited to learn of these instructors’ policies and to help craft their execution in Canvas. If you’d like to try out this inclusive assignment policy, or have an idea for another policy that will be unfamiliar to students, consider how you can use the tools at hand to present the policy as easy and natural — as much a part of our standard operating procedures as the old, inequitable way of doing things. Students will be more likely to benefit that way.

With gratitude to Dr. Jackie Goldman, who first shared the idea of an automated “extension quiz,” and Dr. Jenna Goldman, who adapted the quiz for use in her course.