red lightbulb

Photo by Terry Vlisidis on Unsplash

Last Time on SDT & Online Education…

This post is a continuation of my previous blog posts on Self-Determination Theory (SDT) and Online Education and a companion post to Chris Lindberg’s series of posts, Games as a Model for Motivation and Engagement.

In my last post, I posed some difficult questions to consider as you start thinking about how you use grades and motivation in your courses. In case you missed that post, here are the questions—I invite you to spend a few minutes, hours, or days with these questions before moving on with the rest of this blog post:

  • Do you use grades to create external regulation of behavior in your course?
    • Are you grading a behavior or the demonstration of a skill?
  • Do you want to emphasize performance goals or mastery goals?
  • Are there ways to help students identify and integrate the activities and assessments in your course?
  • Do you need to grade this activity/assessment/task?

Why are you grading?

“The troubling truth is that rewards and punishments are not opposites at all; they are two sides of the same coin. And it is a coin that does not buy very much.” (Kohn, 1993, p. 50)

When I first started teaching, I remember asking a colleague if they would review my syllabus draft. They read the attendance policy and asked me something along the lines of, “Why are you grading this? Does it have anything to do with the outcomes of your course?” I probably spewed the usual talking points that students do better in class when they attend, I wanted them to come to class, etc. The reply: “So, do you want to grade learning, or behavior?” That question rocked my world as a young teacher. And made me question everything.

Why do we use grades? Numerous studies have shown that grades and rewards, especially for intrinsically motivating activities such as learning, have detrimental effects. And what do these grades communicate? In terms of SDT, “grading in educational contexts has two functions. One is providing competence-relevant feedback to students, presumably as an aid to enhancing subsequent performance … A second is gatekeeping. Grades can be used to make sure that only students who have mastered material and are thus qualified are eligible for higher training…” (Ryan & Deci, 2017, p. 371). What does an A, B or F communicate to you? For Ryan & Deci, grades by themselves provide little in the way of relevant feedback. (For more on effective feedback, see Wiggins, 2012.)

So can a “grade” be useful? In the context of SDT, there needs to be important information communicated to students about how they’re doing and where they need to spend more attention and effort. In order for this to be autonomy-supportive, it should be informative for the learning process and not judgmental, pressure-inducing, or a social comparison, both in terms of being a reward or a punishment. For example, “Great work. You might consider adding an example in your third paragraph.” is not informative toward the learning process; “You do a great job of defining the problem in your third paragraph, which is an improvement from your first draft. Adding an example would do even more to help your readers relate to this problem.” is an example of feedback that informs a student about where they have come from and where they still need to go.

Performance vs. Mastery

“There do, indeed, seem to be few empirical or theoretical supports for the motivational or competence-building advantages of classical grading schemes. Yet, in most school settings, grades and evaluations are employed as if they were the key to motivation, when, in fact, especially for those who need competence supports, they are likely to be undermining influences.” (Ryan & Deci, 2017, p. 371)

Is it possible to see a letter grade of your work in a course outside the context of social comparison? How often is a B simply viewed as “better than average” or “in the top half of the class”? Focusing on performing a certain way relative to others is a performance goal, while focusing on increasing competence or learning is a mastery goal. (For more on this topic, see Elliot, 2005.) Additionally, each category of goal has an approach type (seeking to achieve something) and an avoidance type (seeking to avoid something). Multiple studies have found that the performance-avoidance combination has the most detrimental outcomes for both learning and student well being, and that this combination is adopted most when students have expectations of being graded (Ryan & Deci, 2017, p. 373).

Ungrading

“…the grading system that higher education in the United States has relied on for many decades has serious problems. It does not work in anyone’s interests, and it genuinely hurts those most directly associated with it: the faculty and the students. In fact, the system is broken.” (Nilson, 2015, p. 23)

At this point you might be asking, “what am I supposed to do?” There are numerous tools, resources, alternatives, and considerations when thinking about using or eliminating grades in a course, such as self-assessment, student-created rubrics, or specifications or criterion-based grading. (Several more are listed in the Reference & Resources section below). One option is to eliminate grading all together, which some institutions have done. If you aren’t ready to eliminate all your grades, try focusing on providing students with feedback in an autonomy-supportive way and empowering them to learn the valuable skill of self-assessment. Without rewards and punishments, students will feel a greater sense of competence; self-assessment and valuable and informative feedback will give students a greater sense of autonomy—that they’re in the driver’s seat for their own learning; with an increased focus on communication about learning, students will also gain a greater sense of relatedness.

There is much more to the topic of grading and ungrading than can be covered in a single blog post, so I’d like to invite you to check out the references and resources below, add your comments, suggestions, and experiences in the comments, contact your instructional designer, or keep an eye out for other opportunities to continue the discussion at various upcoming Ecampus events!

References & Resources

Center for Self-Determination Theory (CSDT). (2019).

  • This website is a treasure-trove of resources on SDT and its application in numerous fields, including education.

Elliot, A. J. (2005). A conceptual history of the achievement goal construct. In Elliot, A. J., & Dweck, C. S. (Eds.) Handbook of competence and motivation (52–72). New York: Guilford Press.

Flaherty, C. (2019). When grading less is more. Inside Higher Ed.

Kohn, A. (2018). Rewards are still bad news (25 years later). New York Times.

Kohn, A. (2011). The case against grades. Educational Leadership.

Kohn, A. (1993). Punished by rewards: The trouble with gold stars, incentive plans, A’s, praise, and other bribes. Boston: Houghton Mifflin.

Nilson, L. (2015). Specifications grading: Restoring rigor, motivating students, and saving faculty time. Serling, VA: Stylus.

Ryan, R. M., & Deci, E. L. (2017). Self-Determination Theory: Basic psychological needs in motivation, development, and wellness. New York: Guilford Press.

Stommel, J. (2018). How to ungrade.

Wiggins, G. (2012). Seven keys to effective feedback. Educational Leadership 70(1), 10–16.

A new Ecampus project has underscored the potential of graduate teaching assistants (GTAs) to add immense value to the process of reviewing and improving courses by thinking both as an instructor and as a student. Ecampus analyzed data and collaborated with partners in academic departments to identify five courses in which students were experiencing barriers to success that were not being addressed in Ecampus’ rigorous course development and support process. The academic departments also identified five pedagogically-minded and innovative GTAs to analyze and begin addressing the barriers to student success. The result is a pilot that we believe will be beneficial for the students, the GTA Fellows, and the faculty, while also providing learning opportunities for all stakeholders about how to tackle the most challenging course design problems. While we’re still in the first term of the pilot, our collaborative investigation process and emerging creative solutions have already made us very excited about the findings to come. 

Determining first steps 

At Oregon State Ecampus, we have a strong framework to help support and maintain course quality.  Courses are carefully and thoughtfully designed through a collaborative effort between a faculty course developer who has received training in online course design best practices and an Ecampus instructional designer. The development process spans from the two term initial design and build period, where we ensure courses meet our set of Ecampus Essentials, to iterative first term adjustments, to support for continued lifetime maintenance, to formal course “refreshes” every 3-5 years.  Finally, many of our courses are also submitted for and earn Quality Matters certification, which is an important indicator of quality based on research-based standards. This rigorous and supportive development process aims to make sure the course continues to stay relevant, accessible, and effective for learners.

But, in spite of all this careful planning, development, review, and maintenance, what is the appropriate response when courses have recently come through this rigorous and comprehensive design process, faculty have been trained in best practices for teaching online, and students are still encountering barriers to success in the course?

We recently launched a new pilot project to tackle this question head-on.  As a starting point, and using a few basic indicators of student persistence, retention, and success in our courses — such as the DFWU rate, or a rate at which students receive grades of D, F, W (withdrawal), or U (unsatisfactory)  — we created an initial list of courses across our online offerings where students were least successful in passing or completing. From this list, we identified which courses had been redesigned within the last five years (to rule out our standard redevelopment process as a solution to increasing student success).  The latter group of courses underwent some additional review by our team to identify if there were any stand-out issues that could be easily resolved.

What we arrived at was a short-list of courses that had higher than usual DFWU rates and were redesigned recently.  In these courses, we knew that something else was going on beneath the surface; the underlying problem was neither an obvious issue with design or facilitation techniques.  Many of the courses on this short-list are problematic not for a high rate of D/F/U grades at the end of the term, but rather for a high rate of W (withdrawal) grades. Our Ecampus student population is largely comprised of non-traditional students who have a different set of needs than our more traditional on-campus students, namely in that they need flexibility to balance their busy out-of-school lives while also meeting their educational goals; so, through this pilot, we wanted to find an effective way to determine what could be changed to better support Ecampus students in staying in (and succeeding in) these courses that were particularly challenging for reasons we could not easily identify.

Designing the pilot

With these course profiles compiled, we reached out to five department partners to assess their interest in collaborating on a project to further review and revise a course (or, in some cases, a sequence of courses).  We proposed to fund a Graduate Teaching Assistant (GTA) for three consecutive quarters to evaluate and then to propose and implement innovative interventions in these targeted courses with an eye toward increasing online student success.  In general, pilots are following the below schedule:

  • Quarter 1: the GTA is an active observer of the course(s), and reviews previous sections’ data to look for patterns in obstacles that students might face; in collaboration with the faculty course lead and Ecampus staff, the GTA then proposes a first set of interventions for quarter 2; IRB approval of research is confirmed if necessary for design of interventions and/or for desire for possible future publication.
  • Quarter 2: the GTA continues to be an active observer in the course(s) and helps to implement the first set of interventions; in collaboration with the faculty course lead and Ecampus staff, the GTA then proposes new or refined interventions for quarter 3.
  • Quarter 3: the GTA continues to be an active observer in the course(s) and helps the instructor to implement the new or refined interventions; data reporting is wrapped up and a campus presentation is arranged.

Note that, across the three quarters, the GTA does not undertake the traditional tasks associated with a teaching assistant in an online course, such as grading assignments, responding to student questions, holding virtual office hours, etc., modeling our pilot on fellowship programs such as Duke University’s Bass Digital Education Fellowships.  Rather, all stakeholders agreed to allow the GTA to not be constrained by these time-consuming tasks and focus their efforts instead on observational work and then planning and implementing interventions.  The instructors assigned to these courses continue to take on their regular duties of interacting with and assessing students.

The unique advantage of GTAs

With our five unique pilots underway as of this summer, it has already become clear that the key to this pilot is the unique positioning of the GTA to tackle these student success problems from both the faculty and student perspectives.  At Oregon State, GTAs regularly serve as teaching assistants or instructors of record in on-campus, hybrid, and online courses, so our GTAs have come to these pilot projects with prior teaching experience (and, often, with some training in pedagogy and course design).  Yet, our pilot program GTAs are also still students themselves, so they are particularly attuned to the student experience as they follow and track current and upcoming groups of students working through these courses.

Our pilot will also benefit from the fact that these GTAs have a strong interest in pedagogy and in their own professional development as instructors.  With that in mind, we have worked to structure some of the individualized goals of each pilot to reflect how we can help the GTA get the most value out of this opportunity (such as through a campus presentation, a published paper when we have results, or connecting with Ecampus leaders as possible references for job applications).  The final name for our pilot – GTA Innovations for Student Success Fellowship – is crafted both to reflect the central goals of the pilot (student success) and to call out the important and unique work that GTAs are doing as fellows.

Looking forward (to sharing innovative interventions and results)

We are still in the very early stages of each of these pilots, so while we don’t yet have any results to share, the deep engagement of our stakeholders in this process has been heartening, and wonderful plans are in the works for the first sets of interventions to be implemented this fall.  We are also so pleased to see the support behind allowing this group of GTAs inspire innovative online teaching within their home departments, and the willingness of the faculty who teach the courses under review to think collaboratively and differently about the creative ways we can support their online students.

As part of their pilot work, we will encourage these GTAs to contribute to the blog and share their insights and takeaways along the way.  What they learn about how to support student needs in these particularly challenging courses and course sequences, learning design, teaching methods that better motivate disengaged learners, etc. will no doubt be useful to Ecampus stakeholders across the university and beyond.  Stay tuned for more!

As a stranger give it welcome.” – Shakespeare

Students need tactics for when they encounter strange people or strange ideas. (Wilson, 2018) First-time online students are a perfect example of individuals who are encountering something new, strange, and often uncomfortable, for the first time. Welcoming that strange experience should include a little bit of information gathering. Look for positive and negatives in situations to help decide how you view it and, most of all, have an open mind.

To help potential online students make decisions, when they take their first online course, Marie Fetzner asked unsuccessful online students: “What advice would you give to students who are considering registering for an online course?”

Their top 13 responses:

  1. Stay up with the course activities—don’t get behind
  2. Use good time management skills
  3. Use good organizational skills
  4. Set aside specific times during each week for your online class
  5. Know how to get technical help
  6. A lot of online writing is required
  7. There is a lot of reading in the textbook and in online discussions—be prepared
  8. Regular online communications are needed
  9. Ask the professor if you have questions
  10. Carefully read the course syllabus
  11. Be sure you understand the requirements of the online course discussions
  12. Understand how much each online activity is worth toward your grade
  13. Go to the online student orientation, if possible

 

These responses raise the question: how can we better help our students? From the advice above, we know students struggle with time management, expectations, communication, etc.  So, what can we do to help foster their success?

  1. Reach out to students who seem to be lagging behind. A quick email is sometimes all it takes to open up that line of communication between you and the student.
  2. Provide approximate times for course materials and activities. Students can use this to better plan for the requirements that week.
  3. Keep your course organized so students can spend more time with the content instead of search for the content.
  4. Remind students about where to access help and support services.
  5. Develop a Q&A discussion board for student questions about the course. Often, more than one student has the same question and often other students might already know the answer. Have this be something you check daily to answer questions quickly so students can continue with their learning.
  6. Use rubrics for grading. By giving the students rubrics, they will know what is expected, you will get responses closer to your expectations, and it makes grading easier!

 

Welcome these ideas as you would a new experience. Give it a little try, jump right in, confer with colleagues, or chose your own path. Know that as an instructor or developer for an online course, you have the ability to help your students be successful!

References

Fetzner, Marie. (2013). What Do Unsuccessful Online Students Want Us to Know? Journal of Asynchronous Learning Networks, 17(1), 13-27.

Wilson, J. (2018). “As a stranger give it welcome”: Shakespeare’s Advice for First-Year College Students. Change, 50(5), 60.

 

So, you’re thinking about offering virtual office hours in your online class. Your instructional designer is thrilled! Virtual office hours are a great way to promote social connection and build community with your students.

But, you’re nervous. Maybe you’ve tried offering virtual office hours before. Maybe you’ve heard from colleagues that students aren’t going to show up to your office hours. Maybe one student will show up. Maybe five. Or three. Or none. Maybe you’re not sure how to prepare. You want your students to come with questions. Maybe your students will come with tons of questions. Maybe they won’t.

Just as you can’t–or shouldn’t–teach an online course in the same way that you would teach an on-campus course, you also shouldn’t structure your virtual office hours in the same way you structure your face-to-face office hours. On-campus students already have face time with you and their peers in class. If your on-campus students come to your office hour, it’s likely because they have a question for you. Online students may have other reasons for attending your office hour. Given, not just the different modality, but the different reasons online students choose to attend an office hour, virtual office hours implemented into a primarily asynchronous online course, require thoughtful planning.

The research article, “Live Synchronous Web Meetings in Asynchronous Online Courses: Reconceptualizing Virtual Office Hours” (Lowenthal, Dunlap, & Snelson, 2017) explores how to successfully conduct online office hours in primarily asynchronous online courses. The article focuses on group office hours, but synchronous student-student and instructor-student interactions are worth considering as well. While I would encourage you to read the entire paper, I’d like to summarize some of the “implications for practice” highlighted in the article. The paper includes 21 implications for practice. Here are a few to consider for your online course:

  1. Rebrand your office hours. For better or for worse, we all have preconceived notions about what an office hour entails. Be thoughtful about your goals for the virtual sessions, renaming them to reflect how the time will be used, the level of formality, or the structure. Examples from the research article include, “Happy Hours, Coffee Breaks, Afternoon Tea, Bat Cave…Around the Campfire….Consultations, Design Studio, Conference Room, Headquarters, and Open Space.” (188)
  2. Schedule them in advance–ideally at the beginning of the quarter–and vary the days and times to accommodate different schedules and timezones. Providing ample notice and opportunities on various days and times is especially important as online students are often juggling home, work, and school responsibilities.
  3. Provide reminders via email or announcements.
  4. Prompt students for questions prior to the live sessions.
  5. Then, record the live session. That way, students can still ask a question, have it answered, and watch later if they’re unable to attend the live session.
  6. Post the recording in an announcement, so that it is easy to find.
  7. Start the session with an ice-breaker.
  8. Consider offering some brief direct-instruction or inviting a guest speaker.
  9. Incentivize students to attend by making the experience engaging and relevant–and giving them an agenda before the session.

While virtual synchronous interaction isn’t usually required in Ecampus courses, it is an option that, when thoughtfully implemented, can enhance the teaching and learning experience. If this is an approach that you’re interested in exploring, reach out to your instructional designer, and they can help you implement it in a way that is equitable for all students.

References:

Lowenthal, P. R.; Dunlap, J. C. & Snelson, C. (2017). Live synchronous web meetings in asynchronous online courses: Reconceptualizing virtual office hours. Online Learning 21(4), 177-194. doi: 10.24059/olj.v21i4.1285

Image credit:

Photo by rawpixel on Unsplash

Sunrise, Eureka, NV, 12/30/2017
Sunrise, Eureka, NV, 12/30/2017, on highway 50, the longliest road in America

Beauty is everywhere and in every moment, if we pay attention. I saw this beautiful sunrise driving by Eureka, Nevada on Highway 50, the loneliest road in America, during the tail of my one-week road trip vacation. Similarly, good teaching practices are flourishing in OSU online courses as we discover from our talks with Ecampus instructors. To inspire you to expand your teaching toolkit, here are some ready to use online teaching tips from the book “Small Teaching: Everyday Lessons from the Science of Learning” by James Lang. 

Teaching Strategies Online Teaching Tips
Retrieving

  • Syllabus Quiz
  • Weekly reading journals
  • Frequent quizzing such as quizlet practices or weekly quizzes
predicting

  • Pretesting with immediate grading and immediate feedback including exposure of content teaching;
  • Role play: how might a person in a different role approach the problem?
  • Asking students to predict what will be covered in next week’s lesson/reading, etc..
 

Interleaving

  • Open or close each class session with small opportunities for students to retrieve older knowledge, to practice skills developed earlier in the course, or to apply old knowledge or skills to new contexts.
  • Weekly mini review session applying that week’s content to some new question or problem.
  • Stagger deadlines and quiz dates to ensure that students benefit from the power of spaced learning.
Connecting

  • Solicit the prior knowledge of your students at the beginning of the term or individual lesson (such as private journaling or public introductory discussion)
  • Ask students to create concept maps that answer questions or solve problems; use concept maps multiple times throughout the semester with different organizational principles.
  • As much as possible, offer examples or cases from everyday or common experience but also – and more importantly – give students the opportunity to provide such examples on their own.
Practicing

  • Before the semester begins, brainstorm a comprehensive list of cognitive skills your students will need to develop to succeed in your course. (Identify Learning outcomes)
  • Prioritize them; decide which ones students will need to develop most immediately and which ones can emerge only after they have developed some basic skills.
  • Review your course schedule and decide where you can make space for small practice sessions in key skills prior to your major assessments; mark those sessions on the syllabus schedule.
  • Prior to any major assessment, ensure that students have had multiple opportunities to practice the skills they will need to do well, from creating slides or writing paragraphs to answering multiple-choice questions.
Self-Explaining

  • For online homework or readings, create spaces for students to self-explain while they work; 
  • When students are demonstrating their homework, create a regular schedule of opportunities or requirements for them to self-explain their process.
  • Use Peer Instruction: students provide an answer, pause and explain it to their peers, and then revise their answers.
  • In all forms of self-explanation, push students to tie their knowledge of information, principles, theories and formula to the specific task they are completing.
Motivating

 

  • Spend time to get to know your students; learn about their lives and their interests, creating a positive social atmosphere in the virtual class space.
  • Open each lesson by eliciting student emotions: give them something to wonder about, tell them a story, present them with a shocking fact or statistic. Capture their attention and prepare their brains for learning.
  • Consider how practitioners in your field, or the skills you are teaching them, help make a positive difference in the world; remind them continually about the possibilities that their learning can do the same, from the opening of the course.
  • Keep the overarching purpose of any lesson/ learning activity in view while students are working. Make it clear why they are doing this activity.
  • Show enthusiasm for your discipline, for individual texts or problems or units, and for your hope that they will find them as fascinating as you do.
Growing

  • Provide early success opportunities through assignment sequencing or assessment design;
  • Consider offering some reward for effort or improvement in the course (heavier weighting of your assessment toward the latter half or through a portion of the grade set aside for that purpose)
  • Provide examples of initial failures or setbacks in your own intellectual journey or in those of famous or recognizable figures in your field to demonstrate that such failures can be overcome.
  • Give feedback to students in growth language; convey the message that hey are capable of improvement, and offer specific instructions on how to achieve the improvement.
  • Ask top students to write letters to future students about how they succeeded in the course; select and pass along the ones that highlight the power of effort and perseverance.
  • Include a “Tips for Success in this course” section on your syllabus, and refer to it throughout the semester.
Expanding

 

  • Commit to reading at least one new book on teaching and learning every year.
  • Subscribe to an e-mail list from Faculty Focus or Chronicle of Higher Education
  • Create a personal learning network on Twitter.
  • Attend a conference on Teaching and Learning in higher education (the Teaching Professor  or the Lilly Conference on College and University Teaching)
  • Attend events on campus sponsored by Center for Teaching and Learning.

Lang, J. (2016). Small Teaching: Everyday Lessons from the Science of Learning. San Francisco, CA: JosseyBass.

If you have good strategies for enhancing online teaching and learning, feel free to share with us by email EcampusFacultySupport@oregonstate.edu.

Have a wonderful winter 18 term!

If you’d like to adopt group work in your online course, but want to ensure accountability among your students, consider asking your students to create a group contract to guide their work. Beginning online group work with a mutually agreed upon contract creates a blueprint for the project, and it facilitates the process of students establishing norms and expectations within their group. These norms help to remove the instructor as the sole authority figure, and instead give the team the power to hold one another accountable, according to the guidelines they agree upon, rather than just personal opinions or perceptions.

One way to help your students begin to think about what to include in their group contract is to initiate a conversation with your students about their preconceived notions of group work. Have they done group work before? Have they had good or bad experiences? Ask your students to clarify what ideal group work looks like to them and what specific things they hope to avoid. A discussion about their past experiences may also help your students to better understand their peers’ perspectives and what skills they bring to the team. Key areas for your students to consider and map out in their contract are:

  • Roles and participation responsibilities
  • Communication expectations (mode and frequency)
  • Project timeline/milestones
  • Conflict resolution plan
  • Consequences for breaking contract

To get you started, take a look at these sample group contracts that you can adapt to fit your needs:

References

  • Barkley, E.F. (2010). Student engagement techniques: A handbook for college faculty. San Francisco, CA: Jossey-Bass

Additional Resources

chirbit
Providing feedback to students is a critical component in any course and perhaps even more important in an online course where the instructor and students are not in the same physical space. Although written feedback is the primary method used when providing feedback to students, some instructors are turning to the use of audio feedback and finding that it is both easy to do and effective. Research has shown that audio feedback can allow for more nuanced messages to the student. It has also been shown to involve the student more deeply in a class and make them feel that the instructor really cares. One study even found an association between the use of audio feedback and better retention of course content.

There are several online tools that allow you to create and share audio clips easily. One that I’ve used recently is Chirbit. You only need a microphone and you can record clips up to five minutes in length. There is no limit to the number of audio posts that you can share on Chirbit. Once you create an audio clip you can mark it as private and then share the link that is provided with your student. Chirbit has a number of other capabilities for sharing clips that you can explore even further, including the ability to attach transcripts or QR codes directly to audio clips.

Consider choosing one assignment next term that you could experiment with by providing audio feedback to students. Some instructors have reported that giving audio feedback is actually more efficient for them than giving written feedback. It is definitely another way to extend your presence in the online classroom.