Course Design/Learning Design « Ecampus Course Development and Training

Why Peer Review?

According to a study by Leadership IQ, 26% of new hires fail because they can’t accept feedback (Murphy, 2015). Most students are trained to study for grades and have seldom been given enough training on how to receive feedback and how to make feedback work for them. By the time they enter workforce, they will have a hard time facing feedback from coworkers and supervisors. As instructional designers and instructors, we can help by training students in peer review skills. In doing so, we are preparing our students to be successful in their future career on the one hand; on the other hand, instructors will spend less time grading peer reviewed submissions because of the improved quality of work submitted. It’s a win-win solution. Nothing could get better than this in teaching, right?

How to Create Peer Review Assignments in Canvas?

There are two types of peer review assignments.

Writing assignments with peer review process where peer review effort is not heavily graded. The focus is on improved writing.
Writing assignments with peer review process where peer review efforts is heavily graded. The focus is on training students in peer reviewing.

If your students lack peer reviewing skills, instructors can provide tutorials on how to provide feedback constructively. And instructors can also set up practice assignments where peer review is graded, for at least one or two assignments so that students are given the proper training and practices they need. Here is a video tutorial on how to provide constructive feedback.

If your students have been trained in peer reviewing, I recommend the type of assignments where peer review is not heavily graded. Peer review can be extra credit points, or a small portion of the grade.

To set up peer review in Canvas for an assignment, Log into Canvas course as an instructor/designer, go to the assignment, click “Edit” button to edit the settings for the assignment.

It will greatly help students if you provide clear directions for how you expect students to conduct peer review.

banner image of BA 347 International Business

For example, in BA 347 Research Writing Assignment, the instructor provided the following directions: “Peer Review Feedback guidelines: As you conduct your peer review, remember to praise, criticize appropriately, and be specific with revision strategies.

Identify and describe three strengths in this draft.
Identify and describe three weaknesses in this draft.
How does this draft meet the requirements of the assignment? If not, what is missing?
What should be revised in this writing? Why?
After reading, I was left wondering….”

To set up details for peer review, first we set up a due date for when the draft writing will be due and enter the date in the assignment “Due” area. Secondly, check “Required Peer Reviews” box to enable peer review, and how to assign peer review (manually or automatically), if automatically, enter a number for how many peer reviewers will be automatically assigned for each submission and enter a date for when the peer reviewers will be assigned in the “Assign Reviews” area. Lastly, enter a date in the “Available from … until” area for a “until” date as the date for when the peer review will be due. And explain to your students what these dates mean if this is the first time you assign peer review assignment in your course.

Peer Review Set up in Canvas — How to set up peer review assignment in Canvas. date 1: Individual draft due date; date 2: Peer Reviewers assigned date; date 3: Peer Review due date and assignment becomes unavailable after this time.

Image 1: Canvas Assignment Peer Review Option Set Up

Grading peer review

Once all of the peer reviews have been submitted, if instructors would like to access the actual comments, assess, or add comments of their own, they can do so by going to the speedgrader function. To grade the original submission, simply enter grade point in the Assessment “Grade _____ out of 10” area.

Image 2: Grading Assignment

To grade peer review effort, the instructor would need to set up a separate assignment and name it something like “Peer Review Grade”. Some instructors attach peer review rubric forms so students can attach the forms in the submission for Peer Review Grades. See a youtube video example and its web instructions.

References:

Murphy, M. (2015). Why New Hires Fail. Retrieved on November 17, 2015, from http://www.leadershipiq.com/blogs/leadershipiq/35354241-why-new-hires-fail-emotional-intelligence-vs-skills

Alisa Cooper’s post “Conducting Peer Review Assignments in Canvas” at http://freshmancomp.com/2013/02/19/conducting-peer-review-assignments-in-canvas/

TEXT(S)

There’s been some discussion recently about students and lectures and attention spans.* As conversation about this turned to how students grapple with long form texts in an online course, I thought it might be useful to gather some ideas on course design and working with texts in online courses.

The initial page of the Peterborough Chronicle, marked secondarily by the librarian of the Laud collection. The manuscript is an autograph of the monastic scribes of Peterborough. The opening sections were likely scribed around 1638 (See document). The section displayed is prior to the First Continuation. — The initial page of the Peterborough Chronicle (annotated monastic text)

Structure your course around the texts not the weeks

Some instructors structure their reading intensive course around the books that are read. A module per book with multiple discussion boards and prompts per book. This subtly shifts the focus from what am I doing this week to what is this book doing. For example, in ENG 210 Literatures of the World: Asia, Jeff Fearnside structured the course around the five books they were reading.

Banner depicting a 3D model of the Blue Mosque in Turkey — Banner for the module and book on Turkey

Other course elements allowed summative reflections and integrative questions to address themes throughout the course.

Shift format away from only reading and writing.

If reading, multiple books you might change how students interact with one or more of the books.

In engaging with a text, students might:

watch a play rather than read it
listen to a poem rather than read it (For example, this recording of The Waste Land – poem begins at 16:10)

In responding to a text, students might:

create a video journal or podcast as they progress through text(s)
tweet (or write within 140 characters) summaries of characters or plot themes (similar to the idea of Tweet your thesis)
build a timeline of the narrative (for example, this timeline of Russian History created with student entries for Betsy Ehler’s RUS 233: 20th Century Russian Culture course)

Check for understanding

I’m wary about the idea of reducing student engagement with a text to quizzes but as a feedback mechanism as part of a process and on the way to richer engagement I think quick polls, quizzes, or surveys have a role. You could have quick short post reading quiz or survey to figure out if the students have followed the reading. This would let you respond before the students get further along and further behind.

Other interpretative tools

Pie Charts (Shakespeare) - Link out to a collection of images on flickr analyzing word counts of characters in the plays — Collection of Images Analyzing Word Counts for Characters in Shakespeare’s Plays

There’s a whole range of interpretive tools Digital Humanities tools and engaging with them is well beyond this blog post. However, many projects have available outputs in some form that instructors or students can draw on as they grapple with texts.

A great starting point to explore digital humanities would be to take a look at this overview & contact Jane Nichol the emerging technologies librarian. And as you think through how to use these tools in your course

One example of the type of output you might find is this collection of visualizations of the word counts in Shakespeare’s plays

Collaborative writing and commenting

There are also other ways to dialogue around a text – especially when it’s a short dense text with lots of debate and discussion around the text. There are examples of creating your thesis on a blog as you write or using github or a federated wiki as collaborative authoring tools. However, for many courses google docs (which is integrated into canvas) offers a fantastic, known, and private tool for a course to create a document.

A manifesto for teaching online

As a open experiment let me invite you to engage with a text. The Digital Education team at the University of Edinburgh recently released their 2015 Manifesto for teaching online. There’s a lot to think about in their manifesto and how it works or doesn’t work in our context. Please join in and add your voices this copy for comment – an annotated ‘manifesto for teaching online’. **

*The statement spun off a conversation triggered by the NYT opinion piece on lectures, (which I can’t mention without also noting this thoughtful response)

**If you want to author a new pathway through the text or add resources beyond what comments allow request an account and I’ll add you to the project.

There is an exciting new feature in Blackboard which will help instructors provide more detailed feedback in less time. This is the rubrics feature.

What are they?

Rubrics are tables of assessment. Blackboard uses the most common layout, which has columns of proficiency with the greatest levels of achievement on the right moving down to the lowest levels on the left. The rows indicate what is being measured. For example, a piece of writing may be assessed on measures of grammar, structure, clarity, formatting, and citations. Points are attached to each aspect being assessed, with the highest possible points in the right column. Different aspects can have different values. For example, perhaps the focus of this assignment was proper citations, so these would have higher values than grammar or structure, but in another assignment in a future week another rubric could be used in which clarity is the focal point.

Why should I use them?

Measure multiple aspects on one assignment
Save instructor time during grading
Ensures fairness while grading
Guidance for students while completing assignment
Ability to be re-used for multiple assignments

How do I make it happen?

Rubrics can be built right into Blackboard and utilized time and time again. Once you create a rubric, that same rubric can be modified to work for other assignments so there’s not a need to start from scratch. Learn how! (linked) http://oregonstate.edu/instruct/dce/walkthroughs/Rubrics/story.html

Need inspiration?

Here are some examples from the Center for Teaching and Learning to help.

Thinking Rubric (Linked) http://oregonstate.edu/ctl/thinking

Communication Rubric (Linked) http://oregonstate.edu/ctl/communication

Collaboration Rubric (Linked) http://oregonstate.edu/ctl/collaboration

Share your experience with rubrics! Click on “Leave a Reply” below.

Providing feedback to students is a critical component in any course and perhaps even more important in an online course where the instructor and students are not in the same physical space. Although written feedback is the primary method used when providing feedback to students, some instructors are turning to the use of audio feedback and finding that it is both easy to do and effective. Research has shown that audio feedback can allow for more nuanced messages to the student. It has also been shown to involve the student more deeply in a class and make them feel that the instructor really cares. One study even found an association between the use of audio feedback and better retention of course content.

There are several online tools that allow you to create and share audio clips easily. One that I’ve used recently is Chirbit. You only need a microphone and you can record clips up to five minutes in length. There is no limit to the number of audio posts that you can share on Chirbit. Once you create an audio clip you can mark it as private and then share the link that is provided with your student. Chirbit has a number of other capabilities for sharing clips that you can explore even further, including the ability to attach transcripts or QR codes directly to audio clips.

Consider choosing one assignment next term that you could experiment with by providing audio feedback to students. Some instructors have reported that giving audio feedback is actually more efficient for them than giving written feedback. It is definitely another way to extend your presence in the online classroom.

Ecampus Course Development and Training

Providing inspiration for your online class

Category Archives: Course Design/Learning Design

Peer Review: Why and How

Working with Texts in Online Courses