Inspire Blog Author: Philip Chambers

Refining Rubrics & Assessments: AI as Design Support – Part 2

This blog post is a continuation from “Refining Rubrics & Assessments: AI as Design Support – Part 1“. Using AI to Refine Rubric Language In the previous post, I gave an assignment prompt to Copilot (as that’s the recommended tool at Oregon State University) and asked it to complete the task. For reference, here is the task. Rubrics are often the weakest link in assessment design, particularly when descriptors rely on vague phrases like “meets expectations” or “demonstrates understanding.” One way to evaluate rubric clarity is to ask AI to self-assess its own response using the rubric criteria. If the model can plausibly justify a high score despite shallow reasoning or inconsistent logic, the rubric may not be clearly distinguishing … Refining Rubrics & Assessments: AI as Design Support – Part 2

Refining Rubrics & Assessments: AI as Design Support – Part 1

For centuries, knowledge and access to education was restricted to just a few. In today’s’ world, almost anybody can access information through the web and more recently through AI tools. However, it is important to recognize that these tools, while offering expansive access to content of varied nature, also pose challenges. Generative AI has fundamentally changed how students interact with assignments, but it has also given instructors a powerful new lens for examining their own assessment design. Rather than treating AI solely as a threat to academic integrity, we can use it as a diagnostic tool – one that quickly reveals whether our assignments and rubrics are actually measuring what we think they are. If an AI can complete an … Refining Rubrics & Assessments: AI as Design Support – Part 1

When Passing Is Failing: Cultivating Critical AI Literacy

We all remember the warning from math class: “You won’t always have a calculator in your pocket!” How we laugh now, with calculators first arriving in our pockets and, eventually, smartphones putting one in our hands at all times. I have seen a lot of comparisons across the Internet to artificial intelligence (AI) and these mathematics classes of yesteryear. The idea being that AI is but the newest embodiment of this same concern, which ended up being overblown. But is this an apt comparison to make? After all, we did not replace math lessons and teachers with pocket calculators, nor even with smart phones. The kindergarten student is not simply given a Casio and told to figure it out. The … When Passing Is Failing: Cultivating Critical AI Literacy

You won’t believe where AI could replace you next! (But you’re probably going to like it).

Introduction We’ve all heard by now of ChatGPT, the large language model-based chat bot that can seemingly answer most any question you present it. What if there were a way to provide this functionality to students on their learning management system, and it could answer questions they had about course content? Sure, this would not completely replace the instructor, nor would it be intended to. Instead, for quick course content questions, a chatbot with access to all course materials could provide students with speedy feedback and clarifications in far less time than the standard turnaround required through the usual channels. Of course, more involved questions about assignments and course content questions outside of the scope of course materials would be … You won’t believe where AI could replace you next! (But you’re probably going to like it).