Integrating AI into Assessment

When would the integration of generative AI use into your assessments make sense? When:

  • AI is directly used for teaching and learning in the course and using AI in assessments supports the learning objectives being assessed
  • AI supports assessment which makes it easier/more efficient for learners to demonstrate their learning while ensuring AI is not replacing student thoughts/outputs (e.g. used as a tool for multiple representation or accommodation)
  • AI supports authentic assessment which replicates problems and scenarios found in professional practice or industry where AI would be used
  • AI use is the direct object of the assessment (e.g. critique of AI outputs)

Here are some considerations and resources for integrating AI into assessment:

To effectively integrate AI into assessment, it is important for both you and your students to have an understanding of how AI works, the things it does efficiently and the things it does not do well. Here are some resources to help:

 

ULethbridge Generative AI Course Logo
 
AI Literacy: Generative AI 

The library has created an online course open to anyone at the University as an introduction to generative AI. It is aimed primarily at students (it goes on their MyExperience transcript upon completion) but is a great place to begin, refresh or extend your AI understanding.

Teaching Centre Firefly
 
Redesigning Assessment for Authentic Learning in the AI Age 

For information on evaluating assessments and where they are vulnerable to AI mis-use check out our online course 

 
 
 
 
General AI related resources from the library 

 

 

Blooms Taxonomy Revisited - Chart Illustrating how AI interacts with Blooms Taxonomy

Click image to open

 

 

 

Blooms Taxonomy is a learning classification system often used to create learning outcomes that target subject matter and depth of learning in a way directly measurable with assessment. This updated version divides skills that AI can supplement or support well from those that are distinctly human. 

from: https://ecampus.oregonstate.edu/faculty/artificial-intelligence-tools/meaningful-learning/

 

AI Assessment Scale - A five-level framework that helps educators decide what role AI should play in an assessment task, and redesign the task so that decision holds up in practice.

Click image to open

 

 

 

The AI Assessment scale is a five-level framework that helps educators decide what role AI should play in an assessment task and redesign the task so that decision holds up in practice.

from: https://aiassessmentscale.com/

University of Saskatchewan 
Teaching and Learning

Designing Assessments that 
Leverage GenAI

 

From University of Saskatchewan Teaching and Learning, a short article outlining some considerations, ideas and examples for integrating AI into assessment.

University of British Columbia
Centre for Teaching, Learning and Technology

Assessments that Involve GenAI

 

From the University of British Columbia Centre for Teaching, Learning, and Technology, some guiding principles, strategies, approaches and examples for integrating AI in assessment.

From ULethbridge

From Other Institutions

Coming Soon.  If you have an example of an assessment where you have integrated AI (at any scale) and would be willing to share, please contact us at teachingcentre@uleth.ca. 
Collection of Assignments Curated by the AI Pedagogy Project.
  • Incubated by metalab (at) Harvard, These are contributed by educators worldwide and organized by Theme, Subject, Tools, and Skill
Using AI to Enhance Assessment - University of Melbourne
  • strategies, assessment examples, scholarly articles and text resrouces