AI-assisted grading and personalized feedback in large political science classes: results from randomized controlled trials?

Political Science
Artificial Intelligence
Large Language Models
Pedagogy

Heinrich, Tobias et al. 2025. “AI-assisted grading and personalized feedback in large political science classes: results from randomized controlled trials?”

Authors
Affiliations

Political Science, University of Houston

Political Science, Univeristy of South Carolina

Kuan-wu Chen

Political Science, Univeristy of South Carolina

Jack DeOliveira

Political Science, Univeristy of South Carolina University

Kangwon Institute for Unification Studies, Kangwon National University & Political Science, University of South Carolina

Navida Chun-han Wang

Political Science, University of Michigan

Published

December 2024

Abstract

Traditional grading of and feedback for short-answer questions is tremendously time consuming for instructors of large political science classes. Other professional obligations may make instructors shift to inferior learning tools, such as multiple choice questions. We study the potential of artificial intelligence-assisted grading using large language models to augment the productivity of instructor so that a large class could be like a smaller class. Through a randomized controlled trial across four undergraduate courses and almost 300 students in 2023/2024, we assess the effectiveness of AI-assisted grading and feedback in comparison to purely human grading. Our results demonstrate that AI-assisted grading can largely mimic what an instructor would do in a small class.