A recent study at Harvard University has found that a custom-designed artificial intelligence (AI) chatbot can double learning outcomes for students in a large and popular physics course. The study, led by lecturer Gregory Kestin and senior lecturer Kelly Miller, analyzed the learning outcomes of 194 students enrolled in Physical Sciences 2 (PS2), which is a physics course for life sciences majors.
In the experiment, one group of students received instruction from a human instructor in an active learning classroom setting, while another group worked with the AI-supported chatbot at home. The results showed that the AI-powered lesson was more engaging and led to significant increases in motivation to learn compared to the traditional classroom setting.
The study’s findings suggest that the AI tutor can provide personalized feedback and support students in developing critical thinking skills. This is particularly valuable when introducing complex concepts and problems, where students may struggle to keep up or become disengaged.
Kestin emphasized the importance of using AI tutoring as a supplement to traditional instruction, rather than replacing it entirely. The goal is to use AI to help students better prepare for in-person instruction, rather than relying solely on technology.
The study’s authors believe that the AI tutor’s ability to provide personalized feedback and allow self-paced learning are key advantages compared to traditional classroom settings. They also highlighted the importance of customized AI tutoring frameworks that can be tailored to specific courses and subject matter.
The success of this experiment has inspired other large Harvard classes to test the approach this fall, including a math course that will integrate the AI tutor into its workshop portion. The Derek Bok Center for Teaching and Learning is also collaborating with Harvard University Information Technology to pilot similar AI chatbots in several introductory courses.
Source: https://news.harvard.edu/gazette/story/2024/09/professor-tailored-ai-tutor-to-physics-course-engagement-doubled/