Learn Like Feynman: Developing and Testing an AI-Driven Feynman Bot

Abstract: The Feynman learning technique is an active learning strategy that helps learners simplify complex information through student-led teaching and discussion. In this paper, we present the development and usability testing of the Feynman Bot, which uses the Feynman technique to assist self-regulated learners who lack peer or instructor support. The Bot embodies the Feynman learning technique by encouraging learners to discuss their lecture material in a question-answer-driven discussion format. The Feynman Bot was developed using a LLM with Langchain in a Retrieval-Augmented-Generation framework to leverage the reasoning capability required to generate effective discussion-oriented questions. To test the Feynman bot, a controlled experiment was conducted over three days with fourteen participants. Formative and summative assessments were conducted, followed by a self-efficacy survey. We found that participants who used the Feynman Bot experienced higher learning gains than the Passive Learners' group. Moreover, Feynman Bot Learners' had a higher level of comfort with the subject after using the bot. We also found typing to be the preferred input modality method over speech, when interacting with the bot. The high learning gains and improved confidence with study material brought about by the Feynman Bot makes it a promising tool for self-regulated learners.