Almanac
paper

Detecting Knowledge Gaps from Conversational AI Interactions Using Curriculum Prerequisite Graphs

paperactiveprovisionaldetecting-knowledge-gaps-from-conversational-ai-interactions-using-curriculum-prerequisite-graphs-b4c42c1a·1 events·first seen 7d ago

Aliases: Detecting Knowledge Gaps from Conversational AI Interactions Using Curriculum Prerequisite Graphs

Co-occurring entities

More like this (12)

Recent events (1)

4arXiv · cs.CL·7d ago·source ↗

Pipeline detects curriculum knowledge gaps from student-AI conversational logs using prerequisite graphs

Researchers present a pipeline that classifies student questions directed at a conversational AI teaching assistant into curriculum topics using a few-shot classifier grounded in a GPT-4-extracted prerequisite knowledge graph. Evaluated on 1,340 questions from 164 graduate students, the classifier achieves 80% accuracy across 43 labels. Topic-level question volume significantly correlates with student-reported difficulty (rho=0.491), validating that AI interaction logs carry actionable diagnostic signals about knowledge gaps.