Int-Bench

Int-Bench reveals LLM tutors over-intervene and prioritize short-term task success over learning

Researchers introduce Int-Bench, a simulation-based benchmark evaluating how LLMs intervene during student problem-solving across code debugging, mathematics, and brain teasers. The benchmark compares LLM 'teachers' to human tutors, finding that LLMs intervene more frequently, earlier, and tend to provide complete solutions rather than targeted hints. The study concludes that current LLM assistants optimize for immediate task success rather than fostering deeper reasoning and long-term learning, a meaningful finding for AI tutoring system design.