MMMC-Code

SGA: Plug-and-play geometric verification module for LLM-generated educational animations

Researchers introduce the Symbolic Geometric Agent (SGA), a modular component that intercepts LLM-generated Manim animation code, extracts symbolic scene graphs via partial execution, and applies targeted refinement to resolve spatial conflicts and occlusions. They also propose MVQS (Manim Visual Quality Score), a deterministic rendering-free proxy metric for spatial integrity. Evaluated on the MMMC-Code benchmark across four LLM backbones and two agentic pipelines, SGA achieves a 16.1% relative improvement in MVQS over baseline. The work addresses a gap in LLM-driven code generation pipelines where geometric correctness is underserved.