DataGovBench

DataGovBench: Benchmarking LLMs on Real-World Governmental Data Analysis Tasks

Researchers introduce DataGovBench, a benchmark derived from governmental open data designed to evaluate LLMs on practical data analysis tasks beyond simple fact retrieval from small tables. The benchmark covers two tasks: Table QA (complex decomposable questions with textual or visualization outputs) and Table Insight (exploratory data analysis for expert-level findings). Experiments with state-of-the-art LLMs, with and without agentic frameworks, reveal significant performance gaps, suggesting current systems fall well short of real-world data analytics demands.