epistemic-modesty-378f6892·1 events·first seen Aliases: Epistemic Modesty
Researchers introduce Polistemics, a theory-grounded benchmark for evaluating how LLMs mediate political information during elections, grounded in a normative standard called Epistemic Modesty. Applied to three state-of-the-art LLMs on the 2025 German and Dutch elections, the benchmark reveals that high aggregate scores mask systematic failures: models perform well under clear evidence but break down under absent, vague, or contradictory information, and flatten political language intensity. The failures appear driven by party priors and are sensitive to party labels and output language, suggesting no current model delivers consistently responsible political mediation.