Entity · benchmark

Stereotypes-to-Decisions (S2D)

benchmarkactiveprovisionalstereotypes-to-decisions-s2d--265afa1d·1 events·first seen 40h ago

Aliases: Stereotypes-to-Decisions (S2D)

More like this (12)

Conformal Decision Theory InstructS2S-Eval Decision Transformer StylisticBias: A Few Human Visual Cues Drive Most Social Biases in MLLMs stochastic-deterministic boundary (SDB)Bayesian decision theory decision-content decoupled reinforcement learning t-SNE Selective Classification Predicting Future Behaviors in Reasoning Models Enables Better Steering DSIT-Taxonomies Schema-Guided Dialogue

Recent events (1)

5arXiv · cs.CL·40h ago·source ↗

S2D framework evaluates regional bias in LLMs across China's 34 provincial regions

Researchers introduce Stereotypes-to-Decisions (S2D), a framework for evaluating regional bias in LLMs spanning abstract stereotype ratings (Warmth and Competence) through concrete social decisions (Education, Occupation, Social Interaction) across all 34 provincial-level regions of China. Six LLMs are evaluated, revealing substantial and consistent regional differences that correlate with economic and digital development indicators and persist across Chinese and English prompts. The findings suggest regional bias in LLMs is systematic and consequential, with cross-model agreement especially strong for Competence and Occupation decisions.

Evaluation and Benchmarking AI Safety Research Stereotypes-to-Decisions (S2D)