Entity · technique

Evidence-Grounded, Social-Weighted Persona Panel

techniqueactiveprovisionalevidence-grounded-social-weighted-persona-panel-d6c4ab56·1 events·first seen 5h ago

Aliases: Evidence-Grounded, Social-Weighted Persona Panel

Co-occurring entities

Beyond a Single Judge: Simulating Social Persona Panels for Generative UI Evaluation

More like this (12)

Beyond a Single Judge: Simulating Social Persona Panels for Generative UI Evaluation Evidence-Grounded F1 Beyond Third-Person Audits: Situated Interaction Auditing for User-Centered LLM Bias Research Persona Clinical Evidence Graph Memory Reason-Mediated Behavioral Models for Auditing LLM Social Simulators Social Gaze Consistency Evidence-Backed Video Question Answering StylisticBias: A Few Human Visual Cues Drive Most Social Biases in MLLMs Self-Evolving Human-Centered Framework for Explainable Depression Symptom Annotation Political Even-Handedness Evaluation Complex Social Behavior dataset

Recent events (1)

5arXiv · cs.CL·5h ago·source ↗

ESPP: Simulated social persona panels improve LLM-as-judge evaluation of generative UI

Researchers introduce ESPP (Evidence-Grounded, Social-Weighted Persona Panel), a three-stage evaluation method for Generative UI that simulates psychologically diverse personas, has them exchange opinions under a bounded-confidence mechanism, and aggregates judgments via Delphi-inspired social weighting. ESPP raises Pearson correlation with human judgment from 0.716 to 0.922 compared to a naive single-pass LLM judge, with prompt-ensemble baselines recovering only about a third of the gap. The method also reveals that user subgroups agree on overall model rankings but diverge on specific rating dimensions — a structural disagreement a single homogeneous judge would erase.

Evaluation and Benchmarking Evidence-Grounded, Social-Weighted Persona Panel Beyond a Single Judge: Simulating Social Persona Panels for Generative UI Evaluation