technique
disagreement-focused sampling
techniqueactiveprovisional
disagreement-focused-sampling-2d1ade5c·1 events·first seen 22d agoAliases: disagreement-focused sampling
Co-occurring entities
More like this (12)
Top-p samplingannotator disagreementimportance samplingMin-p samplingfinite-sample posterior sampling frameworkBeyond Third-Person Audits: Situated Interaction Auditing for User-Centered LLM Bias Researchdiscrepancy metricpaired-scenario forced-choice probediffusion posterior samplingBest-of-N SamplingSituated Interaction AuditingLESS: Mutual-Stability Sampling for Diffusion Language Models
Recent events (1)
WhoSaidIt: Human-LLM Collaborative Annotation for Multilingual Speaker-Attribute Classification
This paper proposes a human-LLM collaborative re-annotation framework for stabilizing noisy multilingual speaker-attribute labels under resource constraints. LLMs surface recurring annotation rationales through iterative expert interaction, combined with disagreement-focused sampling for targeted re-annotation. The resulting WhoSaidIt dataset covers nine speaker-attribute labels across multiple languages. Benchmarking of recent LLMs reveals substantial cross-lingual annotation divergence and highlights both capabilities and limitations of LLMs in this classification task.