other

Perceptual Judgment Bias

otheractiveprovisionalperceptual-judgment-bias-aeaf7943·1 events·first seen 15d ago

Aliases: Perceptual Judgment Bias

Co-occurring entities

Perceptually Perturbed Judgment Dataset Multimodal Large Language Models GRPO LLM-as-a-Judge

More like this (12)

Perceptually Perturbed Judgment Dataset Expert Blindness Effect Percepta regional-to-global perception gap Paraphrase Judgment political bias evaluation geopolitical bias optimism bias Perception Encoder Perceptual Strength of Embodiment (PSE)Imaginative Perception Tokens Perspective Taking

Recent events (1)

6arXiv · cs.AI·15d ago·source ↗

Mitigating Perceptual Judgment Bias in Multimodal LLM-as-a-Judge via Perceptual Perturbation and Reward Modeling

This paper identifies and analyzes 'Perceptual Judgment Bias' in multimodal LLM judges, where models anchor on response text rather than visual evidence when the two conflict. The authors introduce a Perceptually Perturbed Judgment Dataset using counterfactual responses to isolate perceptual errors, and a training framework combining GRPO-based reward modeling with batch-ranking objectives. Experiments on MLLM-as-a-Judge benchmarks show improved perceptual fidelity, ranking coherence, and alignment with human evaluation.

Evaluation and Benchmarking Alignment and RLHF Perceptually Perturbed Judgment Dataset Multimodal Large Language Models GRPO +3 more