Entity · other

Perceptual Judgment Bias

otheractiveperceptual-judgment-bias-aeaf7943·1 events·first seen Jun 2, 2026

Aliases: Perceptual Judgment Bias

Co-occurring entities

Perceptually Perturbed Judgment Dataset Multimodal Large Language Models GRPO LLM-as-a-Judge

More like this (12)

Perceptually Perturbed Judgment Dataset Expert Blindness Effect Percepta Judgement-of-Learning Inside the Unfair Judge: A Mechanistic Interpretability Account of LLM-as-Judge Bias regional-to-global perception gap OptimismBench: Forecasting Bias and the Alignment Effect in Language Model Judgment StylisticBias: A Few Human Visual Cues Drive Most Social Biases in MLLMs Paraphrase Judgment Judge Response Theory political bias evaluation Vision-Default, Prior-Override: Causal Mechanisms of Perception-Knowledge Conflict in Vision-Language Models

Recent events (1)

6arXiv · cs.AI·Jun 2, 2026·source ↗

Mitigating Perceptual Judgment Bias in Multimodal LLM-as-a-Judge via Perceptual Perturbation and Reward Modeling

This paper identifies and analyzes 'Perceptual Judgment Bias' in multimodal LLM judges, where models anchor on response text rather than visual evidence when the two conflict. The authors introduce a Perceptually Perturbed Judgment Dataset using counterfactual responses to isolate perceptual errors, and a training framework combining GRPO-based reward modeling with batch-ranking objectives. Experiments on MLLM-as-a-Judge benchmarks show improved perceptual fidelity, ranking coherence, and alignment with human evaluation.

Evaluation and Benchmarking Alignment and RLHF Perceptually Perturbed Judgment Dataset Multimodal Large Language Models GRPO +3 more