process-reward-model-6c172dc9·2 events·first seen Aliases: Process Reward Model, process reward models
A new arXiv survey covers 1,250 papers (2024–2026) on AI self-improvement, proposing a two-axis taxonomy distinguishing what is improved (behavior, policy, evaluator, or research process) from the degree of loop closure (human-in-the-loop to fully closed). The authors construct a verification hierarchy for self-evaluation signals—from formal verifiers (strongest) to intrinsic self-assessment (weakest)—and find that demonstrated self-improvement strength tracks this hierarchy while failure modes (self-confirming loops, model collapse, diversity collapse) arise from its violations. The paper argues that 'research direction-setting' remains the key bottleneck keeping humans in the loop, and identifies governance-grade measurement of self-improvement as the most underpopulated niche in the field. The work connects technical RSI limits to safety and governance concerns raised by frontier labs experimenting with closed-loop AI research.
Alibaba's Qwen team introduces a process reward model (PRM) aimed at improving the reliability of mathematical reasoning in LLMs by supervising intermediate reasoning steps rather than only final answers. The work addresses the problem of models producing plausible but flawed intermediate derivations even when reaching correct conclusions. The release includes model weights on HuggingFace and ModelScope alongside a GitHub repository.