technique
token-wise self-certainty
techniqueactive
token-wise-self-certainty-574e7d92·1 events·first seen 25d agoAliases: token-wise self-certainty
Co-occurring entities
More like this (12)
symbolic meta-verificationQuantifying Faithful Confidence Expression in Large Reasoning Modelszero-trust identityChain-of-Thought Self-ConsistencyTrustworthy AIsymbolic verifier outputsconfidence gatingSelf-Trained Verification (STV)Marker Internal Confidence (MIC)multimodal meta-verificationConfidence-Building Measures for AIUncertainty Quantification
Recent events (1)
Two is better than one: A Collapse-free Multi-Reward RLIF Training Framework
This paper proposes a multi-reward reinforcement learning from internal feedback (RLIF) framework that decomposes training signals into an answer-level reward via cluster voting and a completion-level reward via token-wise self-certainty. To address reward hacking and entropy collapse common in single-reward RLIF, the authors introduce GDPO-based normalization and KL-Cov regularization targeting low-entropy token distributions. Evaluated on mathematical reasoning and code-generation benchmarks, the method achieves stability and performance approaching supervised RLVR methods without requiring external ground-truth supervision. The work advances scalable unsupervised RL training for LLM reasoning.