Entity · technique

PosConf

techniqueactiveprovisionalposconf-2fe06bfd·1 events·first seen 3d ago

Aliases: PosConf

Co-occurring entities

EIT-NLP Post-Training Shifts Confidence: A Three-Stage Analysis of How SFT, RL, and OPD Shape Pre-, Intra-, and Post-CoT Calibration

More like this (12)

MemCon CompVis FastConformer-Large Conformal Prediction PCGrad RolePlayConv GraphPO Upper Confidence Bound Promt Mondrian Conformal Prediction PropMe Perplexity Computer

Recent events (1)

5arXiv · cs.CL·3d ago·source ↗

PosConf: Position-aware confidence calibration across SFT, RL, and OPD post-training stages

A new arXiv paper introduces a three-stage calibration framework analyzing how supervised fine-tuning (SFT), reinforcement learning (RL), and on-policy distillation (OPD) shape model confidence before, during, and after chain-of-thought reasoning. The authors find that each post-training method produces distinct calibration profiles at different reasoning stages, and that RL confidence becomes informative only after a path-commitment phase while OPD confidence degrades later. They propose PosConf, a position-aware confidence strategy that selectively uses confidence from reliable relative-position intervals, improving RL answer aggregation by 6.1 points over majority voting and OPD early stopping by up to 4.3 points.

Evaluation and Benchmarking Alignment and RLHF EIT-NLP Post-Training Shifts Confidence: A Three-Stage Analysis of How SFT, RL, and OPD Shape Pre-, Intra-, and Post-CoT Calibration PosConf