technique

Uncertainty Calibration

techniqueactiveuncertainty-calibration-33d09577·1 events·first seen 28d ago

Aliases: Uncertainty Calibration

Co-occurring entities

More like this (12)

model calibration Expected Calibration Error Uncertainty Quantification Calibrated Surprise human uncertainty alignment Human-AI Teaming Through the Lens of Calibration Verbal Uncertainty Expression parameter noise epistemic uncertainty fine-tuning supervised fine-tuning Bayesian Optimization

Recent events (1)

5Openai Blog·28d ago·source ↗

Teaching Models to Express Their Uncertainty in Words

OpenAI published research on training language models to verbally express their own uncertainty rather than stating answers with uniform confidence. The work explores calibration of model outputs through natural language hedging, aiming to make models more honest about what they do and do not know. This is an early contribution to the broader alignment and calibration research agenda.

Evaluation and Benchmarking Alignment and RLHF Verbal Uncertainty Expression Uncertainty Calibration OpenAI