Entity · technique

BeyondUncertainty

techniqueactiveprovisionalbeyonduncertainty-a3a88636·1 events·first seen 45h ago

Aliases: BeyondUncertainty

More like this (12)

Uncertainty Quantification Uncertainty Calibration Uncertainty-Aware Generation and Decision-Making Under Ambiguity epistemic uncertainty human uncertainty alignment Verbal Uncertainty Expression Subjective Risk Decomposition: A New View for Uncertainty Quantification Uncertainty-aware Multi-Granularity RAG Uncertainty Quantification for Computer-Use Agents: A Benchmark across Vision-Language Models and GUI Grounding Datasets Code Is More Than Text: Uncertainty Estimation for Code Generation Upper Confidence Bound Using Reward Uncertainty to Induce Diverse Behaviour in Reinforcement Learning

Recent events (1)

5arXiv · cs.CL·45h ago·source ↗

BeyondUncertainty: Using verbalized LLM confidence to route retrieval in RAG systems

A new arXiv preprint introduces BeyondUncertainty, a method that uses verbalized confidence estimates from black-box LLMs to decide whether to invoke retrieval in RAG pipelines. The system elicits a provisional answer and confidence score, then routes low-confidence queries to TF-IDF retrieval while returning high-confidence answers directly. Evaluated across 27,000 policy instances on six QA benchmarks, the method achieves 0.483 mean token-level F1 versus 0.467 for always-retrieve, while reducing retrieved passages by 20.4%, though the confidence probe adds 28.2% token overhead.

Evaluation and Benchmarking Inference Economics BeyondUncertainty