technique
Adaptive Self-Debiasing
techniqueactiveprovisional
adaptive-self-debiasing-42c53e31·1 events·first seen 41h agoAliases: Adaptive Self-Debiasing
Co-occurring entities
More like this (12)
Uncertainty-based Debiasing and Unlearning for DecontaminationUnBias-PlusThe Role of Feedback Alignment in Self-DistillationZEDA (Zero-Expert Self-Distillation Adaptation)behavioral fine-tuningSelf-Supervised LearningAdaptive Clip Policy OptimizationIn-Context Reward AdaptationStylisticBias: A Few Human Visual Cues Drive Most Social Biases in MLLMson-policy self-distillationStylisticBiasObserve-and-Act Adaptive Context Selection
Recent events (1)
Variance-Calibrated Modulation (VCM): training-free decoding intervention to address LLM likelihood trap
Researchers propose Variance-Calibrated Modulation (VCM), a training-free pre-decoding method that reshapes LLM probability distributions before truncation to combat repetitive degeneration and vocabulary dullness. VCM combines two mechanisms: Contextual Searchlight via PMI (suppressing stopwords, elevating context-relevant tokens) and Adaptive Self-Debiasing (scale-invariant penalization using real-time logit standard deviation). Evaluated across open-ended generation, factual QA, and mathematical reasoning, VCM improves diversity, coherence, and reasoning accuracy at higher temperatures with negligible overhead. The method is compatible with existing decoding strategies like Top-p and Min-p.