technique
Semantic Edit Regularization
techniqueactive
semantic-edit-regularization-24c35c07·1 events·first seen 26d agoAliases: Semantic Edit Regularization
Co-occurring entities
More like this (12)
Entropy Regularizationepistemic-separation regularizerR-Drop consistency regularizationEntropy-Regularized Reinforcement LearningSupervised Semantic Differentialformal argumentation semanticsSemantic Generative Tuning (SGT)Automatic Post-Editing (APE)sentence embeddingsFast Adaptive Semantic EntropyKnowledge Editing in Masked Diffusion Language Modelssemantic retrieval
Recent events (1)
TextReg: Regularization Framework for Mitigating Prompt Distributional Overfitting in LLM Optimization
TextReg addresses a failure mode in iterative prompt optimization where LLM-rewritten prompts grow longer, accumulate narrow rules, and generalize poorly—termed prompt distributional overfitting. The authors formalize this via 'representational inefficiency,' a dual-factor measure decomposing prompt inefficiency into capacity cost and scope narrowness. TextReg applies a soft-penalty regularization framework using Dual-Evidence Gradient Purification, Semantic Edit Regularization, and Regularization-Guided Prompt Update. On reasoning benchmarks, it achieves up to +11.8% OOD accuracy over TextGrad and +16.5% over REVOLVE.