technique
Contrastive Search
techniqueactive
contrastive-search-78109f90·1 events·first seen 28d agoAliases: Contrastive Search
Co-occurring entities
More like this (12)
contrastive learningContrastive Pre-trainingcontrastive vision-language pretrainingcontrastive semantic alignmentContrastive Language-Image Pretraining (CLIP)CORE (Contrastive Reflection)USearchContrastive-Difference CKA Reveals Concept-Specific Structural Alignment Across Language Model ArchitecturesConstrained Beam SearchTest-time Compute SearchBeam SearchGoogle Generative AI (Search)
Recent events (1)
Generating Human-level Text with Contrastive Search in Transformers
Hugging Face introduces contrastive search, a decoding strategy for autoregressive language models that aims to produce more coherent and human-like text compared to standard methods like beam search or nucleus sampling. The technique works by balancing a model's confidence in its next-token prediction against a contrastive penalty that discourages repetitive or degenerate outputs. The blog post describes integration of contrastive search into the Hugging Face Transformers library, making it accessible to practitioners.