technique
contrastive semantic alignment
techniqueactiveprovisional
contrastive-semantic-alignment-96804ac5·1 events·first seen 21d agoAliases: contrastive semantic alignment
Co-occurring entities
More like this (12)
Contrastive-Difference CKA Reveals Concept-Specific Structural Alignment Across Language Model ArchitecturesContrastive Searchcontrastive learningSupervised Semantic Differentialconstructional semanticscontrastive vision-language pretraininghuman alignment benchmarks (perceptual similarity, gloss, robustness, shape-texture)Contrastive Pre-trainingAcoustic Cue Alignment in Audio Language Models for Speech Emotion RecognitionAI alignmentPositive Alignmentscalar adjectival semantics
Recent events (1)
MATCHA: Contrastive Semantic Alignment Metric for LLM Evaluation
MATCHA is a new automatic evaluation metric for LLMs that addresses a fundamental flaw in existing metrics: both token-overlap (ROUGE) and embedding-based (BERTScore) metrics routinely assign near-identical scores to semantically contradictory texts. The metric uses a dual-view approach that rewards proximity to a gold reference while penalizing adversarially generated counterfactual contradictions. Evaluated across eight benchmarks spanning QA, summarization, NLI, and semantic similarity tasks, MATCHA outperforms 23 embedding models and achieves 18.38% and 20.82% improvements over ROUGE-L and BERTScore respectively on TruthfulQA. Code and metric are publicly released.