Entity · technique

Contrastive Activation Addition

techniqueactiveprovisionalcontrastive-activation-addition-395317b1·1 events·first seen 5d ago

Aliases: Contrastive Activation Addition

Co-occurring entities

Google Direct Preference Optimization (DPO)Gemma 3 12B Instruct

More like this (12)

Contrastive CFG Adjacent Contrastive Reasoning Contrastive Pre-training Contrastive Search contrastive semantic alignment contrastive learning Contrastive-Difference CKA Reveals Concept-Specific Structural Alignment Across Language Model Architectures CORE (Contrastive Reflection)contrastive vision-language pretraining Visual Contrastive Self-Distillation Induction in Both Directions: A Mechanistic Analysis of In-Context Learning in Masked Diffusion Language Models Cross Activation Shift Distance

Recent events (1)

5arXiv · cs.CL·5d ago·source ↗

Inference-time steering methods compared for cross-lingual factual consistency in LLMs

Researchers investigate four intervention strategies for reducing cross-lingual factual inconsistency in LLMs, where models give different factual answers depending solely on prompt language. Testing on Gemma 3 12B Instruct, they compare persona prompting, Contrastive Activation Addition (CAA), and DPO-based adapters, finding that simple persona prompting outperforms more invasive methods in efficacy, safety, and generalization. The paper also introduces a novel culturally-rooted generalization benchmark to assess whether factual interventions transfer beyond the training distribution. Results suggest cross-lingual inconsistency is partly a selection problem addressable without weight modification.

Evaluation and Benchmarking Alignment and RLHF Contrastive Activation Addition Google Direct Preference Optimization (DPO)+1 more