gemma-3-12b-instruct-81814fc1·2 events·first seen Aliases: Gemma 3 12B Instruct, Gemma 3 12B
Researchers evaluate multiple training paradigms for legal machine translation, comparing supervised fine-tuning and reinforcement learning with verifiable rewards (RLVR) on small models (Qwen3.5 4B/9B, Gemma 3 12B) against frontier reasoning models. Using the Swiss multilingual legal system as a testbed, they find RLVR outperforms SFT for legal NMT and brings small models close to frontier performance, though a gap remains. The study also observes diminishing returns from re-training as model size increases. Code and models are publicly released.
Researchers investigate four intervention strategies for reducing cross-lingual factual inconsistency in LLMs, where models give different factual answers depending solely on prompt language. Testing on Gemma 3 12B Instruct, they compare persona prompting, Contrastive Activation Addition (CAA), and DPO-based adapters, finding that simple persona prompting outperforms more invasive methods in efficacy, safety, and generalization. The paper also introduces a novel culturally-rooted generalization benchmark to assess whether factual interventions transfer beyond the training distribution. Results suggest cross-lingual inconsistency is partly a selection problem addressable without weight modification.