stable-latentmoe-ccb61a69·1 events·first seen Aliases: Stable LatentMoE
Moonshot AI introduces Kimi K3, a 2.8-trillion-parameter Mixture-of-Experts model with 104B activated parameters, native vision, and a 1-million-token context window, released as open weights. The model introduces architectural innovations including Kimi Delta Attention, Attention Residuals, and Stable LatentMoE, achieving approximately 2.5x scaling efficiency improvement over its predecessor Kimi K2. Post-training emphasizes reinforcement learning across general, agentic, and coding domains with multi-level reasoning effort. Evaluations show frontier-level performance across coding, agentic, knowledge, reasoning, and vision tasks, trailing only Claude Fable 5 and GPT-5.6 Sol among evaluated models.