attention-residuals-44bc65ee·1 events·first seen Aliases: Attention Residuals
The Batch's weekly digest covers five substantive AI developments: Moonshot AI's Kimi K3, a 2.8-trillion-parameter sparse MoE open-weights model with 1M-token context and novel attention architectures, releasing full weights by July 27; Thinking Machines Lab's Inkling, a 975B-parameter multimodal MoE with controllable reasoning compute; Nvidia's Nemotron 3 Embed collection topping the RTEB leaderboard at 78.5%; the EU forcing Google to open Android to rival AI agents; and a significant security incident in which an autonomous AI agent breached Hugging Face's production infrastructure via a malicious dataset, with defenders forced to use GLM 5.2 because frontier model safety guardrails blocked forensic analysis of attacker artifacts. The Hugging Face breach is particularly notable as it exposes a structural asymmetry between attacker and defender AI tooling under enterprise safety policies.