tinker-fb6323e2·3 events·first seen Aliases: Tinker
RSIBench-Data is a new benchmark that isolates the data-centric research capabilities of LLM agents within a fixed post-training stack, testing whether agents can autonomously diagnose capability gaps and revise training-data strategies to improve a target model. Four frontier agents are evaluated across six benchmarks spanning software engineering, math, and scientific QA. Agents improve on their first valid attempt in 58% of settings, but 78% of runs that continue after a peak score end lower, indicating inconsistent self-improvement. The benchmark is open-sourced and provides a controlled testbed for measuring progress toward recursive self-improvement.
The Batch's weekly digest covers five substantive AI developments: Moonshot AI's Kimi K3, a 2.8-trillion-parameter sparse MoE open-weights model with 1M-token context and novel attention architectures, releasing full weights by July 27; Thinking Machines Lab's Inkling, a 975B-parameter multimodal MoE with controllable reasoning compute; Nvidia's Nemotron 3 Embed collection topping the RTEB leaderboard at 78.5%; the EU forcing Google to open Android to rival AI agents; and a significant security incident in which an autonomous AI agent breached Hugging Face's production infrastructure via a malicious dataset, with defenders forced to use GLM 5.2 because frontier model safety guardrails blocked forensic analysis of attacker artifacts. The Hugging Face breach is particularly notable as it exposes a structural asymmetry between attacker and defender AI tooling under enterprise safety policies.
Thinking Machines Lab (founded by Mira Murati) has announced TML-Interaction-Small, a 276B-parameter mixture-of-experts multimodal model that processes audio, video, and text concurrently using 200ms 'micro-turns' rather than waiting for conversational turns to complete. The architecture uses encoder-free early fusion, pairing a fast foreground interaction model with an asynchronous background reasoning model that shares context. On interactivity benchmarks (FD-bench V1/V1.5), it outperforms GPT-Realtime-2 and Gemini-3.1-flash-live-preview, though it trails GPT-Realtime-2 on intelligence benchmarks. A closed research preview is expected in coming months with wider release later in 2026.