Entity · model
DiffusionGemma
modelactive
diffusiongemma-62a8349b·6 events·first seen Aliases: DiffusionGemma
Co-occurring entities
GoogleGemma 4AnthropicLibriSpeechAudio-Native Speech Recognition with a Frozen Discrete-Diffusion Language ModelConnectionist Temporal ClassificationWhisperSeedance 2.0DoubaoAlibabaByteDanceQwenClaude CodeArena CodeInterim Measures for AI-Based Anthropomorphic Interactive ServicesArena AIHow Transparent is DiffusionGemma?Claude MythosClaude Opus 4.6UC Berkeley Center for Responsible, Decentralized Intelligence
More like this (12)
Recent events (6)
Discrete-diffusion language model adapted for parallel speech recognition via frozen DiffusionGemma
Researchers demonstrate that a frozen 26B mixture-of-experts discrete diffusion language model (DiffusionGemma) can be adapted for automatic speech recognition using only ~42M trainable parameters (0.16% of backbone). The system uses a frozen Whisper encoder for acoustic features, lightweight projectors, and LoRA adapters, achieving 6.6% WER on LibriSpeech test-clean in roughly eight parallel denoising steps regardless of utterance length. A key finding is that standard training objectives fail to ground audio features due to attention dismissal, and a CTC loss through the frozen output head resolves this. The approach supports multilingual transcription (English, Hindi, Mandarin) from a single adapter.
The Batch digest: China bans anthropomorphic bots, DiffusionGemma, Anthropic Claude Code study, Seedance 2.5, Code Arena
A multi-story digest covers five distinct AI developments: ByteDance and Alibaba are shutting down customizable humanlike AI agents ahead of China's July 15 Interim Measures for AI-Based Anthropomorphic Interactive Services; Google released DiffusionGemma, an experimental 26B MoE diffusion-based text model generating 256-token blocks at 1,000+ tokens/sec on H100; Anthropic published findings from 400,000 Claude Code sessions showing domain expertise—not coding skill—drives agentic output volume; Seedance released version 2.5 of its video generator with higher resolution and longer clips; and Arena.ai expanded Code Arena to fullstack web development evaluation. The China regulatory action is the most significant item, representing a concrete enforcement moment for AI persona/companion regulation.
Interpretability study of DiffusionGemma reveals novel diffusion-specific reasoning phenomena
Researchers investigate the reasoning transparency of DiffusionGemma, a diffusion-based language model, decomposing transparency into variable and algorithmic components. They show that mapping information through an interpretable token bottleneck reduces DiffusionGemma's opaque serial depth from 28.6X to just 1.1X that of autoregressive Gemma 4, with no performance loss. Interpretability case studies uncover diffusion-specific phenomena including non-chronological reasoning, token smearing, and intermediate-context reasoning. Monitorability tests find DiffusionGemma comparable to Gemma 4, suggesting diffusion LMs are not inherently less amenable to safety oversight.
DiffusionGemma hits 1,000+ tokens/sec; Claude Fable 5 export controls; Agents' Last Exam benchmark launch
Google introduced DiffusionGemma, an experimental 26B MoE model using diffusion-based text generation that produces 256-token blocks simultaneously, achieving over 1,000 tokens/second on H100 hardware at the cost of lower output quality versus standard Gemma 4. Separately, the US government issued an export control directive forcing Anthropic to suspend Claude Fable 5 and Claude Mythos 5 globally, while Anthropic also reversed a controversial silent-degradation safeguard on Fable 5 after researcher backlash. UC Berkeley's Center for RDI launched Agents' Last Exam (ALE), a 1,500+ task agentic benchmark using deterministic grading, where GPT-5.5 topped the leaderboard at only 24% pass rate, highlighting the difficulty gap between current models and professional-grade workflows.
Simon Willison on DiffusionGemma
Simon Willison covers DiffusionGemma, a diffusion-based language model in the Gemma family from Google. The post appears to be commentary or a brief note on the model's release or capabilities. Diffusion-based LLMs represent an active area of research as an alternative to autoregressive generation.
DeepMind announces DiffusionGemma with 4x faster text generation
DeepMind published a blog post introducing DiffusionGemma, a diffusion-based variant of the Gemma model family claiming 4x faster text generation. The announcement suggests a departure from standard autoregressive decoding in favor of diffusion-based generation. If the claims hold, this could represent a meaningful inference efficiency advance for the Gemma line.