Nemotron-Labs-Audex-30B-A3B

Nemotron-Labs Audex-30B: Unified audio-text MoE LLM with no text regression

Nvidia's Nemotron Labs introduces Audex-30B-A3B, a 30B-parameter mixture-of-experts audio-text LLM built on the Nemotron-Cascade-2 text backbone. The model handles audio understanding, ASR, translation, TTS, and speech-to-speech generation within a single Transformer decoder by projecting audio into the text embedding space. Training used 157.4B audio tokens and 320.5B text tokens with multi-stage supervised learning, RL, and on-policy distillation. Model checkpoints are publicly released, and the authors report state-of-the-art audio performance with minimal regression on text reasoning and agentic capabilities.