Soofi S 30B-A3B

Soofi S 30B-A3B: Sovereign German-English MoE Hybrid Mamba Transformer Released Open-Source

Researchers present Soofi S 30B-A3B, a Mixture-of-Experts hybrid Mamba Transformer foundation model for German and English, activating only 3B of 30B parameters per token with near-constant inference cache for long-context efficiency. Pretrained on ~27 trillion tokens with up-weighted German data, it claims top aggregate scores among fully open models in both languages, outperforming OLMo 3 32B and Apertus 70B, and surpasses all European sovereign baselines tested. The model was built on Deutsche Telekom's sovereign HPC infrastructure in Munich and will be released with weights, checkpoints, hyperparameters, training code, and full data accounting under permissive terms.