Requesty
A Towards AI article by Divy Yadav, published June 11, 2026, characterizes the Nemotron 3 Ultra 550B A55B as a 550 billion parameter Mixture-of-Experts model that activates only 55 billion parameters per token, giving a 10:1 sparsity ratio. The piece emphasizes NVIDIA's hybrid design that interleaves Mamba-2 state spac The article positions Nemotron 3 Ultra as an open-source model that AI developers should be aware of, presenting it as a "differently-designed" alternative to smaller models rather than a scaled-up transformer. Technical details around the 10:1 active-to-total ratio and the Mamba-2 hybrid are presented as the different
