Mistral Large 3

Mistral Large 3 is a sparse mixture-of-experts language model that activates 41 billion parameters during inference while drawing on a total pool of 675 billion parameters. It marks Mistral's return to the MoE architecture after the Mixtral series, designed to deliver frontier-level performance across general instruction-following tasks. The model also incorporates vision capabilities, enabling it to process and reason about images alongside text. By structuring computation as a sparse mixture of specialized expert pathways, the architecture aims to deliver high capability at a lower active-parameter cost than a comparable dense model would require.

The model was trained from scratch using a cluster of 3000 NVIDIA H200 GPUs, representing a substantial investment in pretraining scale. After post-training, Mistral Large 3 achieves parity with the best instruction-tuned open-weight models on general prompts and demonstrates best-in-class per-token performance on image understanding tasks. Released under the permissive Apache 2.0 license and available in compressed formats, it is built for developers and organizations that want full control over deployment without licensing restrictions. The combination of open weights, vision support, and strong instruction-following makes it well suited for research, enterprise applications, and anyone building on open foundation models.