Sulat.com
AI models
NovitaAI logo

Model details

Mistral Nemo

Mistral Nemo is a 12-billion parameter language model developed in collaboration with NVIDIA, designed to excel in conversational AI and enterprise applications. The model uses a standard transformer decoder architecture with sliding window attention to handle long contexts efficiently, making it a straightforward drop-in replacement for systems built around smaller models like Mistral 7B. One of its distinguishing features is a custom Tekken tokenizer that provides superior efficiency for European languages, which directly benefits multilingual applications. The model supports an expansive 128k token context window and was trained with quantisation awareness that enables FP8 inference without sacrificing performance, delivering strong throughput for real-world deployment scenarios.

Mistral Nemo was pre-trained with function calling capabilities built in, and both base and instruction-tuned checkpoints are available under the Apache 2.0 license to encourage broad enterprise and research adoption. Its training emphasizes multilingual fluency across English, French, German, Spanish, Italian, Portuguese, Chinese, Japanese, Korean, Arabic, and Hindi, positioning it as a practical tool for global applications. On standard benchmarks for its size category, the model demonstrates state-of-the-art performance in reasoning, world knowledge, and coding, outperforming comparably-sized competitors like Gemma 2 9B and Llama 3 8B. The combination of open weights, large context capacity, and strong multilingual capabilities makes it well-suited for organizations that need customizable AI support across diverse language markets.

NovitaAImistralai/mistral-nemomistral-nemo

Quick Info

Powered by
Provider
NovitaAI
Model key
mistralai/mistral-nemo
Release date
Jul 30, 2024
Last updated
Jul 30, 2024
Input modalities
Output modalities
Capabilities

Cost

Input token cost
$0.04
Output token cost
$0.17

Limits

Output tokens
16,000 tokens
Context window
60,288 tokens

Latest news about Mistral Nemo

No articles yet. Fetch the latest news to show it here.

Videos about Mistral Nemo

More models around Mistral Nemo