Nebius Token Factory
Discover the best embedding models for RAG in 2026. Full comparison of OpenAI text-embedding-3, Cohere embed-v4, Voyage AI, Jina, Qwen3, BGE-M3 and more.
Model details
Qwen3-Embedding-8B is the largest entry in the Qwen3 Embedding series, an 8-billion-parameter dense model built on the Qwen3 foundation for text embedding and ranking workloads. It is designed to produce high-quality vector representations for tasks such as semantic search, document retrieval, code retrieval, clustering, classification, and bitext mining, and it inherits the multilingual coverage of its Qwen3 lineage with support for more than 100 languages. The model offers instruction-aware behavior and configurable embedding dimensions, allowing users to balance vector size against storage and retrieval cost depending on the application.
Reported benchmark performance places the model at the top of the MTEB multilingual leaderboard, where it scored 70.58 as of June 5, 2025, reflecting strong cross-lingual retrieval quality. Long-context behavior is a key practical strength, with the model able to process lengthy passages and return embeddings of up to 4096 dimensions suitable for RAG pipelines and large-document indexing. Users should note a community-reported issue where running inference in torch.float16 can produce NaN outputs for inputs containing certain tokens, so a higher-precision data type is advisable for production deployments where such text is expected.
A provider subscription or plan supersedes token-based pricing for this model.
Nebius Token Factory
Discover the best embedding models for RAG in 2026. Full comparison of OpenAI text-embedding-3, Cohere embed-v4, Voyage AI, Jina, Qwen3, BGE-M3 and more.
Nebius Token Factory
Hello Qwen team,
Nebius Token Factory
Without setting the torch_dtype the snippet will fail with RuntimeError: FlashAttention only support fp16 and bf16 data type , as it defaults to torch.float32 .