Requesty
Qwen3.5-2B is a 2-billion parameter post-trained causal language model with a vision encoder, released by the Qwen team in the Qwen3.5 family. The Hugging Face repository distributes weights and configuration files compatible with Transformers, vLLM, SGLang, and KTransformers, intended for prototyping, task-specific fine-tuning, and research or development use at small scale. Architecture details include 24 layers, a 2048 hidden dimension, and a padded token embedding of 248,320. The model introduces a hybrid layout combining Gated DeltaNet linear attention with sparse Mixture-of-Experts and gated attention, using 6 blocks of 3 (Gated DeltaNet -> FFN) followed by 1 (Gated Attention -> FFN). Qwen3.5 highlights cited on the card include a unified vision-language foundation, scalable reinforcement learning across million-agent environments, and expanded coverage of 201 languages and dialects. The card states Qwen3.5 targets exceptional utility and performance with multimodal learning, architectural efficiency, and next-generation training infrastructure.
