Regolo AI
⚡ Update: v2 (post #71) achieves 51 tok/s. v2.1 (post #104) adds a quick-start script. See those posts for the latest setup. Been chasing every last token/second out of Qwen3.5-122B-A10B on a single DGX Spark for the pa…
Model details
Qwen3.5-122B is designed as a unified vision-language foundation that reaches cross-generational parity with earlier Qwen3 models and outperforms dedicated vision variants across reasoning, coding, agent, and visual understanding benchmarks. The architecture pairs Gated Delta Networks with a sparse Mixture-of-Experts layout, yielding a 122B-parameter model with roughly 10B active parameters (denoted A10B) that delivers high-throughput inference at modest latency and cost overhead. Early fusion training on multimodal tokens lets a single checkpoint handle text and images together, while an asynchronous reinforcement-learning stack has been scaled across million-agent environments with progressively complex task distributions to improve real-world adaptability.
Practical deployment is straightforward: the open-weight release ships in a Hugging Face Transformers-compatible format and runs on engines such as vLLM, SGLang, and KTransformers, with a community-tuned Q4_K_M quantisation weighing around 81 GB. The expanded training corpus broadens linguistic coverage to 201 languages and dialects, making the model a strong fit for globally distributed assistants, document understanding, and tool-using agents that mix vision and text. Hobbyists have already demonstrated single-workstation inference reaching about 51 tokens per second on compact Spark-class hardware, hinting that serious workloads no longer require a full data-centre setup.
Regolo AI
⚡ Update: v2 (post #71) achieves 51 tok/s. v2.1 (post #104) adds a quick-start script. See those posts for the latest setup. Been chasing every last token/second out of Qwen3.5-122B-A10B on a single DGX Spark for the pa…