Deep Infra
The official tencent/Hy3-preview model card on Hugging Face documents the architecture in detail: 295B total parameters with 21B activated, 3.8B MTP layer parameters, 80 non-MTP layers plus 1 MTP layer, 64 attention heads using grouped-query attention with 8 KV heads at head dim 128, hidden size 4096, intermediate size The card highlights gains in STEM reasoning (FrontierScience-Olympiad, IMOAnswerBench, the Tsinghua Qiuzhen College Math PhD qualifying exam Spring 2026, and CHSBO 2025), context learning and instruction following (via Tencent's CL-bench and CL-bench-Life), and code/agent performance on SWE-bench Verified, Terminal-Ben
