Jalapeno Cloud
The Hugging Face model card for tencent/Hy3-preview documents the official open-weights release of Hy3 preview, a 295B-parameter Mixture-of-Experts model with 21B active parameters, 3.8B MTP layer parameters, 192 experts with top-8 routing, 80 layers, 64 attention heads (GQA, 8 KV heads, head dim 128), hidden size 4096 According to the same Hugging Face page, Hy3 preview highlights gains in STEM and reasoning benchmarks including FrontierScience-Olympiad, IMOAnswerBench, the Tsinghua Qiuzhen College Math PhD qualifying exam (Spring '26), and the China High School Biology Olympiad (CHSBO 2025). Context learning and instruction followi
