Melious
Moonshot AI released Kimi K3 on July 16, 2026, as a 2.8 trillion parameter sparse Mixture-of-Experts model with 896 experts (16 active per token, ~104B active parameters), a 1 million token context window, and native text-and-vision integration with always-on reasoning. According to Yotta Labs, the open weights shipped The piece highlights that K3 does not fit on a single GPU or node — running it requires a multi-node cluster with 1.6 TB+ of aggregate GPU memory — and notes Moonshot's claimed 2.5x scaling-efficiency improvement over K2 via Kimi Delta Attention. Third-party benchmarks cited include strong coding leaderboard performanc