Ollama Cloud
Aikido's security-focused benchmark study (published August 21, 2026) burned roughly 11.7 billion tokens testing ten contenders across three attempts on 32 fresh, off-the-shelf vulnerabilities. The lineup added GLM-5.3, DeepSeek V4 Pro 0813, DeepSeek V4 Flash 0731, Qwen3.8-Max, Kimi K3, and Grok 4.6 to its evaluation, The study concludes that open-source models now outperform the public closed frontier on pooled vulnerability recall, with DeepSeek V4 Pro topping every public closed model tested and Qwen, Kimi, and GLM-5.3 offering strong consistency. It also flags a trade-off: while coverage rose, the cheaper open models produced th
