Vercel AI Gateway
Qwen3.8-27B scores 52 on the Artificial Analysis Intelligence Index at maximum reasoning effort and 61.7 on SWE-bench Pro per Qwen's own evaluation, leading its comparison set on agentic coding and computer-use benchmarks while trailing frontier models on Humanity's Last Exam and GPQA Diamond. The page labels which hea The excerpt provides Qwen3.8-27B benchmark figures from the model card against Qwen3.6-27B and Qwen3.7-Plus, including Terminal-Bench 2.1 at 73.0, SWE-bench Pro at 61.7, NL2Repo-Bench at 42.3, DeepSWE 1.1 at 42.2, QwenSWEBench at 79.0, CoWorkBench at 70.7, JobBench at 33.4, IFBench at 79.5, GPQA Diamond at 89.2, Humani
