Abacus
OpenAI's o3 model, released April 16, 2025 as part of the o-series family, has 44 official benchmark scores tracked by evals.report across reasoning, coding, multimodal, agent, and tool-use evaluations. Notable highlights include GPQA Diamond at 81.8% accuracy, MMLU-Pro at 85.3%, MathVista at 86.8%, and FrontierMath at 18.69%, with each result carrying source-status flags. SWE-bench Verified coding performance reached 62.3% resolved. The aggregator records ARC-AGI-1 at 60.83% accuracy and the harder ARC-AGI-2 at only 6.53%, alongside an Artificial Analysis Intelligence Index of 38.4 and an Epoch Capabilities Index of 147.3. Tool-use scores include Berkeley Function Calling Leaderboard at 63.05% and τ²-bench Telecom at 58.2% pass^1. METR Task-Completion Time Horizons is listed at 119.7 minutes for a 50% time horizon, with LiveCodeBench Pro at 1010 Codeforces Elo.
