Jiekou.AI
Hans Reinl's December 7, 2025 benchmark pits GPT-5.1-Codex-Max against Gemini 3 Pro and Claude Opus 4.5 on a full-stack MVP build called Speakit, executed locally inside Cursor to isolate model capability from platform tooling. The test covered URL and PDF text extraction, text-to-speech with playback controls, and a reading interface, followed by one iteration cycle to verify completeness. GPT-5.1-Codex-Max required post-generation fixes to start but completed iteration in 9 minutes 20 seconds total, including 8m 20s for initial generation and 1m for verification, outpacing Gemini 3 Pro's 15m 30s and Claude Opus 4.5's 22m. Lighthouse scores reached 74 mobile and 98 desktop. The article frames the comparison as a check on whether headline SWE-bench numbers translate into shipping product quality.
