Across 8 comparable benchmarks, GPT-5.1 Codex has better reported results on 6 and worse on 2.
Moderate evidence8 of 8 shared results countedHow we compare
GPT-5.1 Codex is no longer available through its official API. API prices for this version are not shown.
Price basis: Standard rates vs listed rates. The price section below shows the applicable periods.
| Fact | Haiku 4.5 | GPT-5.1 Codex |
|---|---|---|
| Context window | 200K tokens | 400K tokens |
| Input / 1M | $1.00 | — |
| Output / 1M | $5.00 | — |
| Blended (4:1) | $1.15 | — |
| Status | Available | Retired |
| Released | October 15, 2025 | November 14, 2025 |
Blended is 4:1 input to output with 90% cache hits at listed rates — set your own mix.
Mean of 6 shared benchmarks grouped by capability on a 0–100 scale. How averages are built
GPT-5.1 Codex ahead on 4 of 5 counted
Haiku 4.5 ahead on 1 of 1 counted
GPT-5.1 Codex ahead on 1 of 1 counted
No shared comparable results for Abstract reasoning, Science & health, Computer & tool use, Research & search, Long context, Professional work & productivity, Cybersecurity.
Published scores, with matching modes where available. Gaps show Haiku 4.5 relative to GPT-5.1 Codex. Reading the results
| Benchmark | Haiku 4.5 | GPT-5.1 Codex | Gap |
|---|---|---|---|
| LiveCodeBenchAlgorithmic Coding · Pass @K | 62.0Extended · no tools | 85.5≠Thinking High · tools | 0.73×#69 vs #24 of 113 |
| SWE-bench VerifiedRepository Engineering · Accuracy | 73.3Thinking · tools · 128K | 70.4≠Thinking High · tools | +2.9 pts#47 vs #60 of 108 |
| Terminal Bench HardAgentic Development · Accuracy | 27.3Normal · tools | 34.8≠Thinking High · tools | −7.5 pts#74 vs #50 of 157 |
| Terminal-Bench 1.0Agentic Development · Accuracy | 41.8Thinking · tools · 32K | 56.3≠Thinking High · tools | −14.5 pts#8 vs #1 of 26 |
| Vibe Code Bench v1.1Code Generation & Editing · Pass rate (%) | 11.4Thinking · tools | 13.1≠Thinking High · tools | −1.7 pts#102 vs #99 of 121 |
| AIME2025Mathematics · Accuracy | 96.3Thinking · tools · 128K | 95.7≠Thinking High · no tools | +0.6 pts#18 vs #22 of 86 |
| MMMU-ProVisual Understanding · Accuracy | 58.6Thinking · no tools | 72.5≠Thinking High · no tools | −13.9 pts#109 vs #80 of 136 |
| LiveBenchCross-capability Suites · Accuracy | 61.3Thinking · no tools · 64K | 68.6≠Normal · no tools | −7.3 pts#82 vs #63 of 106 |
Algorithmic Coding · Pass @K
Repository Engineering · Accuracy
Agentic Development · Accuracy
Agentic Development · Accuracy
Code Generation & Editing · Pass rate (%)
Mathematics · Accuracy
Visual Understanding · Accuracy
Cross-capability Suites · Accuracy
A dash means no result is available.
| Benchmark | Haiku 4.5 | GPT-5.1 Codex |
|---|---|---|
| CritPt | — | 5.7 |
| FrontierMath | 4.1 | — |
| FrontierMath - Tier 4 | 2.1 | — |
| GPQA Diamond | 73.3 | — |
| HLE | 9.7 | — |
| MMLU-Pro | 80.0 | — |
| SciCode | 42.2 | — |
| APEX-SWE | — | 29.0 |
| Code Migration | 7.5 | — |
| SWE-Bench Pro - Public | 39.5 | — |
| SWE-Bench Pro V2 Hard | 25.5 | — |
| Terminal Bench 2.0 | — | 52.8 |
| Claw Bench | 89.4 | — |
| MCP-Atlas | 40.2 | — |
| OSWorld 2.1 | 15.7 | — |
| Pinch Bench | 82.0 | — |
| PinchBench v2 | 67.7 | — |
| ExploitBench | 13.7 | — |
| AA Intelligence Index v5.0.1 | 7.4 | — |
| ECI | 142 | — |
| LiveBench 2.0 | 46.0 | — |
| Vals Index | 22.9 | — |
| IF Bench | 54.3 | — |
| Context Arena | 36.3 | — |
| GDP.pdf | 3.8 | — |
| MMMU | 73.2 | — |
| AA-AnalystAgent | 15.0 | — |
| AutomationBench | 0.46 | — |
| EMB (Excel Modeling) | 22.7 | — |
| Finance Agent v2 | 31.0 | — |
| Harvey Lab-AA | 61.0 | — |
| Harvey's Legal Agent Benchmark | 0.83 | — |
| Legal Research Bench | 10.6 | — |
| Public Benefits Bench v1.1 | 54.3 | — |
| SAGE | 31.8 | — |
| τ²-Bench | 33.0 | — |
| τ³-Banking | 9.3 | — |
| ARC-AGI-1 | 47.7 | — |
| ARC-AGI-2 | 4.5 | — |
| BALROG | 31.2 | — |
| Vending-Bench 2 | 459 | — |
| GAIA | 56.4 | — |
| MedCode | 32.7 | — |
| MedScribe | 85.2 | — |
Time-of-day providers use peak-hour rates; fixed-price providers use standard rates. Off-peak discounts remain in the published details.
Drag the handle above the bar for cache hits, the one below it for the input : output mix · 5% steps
Blended price = effective input rate at 90% cache hits × 80% + output rate × 20%
A blended cost needs a published input and output price on both sides, and one of these two does not have them yet.
Haiku 4.5: Standard pricing. Anthropic official pricing (platform.claude.com/docs/en/about-claude/pricing) verified 2026-11-13
GPT-5.1 Codex: Listed text rates; pricing tier not confirmed.
| Price / 1M tokens | Haiku 4.5 | GPT-5.1 Codex | Ratio |
|---|---|---|---|
| Input | $1.00 | — | — |
| Output | $5.00 | — | — |
| Cached input | $0.10 | — | — |
| Cache write | — | — | — |
| Blended | $1.15 | — | — |
Estimates use the selected token mix. Cache writes, tool fees and long-context surcharges are excluded.
Reported cost per task, paired with the score from the same run. Settings and sources may differ; costs do not affect the verdict.
| Benchmark | Haiku 4.5 | GPT-5.1 Codex |
|---|---|---|
| AA Intelligence Index v5.0.1 | Not reported | |
| ARC-AGI-1 | Not reported | |
| AutomationBench | $0.07 / task Average · Pass Rate: 0.46 Reported best (effort unspecified) · zapier-private-heldout | Not reported |
| LiveBench 2.0 | $0.934 / task Average · Overall score (equal-weight mean of 7 suite scores, 0-100): 46.0 Max (task-specific tools) | Not reported |
| Public Benefits Bench v1.1 | $0.2245 / task Average · Criterion pass rate (%): 54.3 Unspecified Reasoning (With Tools) | Not reported |
| Attribute | Haiku 4.5 | GPT-5.1 Codex |
|---|---|---|
| Availability | Available | Retired |
| Provider | Anthropic | OpenAI |
| Model type | Multimodal model | Coding model |
| First release | October 15, 2025 | November 14, 2025 |
| Context window | 200K tokens | 400K tokens |
| Max output | 64K tokens | 128K tokens |
| Architecture | Undisclosed | Undisclosed |
| Documented capabilities | Reasoning, Multilingual | Reasoning, Coding |
| Input modalities | Text, Image | Text, Image |
| Output modalities | Text | Text |
| Weights | Closed / API only | Closed / API only |
| Commercial use | Proprietary | Proprietary |
These are reported-score comparisons, not controlled head-to-head tests.
What people found comparing these models, or using either one. Comments also appear on the models' own pages.
Used Haiku 4.5 or GPT-5.1 Codex? Sign in with Google to share what worked, what did not, and which API or setup you tested.
No community comments on either model yet.
Alternatives with the most benchmark overlap for this matchup.