Across 8 comparable benchmarks, Claude Haiku 5.5 has better reported results on 7 and worse on 1. 2 further shared results are listed below, each with the reason it is not counted.
Moderate evidence8 of 10 shared results countedHow we compare
Price basis: Standard rates vs listed rates. The price section below shows the applicable periods.
| Fact | GPT-5.1 | Claude Haiku 5.5 |
|---|---|---|
| Context window | 400K tokens | 1M tokens |
| Input / 1M | $1.25 | $0.100 |
| Output / 1M | $10.00 | $0.500 |
| Blended (4:1) | $2.19 | $0.115 |
| Status | Deprecated | Available |
| Released | November 12, 2025 | October 7, 2026 |
Blended is 4:1 input to output with 90% cache hits at listed rates β set your own mix.
Mean of 5 shared benchmarks grouped by capability on a 0β100 scale. How averages are built
Claude Haiku 5.5 ahead on 1 of 1 counted
Claude Haiku 5.5 ahead on 2 of 2 counted
Split 1β1 of 2 counted
Claude Haiku 5.5 ahead on 1 of 1 counted
No shared comparable results for Mathematics, Computer & tool use, Research & search, Long context, Multimodal, Cybersecurity.
Published scores, with matching modes where available. Gaps show GPT-5.1 relative to Claude Haiku 5.5. Reading the results
| Benchmark | GPT-5.1 | Claude Haiku 5.5 | Gap |
|---|---|---|---|
| Vibe Code Bench v1.1Code Generation & Editing Β· Pass rate (%) | 24.6Thinking High Β· tools | 90.4β Max Β· tools | β65.8 pts#81 vs #5 of 119 |
| ARC-AGI-1Abstract Generalization Β· Score (%) | 72.8Thinking High Β· no tools | 89.0β Max Β· no tools | β16.2 pts#50 vs #36 of 86 |
| ARC-AGI-2Abstract Generalization Β· Score (% solved); cost per task (USD)Not counted Β· Speed and cost telemetry is reported, not scored | 17.6Thinking High Β· no tools | 61.3β Extra-High Β· no tools | 0.29Γ#54 vs #34 of 79 |
| SimpleBenchCommonsense Β· Score (AVG@5) | 53.2Thinking High Β· no tools | 59.2β Reported best | 0.90Γ#55 vs #46 of 102 |
| Vending-Bench 2Logical Planning Β· Money Balance (USD)Not counted Β· Speed and cost telemetry is reported, not scored | 1473Unspecified Reasoning Β· tools | 3602Unspecified Reasoning Β· tools | 0.41Γ#51 vs #46 of 64 |
| MedCodeClinical Workflows Β· Accuracy (%) | 52.7Thinking High Β· tools | 51.5β Max Β· tools | +1.2 pts#13 vs #15 of 97 |
| MedScribeClinical Workflows Β· Rubric pass rate (%) | 88.1Thinking High Β· tools | 89.5β Max Β· tools | β1.5 pts#14 vs #6 of 99 |
| SAGEService Workflows Β· Accuracy (%) | 43.2Thinking High Β· tools | 45.8β Max Β· tools | β2.6 pts#51 vs #38 of 82 |
| HLEKnowledge Exams Β· Accuracy | 42.7Thinking High Β· tools + web | 57.4β Max Β· tools + web | β14.7 pts#74 vs #21 of 151 |
| LiveBenchCross-capability Suites Β· Accuracy | 72.0Thinking High Β· no tools | 72.1β Extra-High Β· no tools | β0.0 pts#50 vs #49 of 106 |
Code Generation & Editing Β· Pass rate (%)
Abstract Generalization Β· Score (%)
Abstract Generalization Β· Score (% solved); cost per task (USD)
Not counted Β· Speed and cost telemetry is reported, not scored
Commonsense Β· Score (AVG@5)
Logical Planning Β· Money Balance (USD)
Not counted Β· Speed and cost telemetry is reported, not scored
Service Workflows Β· Accuracy (%)
A dash means no result is available.
Time-of-day providers use peak-hour rates; fixed-price providers use standard rates. Off-peak discounts remain in the published details.
Drag the handle above the bar for cache hits, the one below it for the input : output mix Β· 5% steps
Blended price = effective input rate at 90% cache hits Γ 80% + output rate Γ 20%
GPT-5.1 costs1,801%morethan Claude Haiku 5.5 per million tokens β 19Γ the price.Using standard rates vs listed rates at this token mix.
GPT-5.1: Standard pricing. OpenAI official pricing (developers.openai.com/api/docs/pricing) verified 2026-11-13; standard tier; Deprecated; shutdown 2027-04-01 (replacement: gpt-6-sol)
Claude Haiku 5.5: Standard pricing. context_length <= 100000 Prompt length tier; text and image inputs are token billed. context_length > 100000
| Price / 1M tokens | GPT-5.1 | Claude Haiku 5.5 | Ratio |
|---|---|---|---|
| Input | $1.25 | $0.10 | 12.5Γ |
| Output | $10.00 | $0.50 | 20.0Γ |
| Cached input | $0.125 | $0.01 | 12.5Γ |
| Cache write | β | $0.125 | β |
| Blended | $2.19 | $0.115 | 19.0Γ |
Estimates use the selected token mix. Cache writes, tool fees and long-context surcharges are excluded.
Reported cost per task, paired with the score from the same run. Settings and sources may differ; costs do not affect the verdict.
GPT-5.1 relative to Claude Haiku 5.5
Summary: 2 of 6 shared benchmarks have matching recorded settings and sources. The average is a geometric mean of 2 positive-cost ratios, one equal weight per benchmark. This benchmark set can include related tests and indexes; it is not a workload cost estimate.
Effort, protocol, aggregation and source match; other run conditions may differ.
GPT-5.1
Claude Haiku 5.5
Effort, protocol, aggregation and source match; other run conditions may differ.
GPT-5.1
Claude Haiku 5.5
Settings or sources differ or are not recorded; interpret the comparison with care.
GPT-5.1
Claude Haiku 5.5
Settings or sources differ or are not recorded; interpret the comparison with care.
GPT-5.1
Claude Haiku 5.5
Settings or sources differ or are not recorded; interpret the comparison with care.
GPT-5.1
Claude Haiku 5.5
Settings or sources differ or are not recorded; interpret the comparison with care.
GPT-5.1
Claude Haiku 5.5
| Benchmark | GPT-5.1 | Claude Haiku 5.5 |
|---|---|---|
| AA Decision Index v2.1 | Not reported | |
| AA Intelligence Index v5.0.1 | Not reported | 2 more settings |
| Agent Arena | Not reported | $0.0778 / task Median Β· Net improvement index (percentage points vs. average model): 0.42 Thinking High (With Tools + Internet) |
| Agent Arena Index | Not reported | $0.0944 / task Median Β· Agent Arena Index rating (index points): 1095 Thinking High (With Tools + Internet) |
| AutomationBench | Not reported | $0.03 / task Average Β· Pass Rate: 10.5 Thinking High (With Tools) Β· zapier-private-heldout $0.02 / task Average Β· Pass Rate: 6.1 Thinking Low (With Tools) Β· zapier-private-heldout 2 more settings$0.02 / task Average Β· Pass Rate: 8.5 Thinking Medium (With Tools) Β· zapier-private-heldout $0.04 / task Average Β· Pass Rate: 9.9 Extra-High (With Tools) Β· zapier-private-heldout |
| Code Migration | Not reported | |
| CursorBench 4.0 | Not reported | $1.12 / task Average Β· Task score: 48.4 Max (With Tools) Β· cursorbench-4-0-cursor-agent $0.32 / task Average Β· Task score: 42.3 Thinking High (With Tools) Β· cursorbench-4-0-cursor-agent $0.08 / task Average Β· Task score: 30.9 Thinking Low (With Tools) Β· cursorbench-4-0-cursor-agent 2 more settings$0.17 / task Average Β· Task score: 36.9 Thinking Medium (With Tools) Β· cursorbench-4-0-cursor-agent $0.56 / task Average Β· Task score: 44.3 Extra-High (With Tools) Β· cursorbench-4-0-cursor-agent |
| EMB (Excel Modeling) | Not reported | |
| Finance Agent v2 | Not reported | |
| FrontierCode 1.1 | Not reported | $1.3284 / task Average Β· Weighted rubric score: 46.4 Max (With Tools) Β· frontiercode-1-1-main $0.256 / task Average Β· Weighted rubric score: 41.9 Thinking High (With Tools) Β· frontiercode-1-1-main $0.0596 / task Average Β· Weighted rubric score: 34.8 Thinking Low (With Tools) Β· frontiercode-1-1-main 2 more settings$0.13 / task Average Β· Weighted rubric score: 41.6 Thinking Medium (With Tools) Β· frontiercode-1-1-main $0.6297 / task Average Β· Weighted rubric score: 45.8 Extra-High (With Tools) Β· frontiercode-1-1-main |
| FrontierCode 2.0 | Not reported | $0.139 / task Average Β· Weighted rubric score: 18.6 Thinking High (With Tools + Internet) $0.065 / task Average Β· Weighted rubric score: 10.5 Thinking Low (With Tools + Internet) 2 more settings$0.097 / task Average Β· Weighted rubric score: 13.4 Thinking Medium (With Tools + Internet) |
| FrontierSWE v2 | Not reported | |
| GDPx | Not reported | |
| IOI (Vals v2) | Not reported | |
| Legal Research Bench | Not reported | |
| LiveBench 2.0 | Not reported | $0.6189 / task Average Β· Overall score (equal-weight mean of 7 suite scores, 0-100): 75.6 Max (task-specific tools) |
| MysteryMechanism | Not reported | |
| ProofBench v1.1 (Lean 4) | Not reported | |
| Public Benefits Bench v1.1 | Not reported | |
| Tax Agent Bench | Not reported | $1.1642 / task Average Β· Accuracy (%, rubric Γ citation quality): 31.9 Unspecified Reasoning (With Tools) |
| Terminal-Bench 2.1 | Not reported | |
| Terminal-Bench 4.0 | Not reported | $3.12 / task Average Β· Resolution rate (%): 36.4 Unspecified Reasoning (With Tools) Β· vals-mini-swe |
| Terminal-Bench 4.1 | Not reported | |
| Vals Index v2.2 | Not reported | |
| Vibe Code Bench 1-100 | Not reported | |
| WeirdML v3 | Not reported | $2.3004 / task Average Β· Official score (0-1; higher is better): 0.12 Extra-High (With Tools) |
| Attribute | GPT-5.1 | Claude Haiku 5.5 |
|---|---|---|
| Availability | Deprecated | Available |
| Provider | OpenAI | Anthropic |
| Model type | Reasoning model | Reasoning model |
| First release | November 12, 2025 | October 7, 2026 |
| Context window | 400K tokens | 1M tokens |
| Max output | 128K tokens | 128K tokens |
| Architecture | Undisclosed | Undisclosed |
| Documented capabilities | Reasoning, Multilingual | Reasoning |
| Knowledge cutoff | β | 2026-06 |
| Input modalities | Text, Image | Text, Image |
| Output modalities | Text | Text |
| Weights | Closed / API only | Closed / API only |
| Commercial use | Proprietary | Proprietary |
These are reported-score comparisons, not controlled head-to-head tests.
What people found comparing these models, or using either one. Comments also appear on the models' own pages.
Used GPT-5.1 or Claude Haiku 5.5? Sign in with Google to share what worked, what did not, and which API or setup you tested.
No community comments on either model yet.
Alternatives with the most benchmark overlap for this matchup.