Across 8 comparable benchmarks, Gemini 2.5-Pro has better reported results on 8 and worse on 0.
Moderate evidence8 of 8 shared results countedHow we compare
Gemini 2.5-Pro is no longer available through its official API. API prices for this version are not shown.
Price basis: Listed rates vs listed rates. The price section below shows the applicable periods.
| Fact | GPT-4.1 nano | Gemini 2.5-Pro |
|---|---|---|
| Context window | 1M tokens | 1M tokens |
| Input / 1M | $0.100 | — |
| Output / 1M | $0.400 | — |
| Blended (4:1) | $0.106 | — |
| Status | Deprecated | Retired |
| Released | April 14, 2025 | June 5, 2025 |
Blended is 4:1 input to output with 90% cache hits at listed rates — set your own mix.
Mean of 6 shared benchmarks grouped by capability on a 0–100 scale. How averages are built
Gemini 2.5-Pro ahead on 2 of 2 counted
Gemini 2.5-Pro ahead on 1 of 1 counted
Gemini 2.5-Pro ahead on 1 of 1 counted
Gemini 2.5-Pro ahead on 1 of 1 counted
Gemini 2.5-Pro ahead on 1 of 1 counted
Gemini 2.5-Pro ahead on 2 of 2 counted
No fixed-scale average — see the rows in Benchmark results
No shared comparable results for Abstract reasoning, Computer & tool use, Research & search, Cybersecurity.
Published scores, with matching modes where available. Gaps show GPT-4.1 nano relative to Gemini 2.5-Pro. Reading the results
| Benchmark | GPT-4.1 nano | Gemini 2.5-Pro | Gap |
|---|---|---|---|
| Aider-PolyglotAgentic Development · Accuracy | 8.9Normal · no tools | 83.1≠Thinking · no tools · 32K | −74.2 pts#45 vs #3 of 47 |
| Terminal Bench HardAgentic Development · Accuracy | 3.8Normal · tools | 26.5≠Thinking · tools | −22.7 pts#140 vs #76 of 157 |
| FrontierMathMathematics · Accuracy | 1.0Normal · no tools | 11.0Normal · no tools | −10.0 pts#40 vs #18 of 48 |
| GPQA DiamondScientific Reasoning · Accuracy | 50.3Normal · no tools | 86.4≠Thinking · no tools | −36.1 pts#178 vs #72 of 200 |
| Fiction.liveBenchLong Reasoning · 16k-token score (%) | 25.0Normal · no tools | 91.7Normal · no tools | −66.7 pts#28 vs #5 of 28 |
| MMMU-ProVisual Understanding · Accuracy | 40.1Normal · no tools | 74.9≠Thinking · no tools | −34.8 pts#131 vs #69 of 136 |
| Creative WritingWriting | 939Normal · no tools | 1422Normal · no tools | 0.66×#105 vs #69 of 121 |
| τ³-BankingService Workflows · Score | 3.5Normal · tools | 13.7≠Thinking High · tools | 0.26×#118 vs #78 of 120 |
Agentic Development · Accuracy
Agentic Development · Accuracy
Mathematics · Accuracy
Scientific Reasoning · Accuracy
Long Reasoning · 16k-token score (%)
Visual Understanding · Accuracy
Writing
Service Workflows · Score
A dash means no result is available.
| Benchmark | GPT-4.1 nano | Gemini 2.5-Pro |
|---|---|---|
| AIME 2024 | 29.4 | — |
| AIME2025 | — | 88.0 |
| CritPt | — | 2.6 |
| FrontierMath - Tier 4 | — | 2.1 |
| HLE | — | 21.6 |
| IMO-ProofBench | — | 55.2 |
| IMO-ProofBench Advanced | — | 17.6 |
| MATH-500 | — | 98.8 |
| MMLU | 80.1 | — |
| MMLU-Pro | — | 86.2 |
| SciCode | — | 46.3 |
| CodeClash | — | 1125 |
| GSO | — | 3.9 |
| IC SWE-Lancer (Diamond) | 15.3 | — |
| IOI 2024 (Vals v1) | — | 19 |
| IOI 2025 (Vals v1) | — | 15.2 |
| LiveCodeBench | — | 77.1 |
| SWE-Bench Pro - Commercial | — | 10.1 |
| SWE-bench Verified | — | 67.2 |
| Terminal Bench 2.0 | — | 32.6 |
| Terminal-Bench 1.0 | — | 25.3 |
| ECI | 130 | — |
| LiveBench | — | 58.3 |
| METR Time Horizons v1.1 | — | 38.7 |
| IF Bench | — | 49.0 |
| GDP.pdf | — | 10.2 |
| MMMU | — | 82.0 |
| VPCT | — | 46.4 |
| GDPval-AA | — | 22.0 |
| ARC-AGI-1 | — | 37.0 |
| ARC-AGI-2 | — | 4.9 |
| SimpleBench | — | 62.4 |
| BrowseComp | — | 7.8 |
| SimpleQA | — | 54.0 |
Time-of-day providers use peak-hour rates; fixed-price providers use standard rates. Off-peak discounts remain in the published details.
Drag the handle above the bar for cache hits, the one below it for the input : output mix · 5% steps
Blended price = effective input rate at 90% cache hits × 80% + output rate × 20%
A blended cost needs a published input and output price on both sides, and one of these two does not have them yet.
GPT-4.1 nano: Listed text rates; pricing tier not confirmed.
Gemini 2.5-Pro: Listed text rates; pricing tier not confirmed.
| Price / 1M tokens | GPT-4.1 nano | Gemini 2.5-Pro | Ratio |
|---|---|---|---|
| Input | $0.10 | — | — |
| Output | $0.40 | — | — |
| Cached input | $0.025 | — | — |
| Cache write | — | — | — |
| Blended | $0.106 | — | — |
Estimates use the selected token mix. Cache writes, tool fees and long-context surcharges are excluded.
Lower prices are highlighted. The cache hit rate applies to input tokens only; models without a published cached-input rate use their normal input price for those tokens.Effective dates: GPT-4.1 nano 2026-11-14; Gemini 2.5-Pro —.Reported cost per task, paired with the score from the same run. Settings and sources may differ; costs do not affect the verdict.
| Benchmark | GPT-4.1 nano | Gemini 2.5-Pro |
|---|---|---|
| ARC-AGI-2 | Not reported |
| Attribute | GPT-4.1 nano | Gemini 2.5-Pro |
|---|---|---|
| Availability | Deprecated | Retired |
| Provider | OpenAI | Google Deep Mind |
| Model type | Chat model | Reasoning model |
| First release | April 14, 2025 | June 5, 2025 |
| Context window | 1M tokens | 1M tokens |
| Max output | 32K tokens | 64K tokens |
| Architecture | Undisclosed | Undisclosed |
| Documented capabilities | Multilingual | Reasoning, Multilingual |
| Input modalities | Text, Image | Text, Image |
| Output modalities | Text | Text |
| Weights | Closed / API only | Closed / API only |
| Commercial use | Proprietary | Proprietary |
These are reported-score comparisons, not controlled head-to-head tests.
What people found comparing these models, or using either one. Comments also appear on the models' own pages.
Used GPT-4.1 nano or Gemini 2.5-Pro? Sign in with Google to share what worked, what did not, and which API or setup you tested.
No community comments on either model yet.
Alternatives with the most benchmark overlap for this matchup.