Across 14 comparable benchmarks, OpenAI o3 has better reported results on 9 and worse on 5.
Moderate evidence14 of 14 shared results countedHow we compare
Gemini 2.5 Pro Experimental 03-25 is no longer available through its official API. API prices for this version are not shown.
Price basis: Listed rates vs standard rates. The price section below shows the applicable periods.
| Fact | Gemini 2.5 Pro Experimental 03-25 | OpenAI o3 |
|---|---|---|
| Context window | 1M tokens | 200K tokens |
| Input / 1M | — | $2.00 |
| Output / 1M | — | $8.00 |
| Blended (4:1) | — | $2.12 |
| Status | Retired | Deprecated |
| Released | March 25, 2025 | April 16, 2025 |
Blended is 4:1 input to output with 90% cache hits at listed rates — set your own mix.
Mean of 9 shared benchmarks grouped by capability on a 0–100 scale. How averages are built
OpenAI o3 ahead on 3 of 3 counted
OpenAI o3 ahead on 1 of 1 counted
No fixed-scale average — see the rows in Benchmark results
Gemini 2.5 Pro Experimental 03-25 ahead on 2 of 3 counted
Gemini 2.5 Pro Experimental 03-25 ahead on 1 of 1 counted
OpenAI o3 ahead on 1 of 1 counted
Split 1–1 of 2 counted
OpenAI o3 ahead on 1 of 1 counted
No fixed-scale average — see the rows in Benchmark results
No shared comparable results for Computer & tool use, Research & search, Cybersecurity.
Published scores, with matching modes where available. Gaps show Gemini 2.5 Pro Experimental 03-25 relative to OpenAI o3. Reading the results
| Benchmark | Gemini 2.5 Pro Experimental 03-25 | OpenAI o3 | Gap |
|---|---|---|---|
| Aider-PolyglotAgentic Development · Accuracy | 72.9Normal · no tools | 81.3≠Thinking High · no tools | −8.4 pts#8 vs #4 of 47 |
| LiveCodeBenchAlgorithmic Coding · Pass @K | 70.4Normal · no tools | 75.8Normal · no tools | 0.93×#55 vs #43 of 113 |
| SWE-bench VerifiedRepository Engineering · Accuracy | 63.8Normal · no tools | 69.1≠Thinking · no tools | −5.3 pts#75 vs #65 of 108 |
| SimpleBenchCommonsense · Score (AVG@5) | 51.6Normal · no tools | 53.1≠Thinking High · no tools | 0.97×#63 vs #61 of 106 |
| AIME 2024Mathematics · Accuracy | 92.0Normal · no tools | 91.6Normal · no tools | +0.4 pts#8 vs #9 of 54 |
| AIME2025Mathematics · Accuracy | 86.9Normal · no tools | 88.9≠Thinking · no tools | −2.0 pts#43 vs #37 of 86 |
| FrontierMath - Tier 4Mathematics · Accuracy | 4.2Normal · no tools | 2.1≠Thinking High · no tools | +2.1 pts#21 vs #31 of 50 |
| GPQA DiamondScientific Reasoning · Accuracy | 84.0Normal · no tools | 83.3≠Thinking · no tools | +0.7 pts#88 vs #94 of 200 |
| Fiction.liveBenchLong Reasoning · 16k-token score (%) | 66.7Normal · no tools | 88.9≠Thinking Medium · no tools | −22.2 pts#15 vs #6 of 28 |
| GeoBench ACWVisual Understanding · ACW country accuracy (%) | 81.0Normal · tools + web | 74.0≠Thinking Medium · no tools | +7.0 pts#10 vs #16 of 32 |
| VPCTVisual Understanding · Accuracy (%) | 48.0Normal · no tools | 52.0≠Thinking Medium · no tools | −4.0 pts#8 vs #7 of 26 |
| Creative WritingWriting | 1396Normal · no tools | 1675Normal · no tools | 0.83×#76 vs #37 of 121 |
| Reported separately from the capability domains; not included in the averages. Read each metric’s direction — lower can be better. | |||
| SimpleQAHonesty & Factuality · Accuracy | 52.9Normal · no tools | 49.4Normal · no tools | +3.5 pts#12 vs #14 of 46 |
| HLEKnowledge Exams · Accuracy | 18.8Normal · no tools | 20.3≠Thinking High · no tools | −1.5 pts#108 vs #102 of 151 |
Agentic Development · Accuracy
Algorithmic Coding · Pass @K
Repository Engineering · Accuracy
Commonsense · Score (AVG@5)
Mathematics · Accuracy
Mathematics · Accuracy
Mathematics · Accuracy
Scientific Reasoning · Accuracy
Long Reasoning · 16k-token score (%)
Visual Understanding · ACW country accuracy (%)
Visual Understanding · Accuracy (%)
Writing
Honesty & Factuality · Accuracy
Knowledge Exams · Accuracy
A dash means no result is available.
| Benchmark | Gemini 2.5 Pro Experimental 03-25 | OpenAI o3 |
|---|---|---|
| CritPt | — | 1.1 |
| FrontierMath | — | 10.3 |
| FrontierMath v2 | — | 33.3 |
| IMO-ProofBench | — | 20.5 |
| IMO-ProofBench Advanced | — | 20.5 |
| MATH-500 | — | 99.2 |
| MMLU-Pro | — | 85.6 |
| CodeClash | — | 1343 |
| GSO | — | 8.8 |
| Terminal Bench Hard | — | 37.1 |
| Terminal-Bench 1.0 | — | 30.2 |
| WeirdML v2 | — | 52.4 |
| Claw Bench | 80.4 | — |
| OSWorld-Verified | — | 23.0 |
| Pinch Bench | 71.9 | — |
| ECI | — | 147 |
| METR Time Horizons v1.1 | — | 91.3 |
| MMMU | — | 82.9 |
| MMMU-Pro | — | 76.4 |
| SAGE | — | 41.8 |
| ARC-AGI-1 | — | 60.8 |
| ARC-AGI-2 | — | 6.5 |
| BALROG | 43.3 | — |
| GAIA | — | 28.5 |
| MedCode | — | 47.3 |
| MedScribe | — | 76.7 |
Time-of-day providers use peak-hour rates; fixed-price providers use standard rates. Off-peak discounts remain in the published details.
Drag the handle above the bar for cache hits, the one below it for the input : output mix · 5% steps
Blended price = effective input rate at 90% cache hits × 80% + output rate × 20%
A blended cost needs a published input and output price on both sides, and one of these two does not have them yet.
Gemini 2.5 Pro Experimental 03-25: Listed text rates; pricing tier not confirmed.
OpenAI o3: Standard pricing. OpenAI official pricing (developers.openai.com/api/docs/pricing) verified 2026-11-13; standard tier; Deprecated; shutdown 2026-12-11 (replacement: gpt-6.1-sol)
| Price / 1M tokens | Gemini 2.5 Pro Experimental 03-25 | OpenAI o3 | Ratio |
|---|---|---|---|
| Input | — | $2.00 | — |
| Output | — | $8.00 | — |
| Cached input | — | $0.50 | — |
| Cache write | — | — | — |
| Blended | — | $2.12 | — |
Estimates use the selected token mix. Cache writes, tool fees and long-context surcharges are excluded.
Reported cost per task, paired with the score from the same run. Settings and sources may differ; costs do not affect the verdict.
| Attribute | Gemini 2.5 Pro Experimental 03-25 | OpenAI o3 |
|---|---|---|
| Availability | Retired | Deprecated |
| Provider | Google Deep Mind | OpenAI |
| Model type | Reasoning model | Reasoning model |
| First release | March 25, 2025 | April 16, 2025 |
| Context window | 1M tokens | 200K tokens |
| Max output | 64K tokens | 100K tokens |
| Architecture | Undisclosed | Undisclosed |
| Documented capabilities | Reasoning, Multilingual | Reasoning, Multilingual |
| Input modalities | Text, Image, Audio, Video | Text, Image |
| Output modalities | Text | Text |
| Weights | Closed / API only | Closed / API only |
| Commercial use | Proprietary | Proprietary |
These are reported-score comparisons, not controlled head-to-head tests.
What people found comparing these models, or using either one. Comments also appear on the models' own pages.
Used Gemini 2.5 Pro Experimental 03-25 or OpenAI o3? Sign in with Google to share what worked, what did not, and which API or setup you tested.
No community comments on either model yet.
Alternatives with the most benchmark overlap for this matchup.