Across 11 comparable benchmarks, OpenAI o3 has better reported results on 11 and worse on 0.
Moderate evidence11 of 11 shared results countedHow we compare
Price basis: Standard rates. The price section below shows the applicable periods.
| Fact | OpenAI o3 | Gemini 2.5 Flash-Lite |
|---|---|---|
| Context window | 200K tokens | 1M tokens |
| Input / 1M | $2.00 | $0.100 |
| Output / 1M | $8.00 | $0.400 |
| Blended (4:1) | $2.12 | $0.095 |
| Status | Deprecated | Available |
| Released | April 16, 2025 | June 17, 2025 |
Blended is 4:1 input to output with 90% cache hits at listed rates — set your own mix.
Mean of 8 shared benchmarks grouped by capability on a 0–100 scale. How averages are built
OpenAI o3 ahead on 3 of 3 counted
OpenAI o3 ahead on 1 of 1 counted
OpenAI o3 ahead on 3 of 3 counted
OpenAI o3 ahead on 1 of 1 counted
OpenAI o3 ahead on 1 of 1 counted
No shared comparable results for Abstract reasoning, Computer & tool use, Research & search, Long context, Cybersecurity.
Published scores, with matching modes where available. Gaps show OpenAI o3 relative to Gemini 2.5 Flash-Lite. Reading the results
| Benchmark | OpenAI o3 | Gemini 2.5 Flash-Lite | Gap |
|---|---|---|---|
| LiveCodeBenchAlgorithmic Coding · Pass @K | 75.8Normal · no tools | 34.3Normal · no tools | 2.21×#43 vs #102 of 113 |
| SWE-bench VerifiedRepository Engineering · Accuracy | 69.1Thinking · no tools | 27.6≠Normal · no tools | +41.5 pts#65 vs #105 of 108 |
| Terminal Bench HardAgentic Development · Accuracy | 37.1Thinking · tools | 4.5Thinking · tools | +32.6 pts#43 vs #137 of 157 |
| AIME2025Mathematics · Accuracy | 88.9Thinking · no tools | 63.1≠Normal · no tools | +25.8 pts#37 vs #73 of 86 |
| GPQA DiamondScientific Reasoning · Accuracy | 83.3Thinking · no tools | 66.7≠Normal · no tools | +16.6 pts#94 vs #151 of 200 |
| MedCodeClinical Workflows · Accuracy (%) | 47.3Thinking High · tools | 27.1≠Unspecified Reasoning · tools | +20.2 pts#33 vs #93 of 97 |
| MedScribeClinical Workflows · Rubric pass rate (%) | 76.7Thinking High · tools | 72.8≠Unspecified Reasoning · tools | +3.8 pts#67 vs #79 of 99 |
| MMMU-ProVisual Understanding · Accuracy | 76.4Reported best | 58.2≠Thinking · no tools | +18.2 pts#56 vs #110 of 136 |
| SAGEService Workflows · Accuracy (%) | 41.8Thinking High · tools | 27.5≠Unspecified Reasoning · tools | +14.2 pts#56 vs #79 of 82 |
| Reported separately from the capability domains; not included in the averages. Read each metric’s direction — lower can be better. | |||
| SimpleQAHonesty & Factuality · Accuracy | 49.4Normal · no tools | 13.0Normal · no tools | +36.4 pts#14 vs #38 of 46 |
| HLEKnowledge Exams · Accuracy | 20.3Thinking High · no tools | 6.9≠Normal · no tools | +13.4 pts#102 vs #137 of 151 |
Algorithmic Coding · Pass @K
Repository Engineering · Accuracy
Agentic Development · Accuracy
Mathematics · Accuracy
Scientific Reasoning · Accuracy
Clinical Workflows · Accuracy (%)
Clinical Workflows · Rubric pass rate (%)
Visual Understanding · Accuracy
Service Workflows · Accuracy (%)
Honesty & Factuality · Accuracy
Knowledge Exams · Accuracy
A dash means no result is available.
| Benchmark | OpenAI o3 | Gemini 2.5 Flash-Lite |
|---|---|---|
| AIME 2024 | 91.6 | — |
| CritPt | 1.1 | — |
| FrontierMath | 10.3 | — |
| FrontierMath - Tier 4 | 2.1 | — |
| FrontierMath v2 | 33.3 | — |
| IMO-ProofBench | 20.5 | — |
| IMO-ProofBench Advanced | 20.5 | — |
| MATH-500 | 99.2 | — |
| MMLU | — | 84.5 |
| MMLU-Pro | 85.6 | — |
| Aider-Polyglot | 81.3 | — |
| CodeClash | 1343 | — |
| GSO | 8.8 | — |
| Terminal-Bench 1.0 | 30.2 | — |
| WeirdML v2 | 52.4 | — |
| OSWorld-Verified | 23.0 | — |
| ECI | 147 | — |
| LiveBench | — | 42.6 |
| METR Time Horizons v1.1 | 91.3 | — |
| Creative Writing | 1675 | — |
| Fiction.liveBench | 88.9 | — |
| GeoBench ACW | 74.0 | — |
| MMMU | 82.9 | — |
| VPCT | 52.0 | — |
| ARC-AGI-1 | 60.8 | — |
| ARC-AGI-2 | 6.5 | — |
| SimpleBench | 53.1 | — |
| GAIA | 28.5 | — |
Time-of-day providers use peak-hour rates; fixed-price providers use standard rates. Off-peak discounts remain in the published details.
Drag the handle above the bar for cache hits, the one below it for the input : output mix · 5% steps
Blended price = effective input rate at 90% cache hits × 80% + output rate × 20%
OpenAI o3 costs2,127%morethan Gemini 2.5 Flash-Lite per million tokens — 22.3× the price.Using standard rates at this token mix.
OpenAI o3: Standard pricing. OpenAI official pricing (developers.openai.com/api/docs/pricing) verified 2026-11-13; standard tier; Deprecated; shutdown 2026-12-11 (replacement: gpt-6.1-sol)
Gemini 2.5 Flash-Lite: Standard pricing. Google Gemini API official pricing (ai.google.dev/gemini-api/docs/pricing) verified 2026-11-13; paid tier; standard tier; text input Google Gemini API official pricing (ai.google.dev/gemini-api/docs/pricing) verified 2026-11-13; paid tier; standard tier; output
| Price / 1M tokens | OpenAI o3 | Gemini 2.5 Flash-Lite | Ratio |
|---|---|---|---|
| Input | $2.00 | $0.10 | 20.0× |
| Output | $8.00 | $0.40 | 20.0× |
| Cached input | $0.50 | $0.01 | 50.0× |
| Cache write | — | — | — |
| Blended | $2.12 | $0.095 | 22.3× |
Estimates use the selected token mix. Cache writes, tool fees and long-context surcharges are excluded.
Reported cost per task, paired with the score from the same run. Settings and sources may differ; costs do not affect the verdict.
| Attribute | OpenAI o3 | Gemini 2.5 Flash-Lite |
|---|---|---|
| Availability | Deprecated | Available |
| Provider | OpenAI | Google Deep Mind |
| Model type | Reasoning model | Reasoning model |
| First release | April 16, 2025 | June 17, 2025 |
| Context window | 200K tokens | 1M tokens |
| Max output | 100K tokens | 64K tokens |
| Architecture | Undisclosed | Undisclosed |
| Documented capabilities | Reasoning, Multilingual | Reasoning, Multilingual |
| Input modalities | Text, Image | Text, Image, Audio, Video |
| Output modalities | Text | Text |
| Weights | Closed / API only | Closed / API only |
| Commercial use | Proprietary | Proprietary |
These are reported-score comparisons, not controlled head-to-head tests.
What people found comparing these models, or using either one. Comments also appear on the models' own pages.
Used OpenAI o3 or Gemini 2.5 Flash-Lite? Sign in with Google to share what worked, what did not, and which API or setup you tested.
No community comments on either model yet.
Alternatives with the most benchmark overlap for this matchup.