Across 3 comparable benchmarks, Gemini 3.5 Flash has better reported results on 3 and worse on 0.
Moderate evidence3 of 3 shared results countedHow we compare
GPT-5.1 Codex Mini is no longer available through its official API. API prices for this version are not shown.
Price basis: Standard rates vs listed rates. The price section below shows the applicable periods.
| Fact | Gemini 3.5 Flash | GPT-5.1 Codex Mini |
|---|---|---|
| Context window | 1M tokens | — |
| Input / 1M | $1.50 | — |
| Output / 1M | $9.00 | — |
| Blended (4:1) | $2.03 | — |
| Status | Deprecated | Retired |
| Released | May 19, 2026 | November 14, 2025 |
Blended is 4:1 input to output with 90% cache hits at listed rates — set your own mix.
Mean of 2 shared benchmarks grouped by capability on a 0–100 scale. How averages are built
Gemini 3.5 Flash ahead on 1 of 1 counted
Gemini 3.5 Flash ahead on 1 of 1 counted
No shared comparable results for Abstract reasoning, Mathematics, Science & health, Computer & tool use, Research & search, Long context, Professional work & productivity, Cybersecurity.
Published scores, with matching modes where available. Gaps show Gemini 3.5 Flash relative to GPT-5.1 Codex Mini. Reading the results
| Benchmark | Gemini 3.5 Flash | GPT-5.1 Codex Mini | Gap |
|---|---|---|---|
| Terminal Bench HardAgentic Development · Accuracy | 46.2Normal · tools | 33.3≠Thinking High · tools | +12.9 pts#18 vs #58 of 157 |
| MMMU-ProVisual Understanding · Accuracy | 84.3Thinking High · no tools | 69.0Thinking High · no tools | +15.3 pts#11 vs #88 of 136 |
| LiveBenchCross-capability Suites · Accuracy | 74.6Thinking High · no tools | 60.4≠Normal · no tools | +14.3 pts#35 vs #84 of 106 |
Agentic Development · Accuracy
Visual Understanding · Accuracy
Cross-capability Suites · Accuracy
A dash means no result is available.
Time-of-day providers use peak-hour rates; fixed-price providers use standard rates. Off-peak discounts remain in the published details.
Drag the handle above the bar for cache hits, the one below it for the input : output mix · 5% steps
Blended price = effective input rate at 90% cache hits × 80% + output rate × 20%
A blended cost needs a published input and output price on both sides, and one of these two does not have them yet.
Gemini 3.5 Flash: Standard pricing. Official Gemini Developer API standard input price. Official Gemini Developer API output price, including thinking tokens.
GPT-5.1 Codex Mini: Listed text rates; pricing tier not confirmed.
| Price / 1M tokens | Gemini 3.5 Flash | GPT-5.1 Codex Mini | Ratio |
|---|---|---|---|
| Input | $1.50 | — | — |
| Output | $9.00 | — | — |
| Cached input | $0.15 | — | — |
| Cache write | — | — | — |
| Blended | $2.03 | — | — |
Estimates use the selected token mix. Cache writes, tool fees and long-context surcharges are excluded.
Reported cost per task, paired with the score from the same run. Settings and sources may differ; costs do not affect the verdict.
| Benchmark | Gemini 3.5 Flash | GPT-5.1 Codex Mini |
|---|---|---|
| AIME 2026 | Not reported | |
| ARC-AGI-1 | Not reported | |
| ARC-AGI-2 | $0.8503 / task Average · ARC-AGI-2 Score: 72.1 Thinking High (With Tools) | Not reported |
| AutomationBench | $0.42 / task Average · Pass Rate: 13.4 Thinking High (With Tools) · zapier-private-heldout $0.38 / task Average · Pass Rate: 11.4 Thinking Medium (With Tools) · zapier-private-heldout 1 more settings | Not reported |
| DeepSWE | Not reported | |
| Tax Agent Bench | $0.8597 / task Average · Accuracy (%, rubric × citation quality): 21.6 Thinking High (With Tools) | Not reported |
| Terminal-Bench 4.0 | $5.98 / task Average · Resolution rate (%): 6.1 Unspecified Reasoning (With Tools) · vals-mini-swe | Not reported |
| Vals Index v2.1 | Not reported |
| Attribute | Gemini 3.5 Flash | GPT-5.1 Codex Mini |
|---|---|---|
| Availability | Deprecated | Retired |
| Provider | Google Deep Mind | OpenAI |
| Model type | Multimodal model | Coding model |
| First release | May 19, 2026 | November 14, 2025 |
| Context window | 1M tokens | — |
| Max output | 64K tokens | — |
| Architecture | Undisclosed | Undisclosed |
| Documented capabilities | Reasoning, Multilingual, Function calling, Tool use, Structured output, Web search, Computer use, Long context | Reasoning, Coding |
| Knowledge cutoff | 2025-01 | — |
| Input modalities | Text, Image, Audio, Video | Text, Image |
| Output modalities | Text | Text |
| Weights | Closed / API only | Closed / API only |
| Commercial use | Proprietary | Proprietary |
These are reported-score comparisons, not controlled head-to-head tests.
What people found comparing these models, or using either one. Comments also appear on the models' own pages.
Used Gemini 3.5 Flash or GPT-5.1 Codex Mini? Sign in with Google to share what worked, what did not, and which API or setup you tested.
No community comments on either model yet.
Alternatives with the most benchmark overlap for this matchup.