Across 16 comparable benchmarks, Gemini 3.5 Flash has better reported results on 14 and worse on 2. 2 further shared results are listed below, each with the reason it is not counted.
Strong evidence16 of 18 shared results countedHow we compare
Price basis: Standard rates. The price section below shows the applicable periods.
| Fact | Gemini 3.5 Flash | GPT-5.1 |
|---|---|---|
| Context window | 1M tokens | 400K tokens |
| Input / 1M | $1.50 | $1.25 |
| Output / 1M | $9.00 | $10.00 |
| Blended (4:1) | $2.03 | $2.19 |
| Status | Deprecated | Deprecated |
| Released | May 19, 2026 | November 12, 2025 |
Blended is 4:1 input to output with 90% cache hits at listed rates — set your own mix.
Mean of 10 shared benchmarks grouped by capability on a 0–100 scale. How averages are built
Gemini 3.5 Flash ahead on 3 of 3 counted
Gemini 3.5 Flash ahead on 2 of 2 counted
Gemini 3.5 Flash ahead on 3 of 4 counted
Gemini 3.5 Flash ahead on 1 of 1 counted
Gemini 3.5 Flash ahead on 1 of 1 counted
Gemini 3.5 Flash ahead on 2 of 2 counted
No shared comparable results for Mathematics, Research & search, Long context, Cybersecurity.
Published scores, with matching modes where available. Gaps show Gemini 3.5 Flash relative to GPT-5.1. Reading the results
| Benchmark | Gemini 3.5 Flash | GPT-5.1 | Gap |
|---|---|---|---|
| SWE-Bench Pro - PublicRepository Engineering · Accuracy | 55.1Thinking High · tools | 50.8≠Thinking High · no tools | +4.3 pts#34 vs #48 of 66 |
| Terminal Bench HardAgentic Development · Accuracy | 46.2Normal · tools | 45.5≠Thinking High · tools | +0.7 pts#18 vs #20 of 157 |
| Vibe Code Bench v1.1Code Generation & Editing · Pass rate (%) | 48.7Thinking High · tools | 24.6Thinking High · tools | +24.1 pts#65 vs #82 of 121 |
| ARC-AGI-1Abstract Generalization · Score (%) | 92.5Thinking High · tools | 72.8≠Thinking High · no tools | +19.7 pts#28 vs #51 of 87 |
| ARC-AGI-2Abstract Generalization · Score (% solved); cost per task (USD)Not counted · Speed and cost telemetry is reported, not scored | 72.1Thinking High · tools | 17.6≠Thinking High · no tools | 4.09×#27 vs #55 of 80 |
| SimpleBenchCommonsense · Score (AVG@5) | 76.7Normal · no tools | 53.2≠Thinking High · no tools | 1.44×#18 vs #59 of 106 |
| Vending-Bench 2Logical Planning · Money Balance (USD)Not counted · Speed and cost telemetry is reported, not scored | 5396Unspecified Reasoning · tools | 1473Unspecified Reasoning · tools | 3.66×#35 vs #51 of 64 |
| CritPtScientific Reasoning · Score | 13.1Thinking High · no tools | 4.9Thinking High · no tools | 2.67×#46 vs #71 of 134 |
| GPQA DiamondScientific Reasoning · Accuracy | 92.8Thinking High · no tools | 88.1≠Thinking · no tools | +4.7 pts#36 vs #65 of 200 |
| MedCodeClinical Workflows · Accuracy (%) | 55.8Thinking High · tools | 52.7Thinking High · tools | +3.1 pts#6 vs #13 of 97 |
| MedScribeClinical Workflows · Rubric pass rate (%) | 76.6Thinking High · tools | 88.1Thinking High · tools | −11.5 pts#68 vs #14 of 99 |
| MCP-AtlasTool Orchestration · Pass rate / claim coverage | 83.6Thinking High · tools | 50.1Thinking High · tools | +33.5 pts#12 vs #53 of 55 |
| MMMU-ProVisual Understanding · Accuracy | 84.3Thinking High · no tools | 79.0≠Thinking · no tools | +5.3 pts#11 vs #38 of 136 |
| SAGEService Workflows · Accuracy (%) | 49.9Thinking High · tools | 43.2Thinking High · tools | +6.7 pts#18 vs #51 of 82 |
| τ³-BankingService Workflows · Score | 32.2Thinking High · tools | 15.9Thinking High · tools | 2.03×#36 vs #69 of 120 |
| HLEKnowledge Exams · Accuracy | 40.2Thinking High · tools | 42.7≠Thinking High · tools + web | −2.5 pts#77 vs #74 of 151 |
| ECICapability Indices · ECI score (capability index, higher is better) | 155Reported best | 150Reported best | 1.03×#32 vs #51 of 168 |
| LiveBenchCross-capability Suites · Accuracy | 74.6Thinking High · no tools | 72.0Thinking High · no tools | +2.6 pts#35 vs #50 of 106 |
Repository Engineering · Accuracy
Agentic Development · Accuracy
Code Generation & Editing · Pass rate (%)
Abstract Generalization · Score (%)
Abstract Generalization · Score (% solved); cost per task (USD)
Not counted · Speed and cost telemetry is reported, not scored
Commonsense · Score (AVG@5)
Logical Planning · Money Balance (USD)
Not counted · Speed and cost telemetry is reported, not scored
Scientific Reasoning · Score
Scientific Reasoning · Accuracy
Clinical Workflows · Accuracy (%)
Clinical Workflows · Rubric pass rate (%)
Tool Orchestration · Pass rate / claim coverage
Visual Understanding · Accuracy
Service Workflows · Accuracy (%)
Service Workflows · Score
A dash means no result is available.
Time-of-day providers use peak-hour rates; fixed-price providers use standard rates. Off-peak discounts remain in the published details.
Drag the handle above the bar for cache hits, the one below it for the input : output mix · 5% steps
Blended price = effective input rate at 90% cache hits × 80% + output rate × 20%
Gemini 3.5 Flash costs7.4%lessthan GPT-5.1 per million tokens.Using standard rates at this token mix.
Gemini 3.5 Flash: Standard pricing. Official Gemini Developer API standard input price. Official Gemini Developer API output price, including thinking tokens.
GPT-5.1: Standard pricing. OpenAI official pricing (developers.openai.com/api/docs/pricing) verified 2026-11-13; standard tier; Deprecated; shutdown 2027-04-01 (replacement: gpt-6-sol)
| Price / 1M tokens | Gemini 3.5 Flash | GPT-5.1 | Ratio |
|---|---|---|---|
| Input | $1.50 | $1.25 | 1.20× |
| Output | $9.00 | $10.00 | 0.90× |
| Cached input | $0.15 | $0.125 | 1.20× |
| Cache write | — | — | — |
| Blended | $2.03 | $2.19 | 0.93× |
Estimates use the selected token mix. Cache writes, tool fees and long-context surcharges are excluded.
Reported cost per task, paired with the score from the same run. Settings and sources may differ; costs do not affect the verdict.
Gemini 3.5 Flash relative to GPT-5.1
No matching recorded settings for a cost summary.
Summary: 0 of 2 shared benchmarks have matching recorded settings and sources. The average is a geometric mean of 0 positive-cost ratios, one equal weight per benchmark. This benchmark set can include related tests and indexes; it is not a workload cost estimate.
Settings or sources differ or are not recorded; interpret the comparison with care.
Gemini 3.5 Flash
GPT-5.1
Settings or sources differ or are not recorded; interpret the comparison with care.
Gemini 3.5 Flash
GPT-5.1
| Benchmark | Gemini 3.5 Flash | GPT-5.1 |
|---|---|---|
| AIME 2026 | Not reported | |
| AutomationBench | $0.42 / task Average · Pass Rate: 13.4 Thinking High (With Tools) · zapier-private-heldout $0.38 / task Average · Pass Rate: 11.4 Thinking Medium (With Tools) · zapier-private-heldout 1 more settings | Not reported |
| DeepSWE | Not reported | |
| MedCode | Not reported | |
| MedScribe | Not reported | |
| SAGE | Not reported | |
| Tax Agent Bench | $0.8597 / task Average · Accuracy (%, rubric × citation quality): 21.6 Thinking High (With Tools) | Not reported |
| Terminal-Bench 4.0 | $5.98 / task Average · Resolution rate (%): 6.1 Unspecified Reasoning (With Tools) · vals-mini-swe | Not reported |
| Vals Index v2.1 | Not reported | |
| Vibe Code Bench v1.1 | Not reported |
| Attribute | Gemini 3.5 Flash | GPT-5.1 |
|---|---|---|
| Availability | Deprecated | Deprecated |
| Provider | Google Deep Mind | OpenAI |
| Model type | Multimodal model | Reasoning model |
| First release | May 19, 2026 | November 12, 2025 |
| Context window | 1M tokens | 400K tokens |
| Max output | 64K tokens | 128K tokens |
| Architecture | Undisclosed | Undisclosed |
| Documented capabilities | Reasoning, Multilingual, Function calling, Tool use, Structured output, Web search, Computer use, Long context | Reasoning, Multilingual |
| Knowledge cutoff | 2025-01 | — |
| Input modalities | Text, Image, Audio, Video | Text, Image |
| Output modalities | Text | Text |
| Weights | Closed / API only | Closed / API only |
| Commercial use | Proprietary | Proprietary |
These are reported-score comparisons, not controlled head-to-head tests.
What people found comparing these models, or using either one. Comments also appear on the models' own pages.
Used Gemini 3.5 Flash or GPT-5.1? Sign in with Google to share what worked, what did not, and which API or setup you tested.
No community comments on either model yet.
Alternatives with the most benchmark overlap for this matchup.