Across 13 comparable benchmarks, Nemotron 3 Ultra has better reported results on 13 and worse on 0.
Moderate evidence13 of 13 shared results countedHow we compare
Price basis: Standard rates. The price section below shows the applicable periods.
| Fact | Nemotron 3 Ultra | gpt-oss-20b |
|---|---|---|
| Context window | 1M tokens | 128K tokens |
| Input / 1M | $0.600 | $0.030 |
| Output / 1M | $2.40 | $0.140 |
| Blended (4:1) | $0.614 | $0.052 |
| Status | Available | Available |
| Released | June 4, 2026 | August 6, 2025 |
Blended is 4:1 input to output with 90% cache hits at listed rates — set your own mix.
Mean of 6 shared benchmarks grouped by capability on a 0–100 scale. How averages are built
Nemotron 3 Ultra ahead on 2 of 2 counted
Nemotron 3 Ultra ahead on 2 of 2 counted
No fixed-scale average — see the rows in Benchmark results
Nemotron 3 Ultra ahead on 2 of 2 counted
Nemotron 3 Ultra ahead on 1 of 1 counted
Nemotron 3 Ultra ahead on 1 of 1 counted
Nemotron 3 Ultra ahead on 2 of 2 counted
No fixed-scale average — see the rows in Benchmark results
No shared comparable results for Abstract reasoning, Mathematics, Long context, Cybersecurity.
Published scores, with matching modes where available. Gaps show Nemotron 3 Ultra relative to gpt-oss-20b. Reading the results
| Benchmark | Nemotron 3 Ultra | gpt-oss-20b | Gap |
|---|---|---|---|
| SWE-bench VerifiedRepository Engineering · Accuracy | 70.7Thinking · tools | 34.0≠Thinking · no tools | +36.7 pts#58 vs #103 of 108 |
| Terminal Bench HardAgentic Development · Accuracy | 36.4Thinking · tools | 10.6≠Thinking High · tools | +25.8 pts#45 vs #115 of 157 |
| CritPtScientific Reasoning · Score | 3.1Thinking · no tools | 1.4≠Thinking High · no tools | 2.21×#78 vs #96 of 134 |
| SciCodeScientific Computing · Score | 44.6Thinking · no tools | 38.9≠Thinking High · no tools | 1.15×#66 vs #79 of 98 |
| Pinch BenchTool Orchestration · Accuracy | 90.0Thinking · tools | 66.0Thinking · tools | +24.0 pts#2 vs #35 of 38 |
| PinchBench v2Tool Orchestration · Average score (%) | 89.9Reported best | 36.3Reported best | +53.6 pts#4 vs #48 of 51 |
| BrowseCompFact Finding · Accuracy | 44.4Thinking · tools + web | 28.3≠Thinking · tools | +16.1 pts#51 vs #58 of 61 |
| GDP.pdfDocuments & Charts · Task pass rate (%) | 5.0Thinking · no tools | 2.0≠Thinking High · no tools | +3.0 pts#75 vs #84 of 96 |
| Creative WritingWriting | 1692Normal · no tools | 665Normal · no tools | 2.55×#33 vs #119 of 121 |
| τ³-BankingService Workflows · Score | 22.6Thinking · tools | 7.0≠Thinking High · tools | 3.23×#54 vs #99 of 120 |
| HLEKnowledge Exams · Accuracy | 37.4Thinking · tools | 17.3Thinking · tools | +20.1 pts#80 vs #114 of 151 |
| MMLU-ProKnowledge Exams · Accuracy | 86.8Thinking · no tools | 74.0Thinking · no tools | +12.8 pts#19 vs #84 of 153 |
| ECICapability Indices · ECI score (capability index, higher is better) | 146Reported best | 138Reported best | 1.06×#70 vs #106 of 168 |
Repository Engineering · Accuracy
Agentic Development · Accuracy
Tool Orchestration · Accuracy
Tool Orchestration · Average score (%)
Fact Finding · Accuracy
Documents & Charts · Task pass rate (%)
Writing
Service Workflows · Score
A dash means no result is available.
| Benchmark | Nemotron 3 Ultra | gpt-oss-20b |
|---|---|---|
| AIME 2024 | — | 96.0 |
| AIME2025 | — | 98.7 |
| GPQA | 87.0 | — |
| GPQA Diamond | — | 71.5 |
| IMO-AnswerBench | 92.3 | — |
| MMLU | — | 85.3 |
| AA Cyber Index | 13.1 | — |
| Code Migration | 4.9 | — |
| CodeForces | — | 2516 |
| FrontierCode 1.1 | 13.6 | — |
| LiveCodeBench | 89.0 | — |
| SWE-bench Multilingual | 67.7 | — |
| Terminal-Bench 2.1 | 56.4 | — |
| Terminal-Bench 4.0 | 0.5 | — |
| Vibe Code Bench v1.1 | 7.6 | — |
| APEX-Agents | 22.7 | — |
| MCP-Atlas | 63.1 | — |
| Toolathlon-Verified | 34.3 | — |
| CWE-bench v0 | 18.5 | — |
| AA Intelligence Index (historical versions) | 38.3 | — |
| AA Intelligence Index v5.0.1 | 11.8 | — |
| LiveBench | 67.4 | — |
| LiveBench 2.0 | 40.8 | — |
| IF Bench | 81.7 | — |
| LongBench v2 | 61.9 | — |
| AA-AnalystAgent | 6.3 | — |
| EMB (Excel Modeling) | 31.7 | — |
| Harvey Lab-AA | 81.7 | — |
| Legal Research Bench | 15.4 | — |
| τ²-Bench | — | 47.7 |
| SimpleBench | 41.7 | — |
| MedCode | 38.6 | — |
Time-of-day providers use peak-hour rates; fixed-price providers use standard rates. Off-peak discounts remain in the published details.
Drag the handle above the bar for cache hits, the one below it for the input : output mix · 5% steps
Blended price = effective input rate at 90% cache hits × 80% + output rate × 20%
Nemotron 3 Ultra costs1,082%morethan gpt-oss-20b per million tokens — 11.8× the price.Using standard rates at this token mix.
Nemotron 3 Ultra: Standard pricing. Fireworks official Serverless pricing (fireworks/nemotron-3-ultra-nvfp4) verified 2026-11-13
gpt-oss-20b: Standard pricing. DeepInfra official models API (openai/gpt-oss-20b) verified 2026-11-13
| Price / 1M tokens | Nemotron 3 Ultra | gpt-oss-20b | Ratio |
|---|---|---|---|
| Input | $0.60 | $0.03 | 20.0× |
| Output | $2.40 | $0.14 | 17.1× |
| Cached input | $0.12 | — | — |
| Cache write | — | — | — |
| Blended | $0.614 | $0.052 | 11.8× |
Estimates use the selected token mix. Cache writes, tool fees and long-context surcharges are excluded.
Reported cost per task, paired with the score from the same run. Settings and sources may differ; costs do not affect the verdict.
| Benchmark | Nemotron 3 Ultra | gpt-oss-20b |
|---|---|---|
| AA Intelligence Index v5.0.1 | Not reported | |
| CWE-bench v0 | Not reported | |
| LiveBench 2.0 | $0.5057 / task Average · Overall score (equal-weight mean of 7 suite scores, 0-100): 40.8 Max (task-specific tools) | Not reported |
| Attribute | Nemotron 3 Ultra | gpt-oss-20b |
|---|---|---|
| Availability | Available | Available |
| Provider | NVIDIA | OpenAI |
| Model type | Reasoning model | Reasoning model |
| First release | June 4, 2026 | August 6, 2025 |
| Context window | 1M tokens | 128K tokens |
| Max output | — | 128K tokens |
| Total parameters | 550B | 21B |
| Active parameters | 55B | 3.6B |
| Architecture | Mixture of Experts (MoE) | Mixture of Experts (MoE) |
| Documented capabilities | Reasoning, Multilingual, Tool use, Long context | Reasoning, Multilingual |
| Knowledge cutoff | 2026-05 | — |
| Input modalities | Text | Text |
| Output modalities | Text | Text |
| Weights | Open weights | Open weights |
| Licence | — | Apache 2.0 |
| Commercial use | Commercial use allowed | Commercial use allowed |
These are reported-score comparisons, not controlled head-to-head tests.
What people found comparing these models, or using either one. Comments also appear on the models' own pages.
Used Nemotron 3 Ultra or gpt-oss-20b? Sign in with Google to share what worked, what did not, and which API or setup you tested.
No community comments on either model yet.
Alternatives with the most benchmark overlap for this matchup.