Across 1 comparable benchmark, GPT-6 Astra has better reported results on 1 and worse on 0.
Limited evidence1 of 1 shared result countedHow we compare
Price basis: Listed rates vs listed rates. The price section below shows the applicable periods.
| Fact | StarCoder2-15B | GPT-6 Astra |
|---|---|---|
| Context window | 16K tokens | 1.05M tokens |
| Input / 1M | β | $10.00 |
| Output / 1M | β | $50.00 |
| Blended (4:1) | β | $11.52 |
| Status | Available | Preview |
| Released | February 28, 2024 | September 3, 2026 |
Blended is 4:1 input to output with 90% cache hits at listed rates β set your own mix.
Published scores, with matching modes where available. Gaps show StarCoder2-15B relative to GPT-6 Astra. Reading the results
| Benchmark | StarCoder2-15B | GPT-6 Astra | Gap |
|---|---|---|---|
| ECICapability Indices Β· ECI score (capability index, higher is better) | 105Reported best | 167Reported best | 0.63Γ#152 vs #3 of 168 |
Capability Indices Β· ECI score (capability index, higher is better)
A dash means no result is available.
Time-of-day providers use peak-hour rates; fixed-price providers use standard rates. Off-peak discounts remain in the published details.
Drag the handle above the bar for cache hits, the one below it for the input : output mix Β· 5% steps
Blended price = effective input rate at 90% cache hits Γ 80% + output rate Γ 20%
A blended cost needs a published input and output price on both sides, and one of these two does not have them yet.
StarCoder2-15B: Listed text rates; pricing tier not confirmed.
GPT-6 Astra: Standard pricing. context_length <= 272000 OpenAI official pricing (developers.openai.com/api/docs/pricing) verified 2026-11-13; standard tier; <=272K input tokens context_length > 272000 OpenAI official pricing (developers.openai.com/api/docs/pricing) verified 2026-11-13; standard tier; >272K input tokens
| Price / 1M tokens | StarCoder2-15B | GPT-6 Astra | Ratio |
|---|---|---|---|
| Input | β | $10.00 | β |
| Output | β | $50.00 | β |
| Cached input | β | $1.00 | β |
| Cache write | β | $12.50 | β |
| Blended | β | $11.52 | β |
Estimates use the selected token mix. Cache writes, tool fees and long-context surcharges are excluded.
Reported cost per task, paired with the score from the same run. Settings and sources may differ; costs do not affect the verdict.
| Benchmark | StarCoder2-15B | GPT-6 Astra |
|---|---|---|
| AA Coding Agent Index v2.0 | Not reported | |
| AA Intelligence Index v4.3 | Not reported | 2 more settings |
| AA Intelligence Index v5.0.1 | Not reported | 2 more settings |
| AA-Omniscience | Not reported | 2 more settings |
| Agent Arena | Not reported | $5.4265 / task Median Β· Net improvement index (percentage points vs. average model): 14.6 Max (With Tools + Internet) |
| Agents' Last Exam v1.0 | Not reported | 3 more settings |
| ARC-AGI-1 | Not reported | 5 more settings$0.2837 / task Average Β· Score (%): 98.5 Thinking High (With Tools) $0.2265 / task Average Β· Score (%): 96.5 Thinking Low (With Tools) $0.2398 / task Average Β· Score (%): 97.5 Thinking Medium (With Tools) |
| ARC-AGI-2 | Not reported | $0.6681 / task Average Β· ARC-AGI-2 Score: 92.1 Thinking High (With Tools) 3 more settings$0.4162 / task Average Β· ARC-AGI-2 Score: 85.4 Thinking Low (With Tools) $0.4801 / task Average Β· ARC-AGI-2 Score: 92.1 Thinking Medium (With Tools) $0.8287 / task Average Β· ARC-AGI-2 Score: 93.3 Extra-High (With Tools) |
| AutomationBench | Not reported | $1.44 / task Average Β· Pass Rate: 37.1 Thinking High (With Tools) Β· zapier-private-heldout 3 more settings$1.08 / task Average Β· Pass Rate: 30.3 Thinking Low (With Tools) Β· zapier-private-heldout $1.27 / task Average Β· Pass Rate: 34.1 Thinking Medium (With Tools) Β· zapier-private-heldout $1.50 / task Average Β· Pass Rate: 39.0 Extra-High (With Tools) Β· zapier-private-heldout |
| BenchCAD 2.1 Core | Not reported | $9.71 / task Average Β· Core mean geometry/circuit score (0β100): 62.6 Max (With Tools) $5.38 / task Average Β· Core mean geometry/circuit score (0β100): 51.1 Thinking High (With Tools) $1.14 / task Average Β· Core mean geometry/circuit score (0β100): 20.3 Thinking Low (With Tools) 2 more settings$3.73 / task Average Β· Core mean geometry/circuit score (0β100): 38.7 Thinking Medium (With Tools) $6.32 / task Average Β· Core mean geometry/circuit score (0β100): 53.9 Extra-High (With Tools) |
| CWE-bench v1 | Not reported | |
| DeepSWE | Not reported | 2 more settings |
| FrontierCode 1.1 | Not reported | $4.586 / task Average Β· Weighted rubric score: 53.3 Max (With Tools) Β· frontiercode-1-1-main $3.0149 / task Average Β· Weighted rubric score: 50.9 Thinking High (With Tools) Β· frontiercode-1-1-main $1.70 / task Average Β· Weighted rubric score: 45.3 Thinking Low (With Tools) Β· frontiercode-1-1-main 2 more settings$2.4259 / task Average Β· Weighted rubric score: 48.8 Thinking Medium (With Tools) Β· frontiercode-1-1-main $3.2755 / task Average Β· Weighted rubric score: 50.6 Extra-High (With Tools) Β· frontiercode-1-1-main |
| FrontierCode 2.0 | Not reported | $4.277 / task Average Β· Weighted rubric score: 38.8 Thinking High (With Tools + Internet) $2.437 / task Average Β· Weighted rubric score: 31.1 Thinking Low (With Tools + Internet) 2 more settings$3.493 / task Average Β· Weighted rubric score: 37.3 Thinking Medium (With Tools + Internet) |
| FrontierCS 2 | Not reported | |
| FrontierSWE v2 | Not reported | |
| GDPx | Not reported | |
| HLE | Not reported | $0.0389 / task Average Β· Accuracy: 49.2 Thinking Low (No Tools) Β· Text only Β· text-only $0.1005 / task Average Β· Accuracy: 52.7 Thinking Medium (No Tools) Β· Text only Β· text-only 2 more settings$0.1618 / task Average Β· Accuracy: 53.1 Thinking High (No Tools) Β· Text only Β· text-only $0.2532 / task Average Β· Accuracy: 54.6 Extra-High (No Tools) Β· Text only Β· text-only |
| LiveBench 2.0 | Not reported | $3.2773 / task Average Β· Overall score (equal-weight mean of 7 suite scores, 0-100): 86.1 Max (task-specific tools) |
| SWE-sweep | Not reported | |
| Terminal-Bench 4.0 | Not reported | $8.9756 / task Average Β· Resolution rate (%): 56.6 Max (With Tools) Β· vals-effort-study 6 more settings$5.8733 / task Average Β· Resolution rate (%): 58.6 Thinking High (With Tools) Β· vals-effort-study $7.4889 / task Average Β· Resolution rate (%): 44.4 Thinking Low (With Tools) Β· vals-effort-study $9.58 / task Average Β· Resolution rate (%): 59.6 Unspecified Reasoning (With Tools) Β· vals-mini-swe |
| Terminal-Bench 4.1 | Not reported | 2 more settings |
| Terminal-Bench-Science 0.1 | Not reported | $20.80 / task Average Β· Task success rate (%): 62.9 Unspecified Reasoning (With Tools) |
| Vals Index v2.1 | Not reported | |
| Vals Index v2.2 | Not reported | |
| Vibe Code Bench 1-100 | Not reported | |
| WeirdML v3 | Not reported | $27.854 / task Average Β· Official score (0-1; higher is better): 0.42 Extra-High (With Tools) |
| Attribute | StarCoder2-15B | GPT-6 Astra |
|---|---|---|
| Availability | Available | Preview |
| Provider | BigCode | OpenAI |
| Model type | Coding model | Reasoning model |
| First release | February 28, 2024 | September 3, 2026 |
| Context window | 16K tokens | 1.05M tokens |
| Max output | β | 128K tokens |
| Total parameters | 15B | β |
| Architecture | Dense | Undisclosed |
| Documented capabilities | Coding | Reasoning, Multilingual, Coding, Function calling, Tool use, Structured output, Computer use, Web search, Long context |
| Knowledge cutoff | β | 2026-04-30 |
| Input modalities | β | Text, Image |
| Output modalities | β | Text |
| Weights | Open weights | Closed / API only |
| Licence | BigCode OpenRAIL-M v1 | β |
| Commercial use | Commercial use allowed | Proprietary |
These are reported-score comparisons, not controlled head-to-head tests.
What people found comparing these models, or using either one. Comments also appear on the models' own pages.
Used StarCoder2-15B or GPT-6 Astra? Sign in with Google to share what worked, what did not, and which API or setup you tested.
No community comments on either model yet.
Alternatives with the most benchmark overlap for this matchup.