Across 21 comparable benchmarks, Claude Sonnet 5 has better reported results on 12 and worse on 9. 1 further shared result is listed below, each with the reason it is not counted.
Moderate evidence21 of 22 shared results countedHow we compare
Price basis: Standard rates. The price section below shows the applicable periods.
| Fact | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Context window | 1M tokens | 1M tokens |
| Input / 1M | $2.00 | $0.700 |
| Output / 1M | $10.00 | $2.10 |
| Blended (4:1) | $2.30 | $0.526 |
| Status | Available | Preview |
| Released | June 30, 2026 | October 6, 2026 |
Blended is 4:1 input to output with 90% cache hits at listed rates — set your own mix.
Mean of 16 shared benchmarks grouped by capability on a 0–100 scale. How averages are built
Mistral Large 4 ahead on 5 of 7 counted
Claude Sonnet 5 ahead on 3 of 3 counted
Split 1–1 of 2 counted
Claude Sonnet 5 ahead on 1 of 1 counted
Mistral Large 4 ahead on 3 of 5 counted
No shared comparable results for Abstract reasoning, Computer & tool use, Research & search, Long context, Cybersecurity.
Published scores, with matching modes where available. Gaps show Claude Sonnet 5 relative to Mistral Large 4. Reading the results
| Benchmark | Claude Sonnet 5 | Mistral Large 4 | Gap |
|---|---|---|---|
| Code MigrationMaintenance & Optimization · Hidden-test pass rate (%) | 44.4Max · tools | 30.6≠Thinking High · tools | +13.8 pts#24 vs #43 of 79 |
| DeepSWERepository Engineering · Pass@1 (DeepSWE v1.1) | 54.0Deep Thinking · tools | 61.7≠Thinking · tools | −7.7 pts#55 vs #45 of 73 |
| FrontierCode 1.1Code Generation & Editing · Weighted rubric score (%)Not counted · Different or unrecorded test environments — excluded from the tally | 56.2Extra-High · tools· frontiercode-1-1-extended | 39.4≠Thinking High · tools· frontiercode-1-1-main | —#11 vs #30 of 51 |
| IOI (Vals v2)Algorithmic Coding · Subtask points (%) | 45Max · tools | 45.3≠Thinking High · tools | −0.3 pts#33 vs #32 of 45 |
| Terminal-Bench 4.0Agentic Development · Resolution rate (%) | 12.4Max · tools | 28.3≠Thinking · tools | −15.9 pts#59 vs #40 of 90 |
| Terminal-Bench 4.1Agentic Development · Resolution rate (%) | 12.1Max · tools | 27.6Max · tools | −15.5 pts#41 vs #26 of 48 |
| Vibe Code Bench 1-100Agentic Development · Accuracy (%) | 13.8Max · tools | 14.3≠Thinking High · tools | −0.4 pts#21 vs #20 of 25 |
| Vibe Code Bench v1.1Code Generation & Editing · Pass rate (%) | 81.3Max · tools | 78.4≠Thinking High · tools | +2.9 pts#31 vs #36 of 121 |
| FrontierMath Tier 4 v2Mathematics · Accuracy (verification_code) | 29.3Max · tools | 26.8≠Thinking High · tools | +2.4 pts#37 vs #40 of 73 |
| FrontierMath v2Mathematics · Accuracy (verification_code) | 65.6Max · tools | 58.6≠Thinking High · tools | +7.0 pts#38 vs #46 of 85 |
| ProofBench v1.1 (Lean 4)Mathematics · Accuracy (%) | 77.0Max · tools | 10.0≠Thinking High · tools | +67.0 pts#19 vs #49 of 54 |
| MedCodeClinical Workflows · Accuracy (%) | 47.5Max · tools | 40.7≠Thinking High · no tools | +6.9 pts#32 vs #58 of 97 |
| MedScribeClinical Workflows · Rubric pass rate (%) | 76.0Max · tools | 80.4≠Thinking High · no tools | −4.4 pts#71 vs #53 of 99 |
| MMMU-ProVisual Understanding · Accuracy | 77.3Max · no tools | 76.4≠Thinking · no tools | +0.9 pts#49 vs #55 of 136 |
| EMB (Excel Modeling)Finance · Accuracy (%) | 66.3Max · tools | 56.2≠Thinking High · tools | +10.1 pts#24 vs #49 of 78 |
| Finance Agent v2Finance · Score | 53.9Max · tools | 54.7≠Thinking High · tools | 0.99×#29 vs #24 of 75 |
| Harvey's Legal Agent BenchmarkLegal · Accuracy (%) | 5.0Max · tools | 15.8≠Thinking High · tools | −10.8 pts#28 vs #6 of 52 |
| Legal Research BenchLegal · Score | 41.8Max · tools | 31.7≠Thinking High · tools | 1.32×#30 vs #52 of 91 |
| Tax Agent BenchFinance · Accuracy (%, rubric × citation quality) | 62.3Max · tools | 63.3≠Thinking High · tools | −1.0 pts#16 vs #14 of 74 |
| LiveBenchCross-capability Suites · Accuracy | 76.0Extra-High · no tools | 71.8≠Thinking High · no tools | +4.2 pts#29 vs #53 of 106 |
| LiveBench 2.0Cross-capability Suites · Overall score (equal-weight mean of 7 suite scores, 0-100) | 73.0Max · task tools | 47.7≠Thinking High · tools | 1.53×#23 vs #47 of 51 |
| Vals Index v2.1Capability Indices · GDP-weighted accuracy (%) | 51.8Max · task tools | 48.0≠Thinking High · tools | +3.7 pts#21 vs #30 of 38 |
Maintenance & Optimization · Hidden-test pass rate (%)
Repository Engineering · Pass@1 (DeepSWE v1.1)
Code Generation & Editing · Weighted rubric score (%)
Not counted · Different or unrecorded test environments — excluded from the tally
Algorithmic Coding · Subtask points (%)
Agentic Development · Resolution rate (%)
Agentic Development · Resolution rate (%)
Agentic Development · Accuracy (%)
Code Generation & Editing · Pass rate (%)
Mathematics · Accuracy (verification_code)
Mathematics · Accuracy (verification_code)
Mathematics · Accuracy (%)
Visual Understanding · Accuracy
Finance · Accuracy (%)
Finance · Score
Legal · Accuracy (%)
Legal · Score
Finance · Accuracy (%, rubric × citation quality)
Cross-capability Suites · Accuracy
Cross-capability Suites · Overall score (equal-weight mean of 7 suite scores, 0-100)
Capability Indices · GDP-weighted accuracy (%)
A dash means no result is available.
| Benchmark | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| CritPt | 16.9 | — |
| GPQA Diamond | 90.5 | — |
| HLE | 57.4 | — |
| HLE-Verified | 31.0 | — |
| MysteryMechanism | — | 12.2 |
| SciCode | 54.3 | — |
| AA Cyber Index | — | 49.5 |
| APEX-SWE | 46.4 | — |
| CursorBench 4.0 | 34.1 | — |
| FrontierCode 2.0 | — | 8.8 |
| GSO | 37.3 | — |
| SWE-Atlas-QnA | — | 59.4 |
| SWE-Bench Pro V2 | 93.2 | — |
| SWE-Bench Pro V2 Hard | 88.2 | — |
| SWE-bench Verified | 85.2 | — |
| Terminal-Bench 2.1 | 80.4 | — |
| WeirdML v2 | 68.8 | — |
| WeirdML v3 | — | 0.044 |
| APEX-Agents | 54.5 | — |
| OSWorld-Verified | 81.2 | — |
| Toolathlon-Verified | 71.6 | — |
| AA Intelligence Index v5.0.1 | — | 25.3 |
| Agent Arena | 2 | — |
| Agent Arena Index | 1110 | — |
| ECI | 156 | — |
| Text Arena (Coding) | 1544 | — |
| Vals Index | 59.6 | — |
| Creative Writing | 1798 | — |
| Context Arena | 79.5 | — |
| GDP.pdf | 13.2 | — |
| GeoBench ACW | 74.0 | — |
| AA-AnalystAgent | 46.3 | — |
| AutomationBench | 10.7 | — |
| Harvey Lab-AA | 90.1 | — |
| Public Benefits Bench v1.1 | 66.0 | — |
| SAGE | 48.9 | — |
| τ³-Banking | 37.3 | — |
| SimpleBench | 60.6 | — |
| Vending-Bench 2 | 6378 | — |
| BrowseComp | 84.7 | — |
| BioMysteryBench | — | 67.0 |
Time-of-day providers use peak-hour rates; fixed-price providers use standard rates. Off-peak discounts remain in the published details.
Drag the handle above the bar for cache hits, the one below it for the input : output mix · 5% steps
Blended price = effective input rate at 90% cache hits × 80% + output rate × 20%
Claude Sonnet 5 costs338%morethan Mistral Large 4 per million tokens — 4.4× the price.Using standard rates at this token mix.
Claude Sonnet 5: Standard pricing. Anthropic official pricing (platform.claude.com/docs/en/about-claude/pricing) verified 2026-11-13; Promotional introductory pricing extended permanently per Anthropic pricing docs
Mistral Large 4: Standard pricing. Mistral official pricing (docs.mistral.ai/inference/pricing) verified 2026-11-13; price reduced from $1.36 Mistral official pricing (docs.mistral.ai/inference/pricing) verified 2026-11-13; price reduced from $4.18
| Price / 1M tokens | Claude Sonnet 5 | Mistral Large 4 | Ratio |
|---|---|---|---|
| Input | $2.00 | $0.70 | 2.86× |
| Output | $10.00 | $2.10 | 4.76× |
| Cached input | $0.20 | $0.07 | 2.86× |
| Cache write | — | — | — |
| Blended | $2.30 | $0.526 | 4.38× |
Estimates use the selected token mix. Cache writes, tool fees and long-context surcharges are excluded.
Reported cost per task, paired with the score from the same run. Settings and sources may differ; costs do not affect the verdict.
Claude Sonnet 5 relative to Mistral Large 4
Summary: 2 of 6 shared benchmarks have matching recorded settings and sources. The average is a geometric mean of 2 positive-cost ratios, one equal weight per benchmark. This benchmark set can include related tests and indexes; it is not a workload cost estimate.
Claude Sonnet 5 13.4× more expensive
Claude Sonnet 5 9.5× more expensive
Settings or sources differ
Settings or sources differ
Settings or sources differ
Settings or sources differ
Claude Sonnet 5 13.4× more expensive
Claude Sonnet 5 9.5× more expensive
Settings or sources differ
Settings or sources differ
Settings or sources differ
Settings or sources differ
Settings or sources differ or are not recorded; interpret the comparison with care.
Claude Sonnet 5
Mistral Large 4
Settings or sources differ or are not recorded; interpret the comparison with care.
Claude Sonnet 5
Mistral Large 4
Effort, protocol, aggregation and source match; other run conditions may differ.
Claude Sonnet 5
Mistral Large 4
Effort, protocol, aggregation and source match; other run conditions may differ.
Claude Sonnet 5
Mistral Large 4
Settings or sources differ or are not recorded; interpret the comparison with care.
Claude Sonnet 5
Mistral Large 4
Settings or sources differ or are not recorded; interpret the comparison with care.
Claude Sonnet 5
Mistral Large 4
| Benchmark | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| AA Intelligence Index v5.0.1 | Not reported | |
| Agent Arena | $0.8542 / task Median · Net improvement index (percentage points vs. average model): 2 Thinking High (With Tools + Internet) | Not reported |
| Agent Arena Index | $0.9521 / task Median · Agent Arena Index rating (index points): 1110 Thinking High (With Tools + Internet) | Not reported |
| AutomationBench | $0.56 / task Average · Pass Rate: 9.9 Thinking High (With Tools) · zapier-private-heldout 2 more settings$0.41 / task Average · Pass Rate: 5.8 Thinking Medium (With Tools) · zapier-private-heldout | Not reported |
| BioMysteryBench | Not reported | |
| Code Migration | Not reported | |
| CursorBench 4.0 | $3.48 / task Average · Task score: 30.8 Thinking High (With Tools) · cursorbench-4-0-cursor-agent $1.39 / task Average · Task score: 24.1 Thinking Low (With Tools) · cursorbench-4-0-cursor-agent 2 more settings$2.31 / task Average · Task score: 28.0 Thinking Medium (With Tools) · cursorbench-4-0-cursor-agent $4.55 / task Average · Task score: 32.0 Extra-High (With Tools) · cursorbench-4-0-cursor-agent | Not reported |
| DeepSWE | 2 more settings | Not reported |
| EMB (Excel Modeling) | Not reported | |
| Finance Agent v2 | Not reported | |
| FrontierCode 1.1 | $12.6849 / task Average · Weighted rubric score: 54.9 Max (With Tools) · frontiercode-1-1-extended $15.4048 / task Average · Weighted rubric score: 42.4 Max (With Tools) · frontiercode-1-1-main $4.4766 / task Average · Weighted rubric score: 52.7 Thinking High (With Tools) · frontiercode-1-1-extended 7 more settings$5.4879 / task Average · Weighted rubric score: 39.4 Thinking High (With Tools) · frontiercode-1-1-main $1.8305 / task Average · Weighted rubric score: 44.5 Thinking Low (With Tools) · frontiercode-1-1-extended $2.1507 / task Average · Weighted rubric score: 28.7 Thinking Low (With Tools) · frontiercode-1-1-main $2.8424 / task Average · Weighted rubric score: 49.3 Thinking Medium (With Tools) · frontiercode-1-1-extended $3.4334 / task Average · Weighted rubric score: 35.2 Thinking Medium (With Tools) · frontiercode-1-1-main $9.0599 / task Average · Weighted rubric score: 42.7 Extra-High (With Tools) · frontiercode-1-1-main $7.4079 / task Average · Weighted rubric score: 56.2 Extra-High (With Tools) · frontiercode-1-1-extended | Not reported |
| FrontierCode 2.0 | Not reported | |
| Harvey's Legal Agent Benchmark | Not reported | |
| IOI (Vals v2) | Not reported | |
| Legal Research Bench | Not reported | |
| MedCode | Not reported | |
| MedScribe | Not reported | |
| MysteryMechanism | Not reported | |
| ProofBench v1.1 (Lean 4) | Not reported | |
| Vibe Code Bench v1.1 | Not reported | |
| WeirdML v3 | Not reported | $28.7748 / task Average · Official score (0-1; higher is better): 0.044 Thinking High (With Tools) |
| Attribute | Claude Sonnet 5 | Mistral Large 4 |
|---|---|---|
| Availability | Available | Preview |
| Provider | Anthropic | MistralAI |
| Model type | Multimodal model | Multimodal model |
| First release | June 30, 2026 | October 6, 2026 |
| Context window | 1M tokens | 1M tokens |
| Max output | 128K tokens | — |
| Total parameters | — | 1.1T |
| Active parameters | — | 49B |
| Architecture | Undisclosed | Mixture of Experts (MoE) |
| Documented capabilities | Reasoning, Multilingual, Coding, Tool use, Function calling, Computer use, Web search, Long context | Reasoning, Multilingual, Function calling, Tool use, Structured output, Long context, Coding |
| Knowledge cutoff | 2026-01 | — |
| Input modalities | Text, Image | Text, Image |
| Output modalities | Text | Text |
| Weights | Closed / API only | Closed / API only |
| Commercial use | Proprietary | Proprietary |
These are reported-score comparisons, not controlled head-to-head tests.
What people found comparing these models, or using either one. Comments also appear on the models' own pages.
Used Claude Sonnet 5 or Mistral Large 4? Sign in with Google to share what worked, what did not, and which API or setup you tested.
No community comments on either model yet.
Alternatives with the most benchmark overlap for this matchup.