Across 3 comparable benchmarks, Mistral 7B has better reported results on 3 and worse on 0. 2 further shared results are listed below, each with the reason it is not counted.
Moderate evidence3 of 5 shared results countedHow we compare
Mistral 7B is no longer available through its official API. API prices for this version are not shown.
Price basis: Listed rates vs listed rates. The price section below shows the applicable periods.
| Fact | Mistral 7B | LLaMA2 7B |
|---|---|---|
| Context window | 8K tokens | 4K tokens |
| Input / 1M | — | — |
| Output / 1M | — | — |
| Blended (4:1) | — | — |
| Status | Retired | Available |
| Released | September 27, 2023 | July 18, 2023 |
Blended is 4:1 input to output with 90% cache hits at listed rates — set your own mix.
Mean of 1 shared benchmark grouped by capability on a 0–100 scale. How averages are built
Mistral 7B ahead on 1 of 1 counted
No shared comparable results for Coding, Abstract reasoning, Science & health, Computer & tool use, Research & search, Long context, Multimodal, Professional work & productivity, Cybersecurity.
Published scores, with matching modes where available. Gaps show Mistral 7B relative to LLaMA2 7B. Reading the results
| Benchmark | Mistral 7B | LLaMA2 7B | Gap |
|---|---|---|---|
| HumanEvalCode Generation & Editing · AccuracyNot counted · Different or unrecorded test environments — excluded from the tally | 26.2Historical· legacy-default | 44.4≠Historical · pass@100· pass-at-100 | —#91 vs #71 of 100 |
| MBPPCode Generation & Editing · Pass rate (%)Not counted · Different or unrecorded test environments — excluded from the tally | 50.2Historical· legacy-default | 65.5≠Historical · pass@100· pass-at-100 | —#50 vs #32 of 67 |
| GSM8KMathematics · Accuracy | 52.1Historical | 14.6Historical | +37.5 pts#45 vs #63 of 67 |
| AGIEvalKnowledge Exams · accuracy | 43.0Historical | 29.3Historical | +13.7 pts#11 vs #20 of 27 |
| MMLUKnowledge Exams · Accuracy | 60.1Historical | 45.3Historical | +14.8 pts#83 vs #102 of 114 |
Code Generation & Editing · Accuracy
Not counted · Different or unrecorded test environments — excluded from the tally
Code Generation & Editing · Pass rate (%)
Not counted · Different or unrecorded test environments — excluded from the tally
Mathematics · Accuracy
Time-of-day providers use peak-hour rates; fixed-price providers use standard rates. Off-peak discounts remain in the published details.
Drag the handle above the bar for cache hits, the one below it for the input : output mix · 5% steps
Blended price = effective input rate at 90% cache hits × 80% + output rate × 20%
A blended cost needs a published input and output price on both sides, and one of these two does not have them yet.
Mistral 7B: Listed text rates; pricing tier not confirmed.
LLaMA2 7B: Listed text rates; pricing tier not confirmed.
| Price / 1M tokens | Mistral 7B | LLaMA2 7B | Ratio |
|---|---|---|---|
| Input | — | — | — |
| Output | — | — | — |
| Cached input | — | — | — |
| Cache write | — | — | — |
| Blended | — | — | — |
Estimates use the selected token mix. Cache writes, tool fees and long-context surcharges are excluded.
Lower prices are highlighted. The cache hit rate applies to input tokens only; models without a published cached-input rate use their normal input price for those tokens.| Attribute | Mistral 7B | LLaMA2 7B |
|---|---|---|
| Availability | Retired | Available |
| Provider | MistralAI | Facebook AI Research Lab |
| Model type | Foundation model | Foundation model |
| First release | September 27, 2023 | July 18, 2023 |
| Context window | 8K tokens | 4K tokens |
| Total parameters | 7.3B | 7B |
| Architecture | Dense | Dense |
| Weights | Open weights | Open weights |
| Licence | Apache 2.0 | Llama 2 Community License Agreement |
| Commercial use | Commercial use allowed | Commercial use allowed |
These are reported-score comparisons, not controlled head-to-head tests.
What people found comparing these models, or using either one. Comments also appear on the models' own pages.
Used Mistral 7B or LLaMA2 7B? Sign in with Google to share what worked, what did not, and which API or setup you tested.
No community comments on either model yet.
Alternatives with the most benchmark overlap for this matchup.