whatmodel.sh / Mistral Large (2402)

Mistral Large (2402) is a closed-weights language model from Mistral, released February 2024. Licence: proprietary.

Catalogue identity notes

Comparison model from the Epoch AI internal-evaluation CSVs (Epoch release date 2024-02-26). API model mistral-large-2402 ('Mistral Large 1.0', version 24.02 in Mistral's legacy-models table; retired 6/16/2025). No open weights.

46.4±0.6comparison only: no current run option verifiedfrom 14 benchmark results across 9 sources

$ how it compares

The LLMs ranked either side of Mistral Large (2402), out of 828 with a score, then more from Mistral.

#modelscorewhereRAMreleased
488Granite 4.0 H Micro 3B IBM47±1local~3.4GB2025-09
489GPT-3.5 Turbo (0125) OpenAI46±1api $0.75/M2024-01
490Mistral Large (2402) Mistral46±1comparison only2024-02
491Jamba 1.5 Mini AI21 Labs46±1local~34GB2024-08
492MedGemma 4B IT Google46±3local~4.1GB2025-05
more from Mistral
79Mistral Large 4 (public preview) Mistral71±2api $2.06/M2026-10
174Mistral Medium 3.5 (128B) Mistral65±1api $3.00/M +local~42GB2026-04
180Mistral Medium 3.1 (2508) Mistral64±2comparison only2025-08

see all LLMs · find the ones that fit your machine

$ what it's good at

coding▁▁▁▃▅▇█▇▅▄▃▁ #370 of 524 · 46% of its score · 3 tests

Beats GLM-4.7-Flash, Qwen3-VL 8B Instruct, Qwen3-VL 4B Instruct here, though they rank higher overall. Trails DeepSeek LLM 67B Chat, WizardLM 70B V1.0, Phi-4-mini 3.8B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
HumanEval69.5% ✎▁·▁▁▃▄▆▅█▃▁▁ beats 56/99easy · avg 79%▇▇▇▇▇▇▇▇▇ 24%sharp · at its level
HumanEval+62.2% ✎▁·▁▁▁▃▄▄▄█▃▁ beats 55/99easy · avg 74%▇▇▇▇▇▇▇▇ 19%sharp · at its level
MBPP+59.5% ✎▁···▁▁▂▅▇█▆▂ beats 36/75easy · avg 68%▇ 3.5%at its level
chat & writing▁▁▁▃▅▄▆█▇▇▇▃ #332 of 463 · 24% of its score · 4 tests

Beats Ministral 3 14B Reasoning 2512, Gemma 4 E4B, Ministral 3 8B here, though they rank higher overall. Trails Flan-T5 XXL, LFM2 700M, EXAONE 3.5 2.4B Instruct here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
AlpacaEval 2 length-controlled32.6% ✎▁▂▂▃▆▆█▆▄▄▁▁ beats 85/122medium · avg 39%▇▇▇▇ 11%at its level
Arena-Hard (v0.1, GPT-4-1106 judge)37.7% ✎▂▁▁▅█▅▄▃▃▅▃▁ beats 32/60medium · avg 52%▇▇▇ 7.6%sharp · at its level
Polyrating rating (bias-aware re-fit of Chatbot Arena votes, mid-2024)1163.0 ✎▂▁▂▁▃▇█▆▇▄▂▂ beats 72/95avg 1201▇ 3.0%blunt
LMArena (text)1242.5 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 91/379avg 1268▇ 2.9%blunt
math▁▂▃▅▇▅▅█▄▁▁▁ #354 of 462 * · 5.0% of its score · 2 tests

Beats GPT-4 (0613), Athene-70B, Llama 3 70B Instruct here, though they rank higher overall. Trails Gemma 7B (base), DeepSeek R1 Distill Qwen 1.5B, CodeGemma 7B (v1.0) here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
MATH level 524.5% ✎▂▂▅▆▄█▆▃▅▂▃▄ beats 22/92hard · avg 32%▇▇ 4.6%sharp
OTIS mock AIME 2024–20251.9% ✎▃▃▄▃▃▃▇▇█▃▂▅ beats 14/193very hard · avg 8.5%▇ 0.5%sharp · too hard for it · noisy
other tests5 not in a task · 24% of its score
testresultvs the others in its rundifficultycountswhy
LiveBench 2024-07-2639.2% ✎▁▁▁▂▂▃▂█▆▃▅▃ beats 43/61medium · avg 41%▇▇▇▇▇ 12%at its level
BigCodeBench (Instruct)29.6% ✎▃▂·▆▆██▆▅▃▃▃ beats 6/33medium · avg 41%▇ 3.6%at its level
BigCodeBench (Complete)37.9% ✎▂▁▁▄▂▅▇█▆▂▂▂ beats 21/58medium · avg 50%▇ 3.5%at its level
WildBench v2 WB-Score (task macro)38.8937 WB-Score ✎▁·▁▁·▃█▄▇▆▅▆ beats 27/52avg 45.199 WB-Score▇ 3.3%sharp
GPQA Diamond38.8% ✎▁▁▁▁▂▄▆▄▅▇█▅ beats 36/208hard · avg 40%▇ 2.5%sharp

$ where to run it

No verified API or download recorded yet · add one

$ how the score was worked out · EvalPlus / EvalPerf published… 46%, LiveBench model judgments (HF… 12%, AlpacaEval 1.0 and 2.0 leader… 11% and 6 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json