whatmodel.sh / Codestral (25.01)

Codestral (25.01) is a closed-weights language model from Mistral, released January 2025. Licence: proprietary.

Catalogue identity notes

Comparison-only: retired or no longer listed API model, kept so its independent runs can be scored. Mistral API model codestral-2501 ('Codestral' version 25.01 in Mistral's legacy-models table: deprecated 11/6/2025, retired 11/30/2025). The Aider run (2025-01-13, label 'Codestral 25.01') called codestral-latest on Codestral 25.01's launch day, when the alias pointed to 25.01. No open weights for 25.01 (distinct from the open Codestral-22B-v0.1).

51.5±3.0comparison only: no current run option verifiedfrom 1 benchmark result across 1 source* thinly tested, treat the rank as provisional

$ how it compares

The LLMs ranked either side of Codestral (25.01), out of 1132 with a score, then more from Mistral.

#modelscorewhereRAMreleased
528Qwen2.5 14B Instruct Alibaba52±1local~10GB2024-09
529Gemini Experimental 1121 Google52±2comparison only2024-11
530Codestral (25.01) Mistral52±3comparison only2025-01
531Jan v1 4B Jan (Menlo Research)52±7local~3.9GB2025-08
532Cogito v1 Preview Llama 8B Deep Cogito51±5local~6.2GB2025-03
more from Mistral
88Mistral Large 4 (public preview) Mistral71±2api $2.06/M2026-10
204Mistral Medium 3.5 (128B) Mistral65±1api $3.00/M +local~42GB2026-04
212Mistral Medium 3.1 (2508) Mistral64±2comparison only2025-08

see all LLMs · find the ones that fit your machine

$ what it's good at

coding▁▁▁▃▅▇█▇▅▄▂▁ #313 of 549 * · 96% of its score · 1 test

Beats Qwen3-VL 32B Instruct, Solar Open 100B (102B-A12B), GLM-4.7-Flash here, though they rank higher overall. Trails DeepSeek LLM 67B Chat, QwQ-32B-Preview, InternLM2.5 20B Chat here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Aider polyglot (225 exercises, two attempts)11.1% ✎▂·▃▃▅▂▃█▆▄▂▂ beats 4/49very hard · avg 8.5%▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 96%sharp

$ where to run it

No verified API or download recorded yet · add one

$ how the score was worked out · Aider polyglot benchmark runs 96%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Aider polyglot benchmark runs1▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 96%Apache-2.0
prior · pull toward the middle▇ 4%
weighted average= 51.5

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json