whatmodel.sh / Grok 3 Preview (02-24)

Grok 3 Preview (02-24) is a closed-weights language model from SpaceXAI (xAI), released February 2025.

Catalogue identity notes

Comparison-only. Arena entry 'grok-3-preview-02-24' (text). LMArena's leaderboard table (arena-leaderboard space @6f2eeeb) labels 'grok-3-preview-02-24' as 'Grok-3-Preview-02-24' (xAI, Proprietary), linking https://x.ai/blog/grok-3. Released 2025-02: xAI 'Grok 3 Beta' post dated Feb 19, 2025. Dated pre-API Grok 3 snapshot (LMArena label 'Grok-3-Preview-02-24', link x.ai/blog/grok-3); kept separate from the later grok-3 API model, which xAI retired on May 15, 2026.

66.3±3.3comparison only: no current run option verifiedfrom 1 benchmark result across 1 source* thinly tested, treat the rank as provisional

$ how it compares

The LLMs ranked either side of Grok 3 Preview (02-24), out of 1132 with a score, then more from SpaceXAI (xAI).

#modelscorewhereRAMreleased
167Nova 2 Omni (Preview) Amazon66±7api $0.93/M2025-11
168GPT-5.1-Codex OpenAI66±2comparison only2025-11
169Grok 3 Preview (02-24) SpaceXAI (xAI)66±3comparison only2025-02
170Llama-xLAM-2-70b-fc-r Salesforce66±4local~29GB2025-03
171Qwen3.6 Flash Alibaba66±1api $0.56/M2026-04
more from SpaceXAI (xAI)
30Grok 4.6 SpaceXAI (xAI)77±1api $3.00/M2026-08
42Grok 4.5 SpaceXAI (xAI)75±1api $3.00/M2026-07
47Grok 4.7 SpaceXAI (xAI)75±1api $3.00/M2026-09

see all LLMs · find the ones that fit your machine

$ what it's good at

chat & writing▁▁▁▃▅▅▆█▆▆▆▂ #125 of 579 * · 95% of its score · 1 test

Beats LongCat 2.0 (1.6T-A48B), Inkling Small (266B-A12B), GPT-5.4 nano here, though they rank higher overall. Trails Mistral Large 3 (675B-A41B), Gemma 4 12B, Qwen3-VL 235B-A22B Instruct here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
LMArena (text)1411.4 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 258/379avg 1268▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 95%blunt

$ where to run it

No verified API or download recorded yet · add one

$ how the score was worked out · LMArena leaderboard dataset 95%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
LMArena leaderboard dataset1▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 95%CC BY 4.0
prior · pull toward the middle▇ 5%
weighted average= 66.3

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json