whatmodel.sh / Grok 4.5
Grok 4.5
↗ share
+ contribute
Grok 4.5 is a closed-weights language model from SpaceXAI (xAI), released July 2026.
$ how it compares
The LLMs ranked either side of Grok 4.5, out of 828 with a score, then more from SpaceXAI (xAI).
| # | model | score | where | ||
|---|---|---|---|---|---|
| 40 | 75±1 | api $2.00/M | |||
| 41 | 75±1 | api $10.00/M | |||
| 42 | 75±1 | api $3.00/M | |||
| 43 | 75±1 | api $2.00/M | |||
| 44 | 75±2 | comparison only | |||
| more from SpaceXAI (xAI) | |||||
| 30 | 77±1 | api $3.00/M | |||
| 47 | 75±1 | api $3.00/M | |||
| 60 | 73±2 | api $1.56/M | |||
$ what it's good at
agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #38 of 300 · 16% of its score · 4 tests
Beats Gemini 3.7 Flash, Qwen3.8-Flash-Next, Qwen3.8-Omni-Flash here, though they rank higher overall. Trails GLM-5.3-Flash, Grok 4.7, Claude Sonnet 5 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena Agent (October 2026 aggregate IPS) | 0.0121 IPS ✎ | ▁▁▁▄▂▃▇█▂▂▁▃ beats 24/49 | 8.0% |
| Terminal-Bench 4.0 | 12.4% ✎ | █▅▅▅▅·▅▃▃▅▅▅ beats 2/20 | 4.0% |
| τ³-bench banking_knowledge (v1.0.1 grading) | 47.9% ✎ | ▃▃▂▃·▆▃▂█▅▅▂ beats 23/25 | 3.0% |
| EEGAgentBench overall (tool-based EEG analysis agents, 6 tasks) | 51.8% ✎ | ▂·▁▁··▇▇█▂·▁ beats 22/25 | 1.2% |
coding▁▁▁▃▆██▇▆▄▃▁ #36 of 458 * · 10% of its score · 2 tests
Beats GPT-5.5, GPT-5.6 Terra, GPT-5.4 here, though they rank higher overall. Trails Qwen3.8 27B, GLM-5.2, GLM-5.3-Flash here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena WebDev (Code Arena) | 1551.8 ✎ | ▁▂▄▃▅█▄▇▆▄▁▁ beats 85/119 | 7.1% |
| Luau Leetcode fully solved (Torpedo Software) | 78.4% ✎ | ▁▁▁▁·▁▂▃▅▃█▇ beats 30/49 | 2.8% |
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #37 of 393 * · 4.0% of its score · 1 test
Beats GPT-6 Sol, MiMo-V2.6-Flash (309B-A15B), GPT-6 Luna here, though they rank higher overall. Trails MiMo-V2.5-Pro (1T-A42B), Grok 4.20 (0309 reasoning), Claude Opus 4.5 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| LMArena (text) | 1465.8 ✎ | ▁▁▁▂▃▃▃▆▆▇█▃ beats 338/379 | 4.0% |
math▁▂▃▅▆▅▄█▄▁▁▁ #36 of 398 · 48% of its score · 5 tests
Beats Claude Opus 4.7 here, though they rank higher overall. Trails GPT-5.2, Qwen3.7 Max, Claude Sonnet 5 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| FrontierMath tiers 1–3 v2 | 57.2% ✎ | ▂··▁▁▃▄▄█▅▃▃ beats 43/82 | 19% |
| FrontierMath tier 4 v2 | 24.4% ✎ | ▁▂▁▂█▅▂▂▁▁▁▁ beats 25/63 | 16% |
| MathArena ArXivMath June 2026 (48 problems) | 66.7% ✎ | ▂···▄·██▆▆▄▂ beats 8/19 | 11% |
| MathArena BrokenArXiv June 2026 (54 problems) | 29.3% ✎ | ▄··█▂▃▂▆▄··▂ beats 7/14 | 2.5% |
| OTIS mock AIME 2024–2025 | 97.8% ✎ | ▃▃▄▃▃▃▇▇█▃▃▅ beats 171/193 | 0.8% |
vision & documents▁▁▃▂▁▃▄▂▆▇█▄ #26 of 147 * · 4.1% of its score · 2 tests
Beats Claude Sonnet 5.5, MiMo-V2.6-Pro, GPT-5.6 Terra here, though they rank higher overall. Trails Gemini 3.6 Flash, Gemini 3.5 Flash, GLM-5.3-Flash here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena vision (style controlled) | 1279.0 ✎ | ▁▁▂▂▂▂▄▅▅▆██ beats 123/145 | 2.8% |
| Arena document (style controlled) | 1464.3 ✎ | ▁▁▃▃▄▃▇█▅▇▄▅ beats 20/37 | 1.3% |
web search▂▁▂▆▄█▃▃▁▁·▁ #27 of 80 * · 1.6% of its score · 1 test
Beats Claude Haiku 5.5, Gemini 3.1 Pro (Preview), Claude Opus 4.7 here, though they rank higher overall. Trails GPT-4o mini (2024-07-18), Mistral Small 3.1 24B (2503), GPT-4o (2024-08-06) here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena search systems (style controlled) | 1202.4 ✎ | ▁·▁▁▂▂▂█▅▂▁▁ beats 23/30 | 1.6% |
other tests5 not in a task · 16% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Furniture Assembly (Epoch) | 22.5% ✎ | █▆▆▆▆▂▅▂▂▂·▅ beats 3/30 | 6.6% |
| Chess Puzzles (Epoch) | 36.0% ✎ | █▁▁▁▁▂▁▄▃▂▁▁ beats 112/135 | 3.3% |
| GPQA Diamond | 93.4% ✎ | ▁▁▁▁▂▄▆▄▅▇█▅ beats 197/208 | 3.1% |
| SimpleQA Verified | 48.3% ✎ | ▁▁▃▂▃▃▆▆█▃▂▅ beats 50/78 | 1.6% |
| RobloxQA v2.0 multiple choice (Torpedo Software) | 96.2% ✎ | ▁▁▃▁█▄▃▃▆▂▂▂ beats 33/49 | 0.9% |
$ where to run it
Through an API
api · xAI · $3.00/M · $2 in / $6 out per 1M tokens · 500k context · docs.x.ai ↗ · price sourceStandard base token rate from models.dev. Provider-specific tiers, long-context surcharges, caching and promotions may differ.
$ how the score was worked out · Epoch AI — internal evaluatio… 50%, LMArena leaderboard dataset 25%, MathArena ArXivMath / BrokenA… 13% and 4 more
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
| source | results | share of the score |
|---|---|---|
| 7 | 50% | |
| 6 | 25% | |
| 2 | 13% | |
| 1 | 4% | |
| 2 | 4% | |
| 1 | 3% | |
| 1 | 1% | |
| prior · pull toward the middle | 0% | |
| weighted average | = 75.0 |
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json