whatmodel.sh / Claude Opus 5
Claude Opus 5
↗ share
+ contribute
Claude Opus 5 is a closed-weights language model from Anthropic, released July 2026.
$ how it compares
The LLMs ranked either side of Claude Opus 5, out of 828 with a score, then more from Anthropic.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 4 | 85±1 | api $20.00/M | |||
| 5 | 84±1 | api $4.00/M | |||
| 6 | 83±1 | api $10.00/M | |||
| 7 | 83±1 | api $4.00/M | |||
| 8 | 82±1 | api $67.50/M | |||
| more from Anthropic | |||||
| 2 | 87±1 | api $8.00/M | |||
| 11 | 81±1 | api $20.00/M | |||
| 12 | 81±1 | limited preview | |||
$ what it's good at
agent tasks▁▁▃▆█▆▅▅▅▄▃▃ #6 of 300 · 36% of its score · 16 tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Terminal-Bench 4.0 +1 | 51.8% ✎ | █▅▅▅▅·▅▃▃▅▅▅ beats 16/20 | 7.5% |
| Arena Agent (October 2026 aggregate IPS) | 0.0792 IPS ✎ | ▁▁▁▄▂▃▇█▂▃▁▃ beats 42/49 | 4.8% |
| SWE-bench Pro (split unspecified) lab | 79.2% ✎ | ▄█·▄·▄██···▄ beats 5/9 | 4.3% |
| GameLogicBench solve rate (72 Godot game-logic tasks, Claude Code scaffold) | 52.8% ✎ | █▄·█·▄·██▄·▄ beats 11/11 | 2.1% |
| SWE-bench Multilingual lab | 89.5% ✎ | ▃··▃·▅▃▃█··▃ beats 7/9 | 2.1% |
| τ³-bench banking_knowledge (v1.0.1 grading) | 48.7% ✎ | ▃▃▂▃·▆▃▂█▅▅▂ beats 24/25 | 2.0% |
| E2E-SWE (build a working codebase from scratch, 186 tasks) pass@1 | 67.7% ✎ | ▃··▅··▃█▃▅▃▅ beats 12/12 | 1.9% |
| SWE-bench Verified lab | 96.0% ✎ | ▁▁▁▁▁▁▂▄█▆▁▃ beats 131/131 | 1.8% |
8 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Chartography with tools lab +1 | 83.4% ✎ | ▃········▃██ beats 2/7 | 1.7% |
| Humanity's Last Exam with tools lab +1 | 63.6% ✎ | ▁······▁·▄·█ beats 6/10 | 1.4% |
| DeepSWE v1.1 (resolved) lab | 68.8% ✎ | █·····████·█ beats 2/5 | 1.3% |
| Video2World V2WScore (coding agents reconstruct interactive simulated worlds from videos, OpenCode scaffold) | 41.6% ✎ | █··▄█·▄····▄ beats 6/6 | 1.3% |
| Thinkingbox-bench pass@1 (507 stateful business-workflow agent tasks, N=20) | 66.5% ✎ | ▅··▃·▃·█▃▅██ beats 15/15 | 1.1% |
| BrowseComp with context management lab | 90.8% ✎ | ▅·▅▃·█▃·█▅·▃ beats 14/14 | 0.9% |
| KlinikeBench strict pass@1 (333 interactive clinical encounters, Terminus-2) | 29.4% ✎ | ▁▁·▁▁▁▁▅▃█▅█ beats 27/27 | 0.9% |
| Toolathlon-Verified lab | 80.6% ✎ | ▃·····█···▃▃ beats 5/5 | 0.7% |
coding▁▁▁▃▆██▇▆▄▃▃ #6 of 458 · 19% of its score · 8 tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| SWE-bench Pro (split unspecified) lab | 79.2% ✎ | ▄█·▄·▄██···▄ beats 5/9 | 4.3% |
| Arena WebDev (Code Arena) | 1695.0 ✎ | ▁▂▄▃▅█▄▇▆▄▃▁ beats 114/119 | 4.2% |
| GameLogicBench solve rate (72 Godot game-logic tasks, Claude Code scaffold) | 52.8% ✎ | █▄·█·▄·██▄·▄ beats 11/11 | 2.1% |
| SWE-bench Multilingual lab | 89.5% ✎ | ▃··▃·▅▃▃█··▃ beats 7/9 | 2.1% |
| E2E-SWE (build a working codebase from scratch, 186 tasks) pass@1 | 67.7% ✎ | ▃··▅··▃█▃▅▃▅ beats 12/12 | 1.9% |
| SWE-bench Verified lab | 96.0% ✎ | ▁▁▁▁▁▁▂▄█▆▁▃ beats 131/131 | 1.8% |
| DeepSWE v1.1 (resolved) lab | 68.8% ✎ | █·····████·█ beats 2/5 | 1.3% |
| Luau Leetcode fully solved (Torpedo Software) | 82.2% ✎ | ▁▁▁▁·▁▂▃▅▃█▇ beats 38/49 | 1.0% |
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #11 of 393 * · 2.4% of its score · 1 test
Beats GPT-6 Astra, GPT-6.1 Sol, Claude Sonnet 5.5 here, though they rank higher overall. Trails Claude Opus 4.6, Muse Spark 1.1, Claude Opus 4.7 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| LMArena (text) | 1489.5 ✎ | ▁▁▁▂▃▃▃▆▆▇█▃ beats 369/379 | 2.4% |
math▁▂▃▅▆▅▄█▄▁▃▁ #12 of 398 · 21% of its score · 6 tests
Trails GPT-5.5, Claude Mythos Preview (limited preview), Claude Fable 5 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| FrontierMath tier 4 v2 | 73.2% ✎ | ▁▂▁▂█▅▂▃▁▁▁▁ beats 54/63 | 8.0% |
| FrontierMath tiers 1–3 v2 | 85.6% ✎ | ▂··▁▁▃▄▄█▅▃▃ beats 72/82 | 5.0% |
| MathArena ArXivMath June 2026 (48 problems) | 82.6% ✎ | ▂···▄·██▆▆▄▂ beats 14/19 | 3.9% |
| MathArena ArXivLean June 2026 (46 problems) | 32.6% ✎ | ▄····▄▄███·▄ beats 7/9 | 2.3% |
| MathArena BrokenArXiv June 2026 (54 problems) | 90.7% ✎ | ▄··█▂▂▂▆▄··▃ beats 14/14 | 1.6% |
| OTIS mock AIME 2024–2025 | 98.9% ✎ | ▃▃▄▃▃▃▇▇█▃▂▅ beats 179/193 | 0.1% |
vision & documents▁▁▃▂▁▃▄▂▆▇█▄ #6 of 147 · 3.2% of its score · 4 tests
Beats GPT-6 Astra, GPT-6.1 Sol, Claude Fable 5.1 here, though they rank higher overall. Trails Claude Opus 4.7, Gemini 3.7 Flash, Qwen3.8 Max (2.4T-A95B) here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena vision (style controlled) | 1289.0 ✎ | ▁▁▂▂▂▂▄▅▅▆██ beats 134/145 | 1.6% |
| Arena document (style controlled) | 1489.7 ✎ | ▁▁▃▃▄▃▇█▅▇▄▅ beats 33/37 | 0.8% |
| SciDocBench scientific-document workflows (overall, 496 instances) | 62.6% ✎ | ▃▃···█▃▅▃·▃▅ beats 11/11 | 0.8% |
| PureDocBench document parsing (Avg3 over Clean/Digital/Real) | 77.1% ✎ | ▂·▁·▂▂▅█·▁▃▂ beats 19/22 | 0.0% |
web search▂▁▂▆▄█▃▃▁▁·▁ #16 of 80 * · 2.4% of its score · 2 tests
Beats Claude Fable 5.1, Claude Sonnet 5.5 here, though they rank higher overall. Trails GPT-4o mini (2024-07-18), Mistral Small 3.1 24B (2503), GPT-4o (2024-08-06) here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Humanity's Last Exam with tools lab +1 | 63.6% ✎ | ▁······▁·▄·█ beats 6/10 | 1.4% |
| BrowseComp with context management lab | 90.8% ✎ | ▅·▅▃·█▃·█▅·▃ beats 14/14 | 0.9% |
other tests18 not in a task · 32% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| EBR-bench (Epoch) | 45.7% ✎ | ▄▂·▆█▂▆▄▆▆·▄ beats 18/23 | 7.0% |
| Mystery Game Puzzles (Epoch) | 59.0% ✎ | █··▂▃▇▄█▂▃▁▁ beats 70/74 | 4.8% |
| Furniture Assembly (Epoch) | 60.8% ✎ | █▆▆▆▆▂▅▃▂▂·▅ beats 25/30 | 4.4% |
| Humanity's Last Exam lab +1 | 56.6% ✎ | ▂·····▂·▄▂█▄ beats 5/10 | 3.0% |
| Chess Puzzles (Epoch) | 42.0% ✎ | █▁▁▁▁▂▁▄▂▃▁▁ beats 122/135 | 2.5% |
| KMMLU-HARD (Daekeun Kim, zero-shot) | 88.4% ✎ | █···▁▁▁▂▃·▆▃ beats 23/23 | 1.7% |
| Global-MMLU lab | 92.5% ✎ | ▄▄····▄▄··▄█ beats 3/6 | 1.1% |
| KoBALT-700 (Daekeun Kim) | 88.1% ✎ | ▄▄█·····▄··▄ beats 5/5 | 1.0% |
10 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| SimpleQA Verified | 59.9% ✎ | ▁▁▃▂▃▃▆▆█▃▂▅ beats 63/78 | 0.9% |
| AutomationBench public set (Zapier README) | 50.3% ✎ | ▄······▄█··▄ beats 4/4 | 0.8% |
| KMMLU-Pro (Daekeun Kim) | 95.6% ✎ | ▄·▄█·····▄·▄ beats 5/5 | 0.8% |
| Icelandic LLM Leaderboard average (Miðeind, Sept 2026 suite) | 68.6% ✎ | ▁▁▃▂▂▄▁▃▄▄▄█ beats 35/38 | 0.8% |
| GPQA Diamond | 93.9% ✎ | ▁▁▁▁▂▄▆▄▅▇█▅ beats 199/208 | 0.8% |
| CLIcK Korean (Daekeun Kim) | 95.8% ✎ | ▆▄▄▄█▄▂·▄█·▄ beats 23/23 | 0.8% |
| HealthBench lab | 67.1% ✎ | █·▄·····▄▄▄▄ beats 4/6 | 0.6% |
| MuSR Korean (Daekeun Kim) | 86.5% ✎ | █·····███·██ beats 5/5 | 0.6% |
| HAE-RAE 1.0 (Daekeun Kim) | 95.8% ✎ | ▄▄▄▂▂█▂▄▂█▂▄ beats 22/22 | 0.5% |
| RobloxQA v2.0 multiple choice (Torpedo Software) | 97.5% ✎ | ▁▁▃▁█▄▃▃▆▃▂▂ beats 42/49 | 0.4% |
$ where to run it
Through an API
api · $10.00/M · $5 in / $25 out per 1M tokens · 1M context · docs.anthropic.com ↗ · price sourceStandard base token rate from models.dev. Provider-specific tiers, long-context surcharges, caching and promotions may differ.
$ how the score was worked out · Epoch AI — internal evaluatio… 33%, Anthropic system cards and mo… 23%, LMArena leaderboard dataset 14% and 14 more
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json