whatmodel.sh / Claude Opus 4.7
Claude Opus 4.7
↗ share
+ contribute
Claude Opus 4.7 is a closed-weights language model from Anthropic, released April 2026.
$ how it compares
The LLMs ranked either side of Claude Opus 4.7, out of 828 with a score, then more from Anthropic.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 39 | 75±1 | api $4.50/M | |||
| 40 | 75±1 | api $2.00/M | |||
| 41 | 75±1 | api $10.00/M | |||
| 42 | 75±1 | api $3.00/M | |||
| 43 | 75±1 | api $2.00/M | |||
| more from Anthropic | |||||
| 2 | 87±1 | api $8.00/M | |||
| 4 | 85±1 | api $20.00/M | |||
| 5 | 84±1 | api $4.00/M | |||
$ what it's good at
agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #34 of 300 · 13% of its score · 7 tests
Beats GPT-6 Luna, GPT-5.6 Luna, Gemini 3.7 Flash here, though they rank higher overall. Trails GLM-5.3-Flash, Grok 4.7 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| SWE-bench Verified | 83.5% ✎ | ▁··▁·▁▂▁▄█▄▃ beats 29/29 | 4.3% |
| Agents' Last Exam overall full-pass rate (fixed OpenClaw + GUI-as-Tool) | 15.1% ✎ | ▄···█▄▄▄█▄·█ beats 8/10 | 2.5% |
| τ³-bench banking_knowledge (v1.0.1 grading) | 40.2% ✎ | ▃▃▂▃·▆▃▂█▅▅▂ beats 19/25 | 2.0% |
| Toolathlon (Tool Decathlon) lab | 59.3% ✎ | █···█··█·███ beats 3/5 | 1.5% |
| SWE Atlas (Codebase Q&A, Test Writing, Refactoring; mini-SWE-agent) pass@1 | 38.9% ✎ | ▄·▄··█···▄·█ beats 6/6 | 1.4% |
| RWSearch | 79.3% ✎ | ████··█····█ beats 3/5 | 1.0% |
| TerminalWorld-Verified (200 tasks) with Terminus-2 | 62.5% ✎ | ▄··▄·▄·█···▄ beats 5/5 | 0.6% |
coding▁▁▁▃▆██▇▆▄▃▁ #35 of 458 · 11% of its score · 3 tests
Beats GPT-5.5, GPT-5.6 Terra, GPT-5.4 here, though they rank higher overall. Trails Qwen3.8 27B, GLM-5.2, GLM-5.3-Flash here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena WebDev (Code Arena) | 1557.3 ✎ | ▁▂▄▃▅█▄▇▆▄▁▁ beats 87/119 | 4.7% |
| SWE-bench Verified | 83.5% ✎ | ▁··▁·▁▂▁▄█▄▃ beats 29/29 | 4.3% |
| SWE Atlas (Codebase Q&A, Test Writing, Refactoring; mini-SWE-agent) pass@1 | 38.9% ✎ | ▄·▄··█···▄·█ beats 6/6 | 1.4% |
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #6 of 393 * · 3.0% of its score · 2 tests
Beats GPT-6 Astra, GPT-6.1 Sol, Claude Sonnet 5.5 here, though they rank higher overall. Trails Claude Opus 4.6 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| LMArena (text) | 1501.3 ✎ | ▁▁▁▂▃▃▃▆▆▇█▃ beats 375/379 | 2.7% |
| IFEval (aggregation unspecified) | 88.7% ✎ | █·██·█···█·█ beats 1/5 | 0.3% |
math▁▂▃▅▆▅▄█▄▁▁▁ #38 of 398 · 47% of its score · 14 tests
Trails GPT-5.2, Qwen3.7 Max, Claude Opus 4.6 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| FrontierMath tiers 1–3 v2 | 70.2% ✎ | ▂··▁▁▃▄▄█▅▃▃ beats 59/82 | 12% |
| FrontierMath tier 4 v2 | 31.7% ✎ | ▁▂▁▂█▅▂▂▁▁▁▁ beats 37/63 | 11% |
| MathArena ArXivMath April 2026 (40 problems) | 57.5% ✎ | ▁·····▅██▄·▁ beats 12/20 | 6.0% |
| MathArena ArXivMath February 2026 (32 problems) | 40.6% ✎ | ▁▁▁▁█▇▄▃▁▃·▃ beats 12/24 | 3.5% |
| MathArena ArXivMath March 2026 (30 problems) | 50.8% ✎ | █▃▅·█▃▃·▅·▃▃ beats 4/14 | 2.9% |
| MathArena BrokenArXiv April 2026 (61 problems) | 4.1% ✎ | ▃▂▆█▃▃▂▂▂··▂ beats 0/18 | 2.4% |
| MathArena ArXivMath January 2026 (23 problems) | 52.2% ✎ | ▂··▄▂▄█▆▆▄▄█ beats 6/23 | 2.2% |
| MathArena BrokenArXiv March 2026 (56 problems) | 5.8% ✎ | █·▆█▂·▂▂···▂ beats 0/14 | 1.4% |
6 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| MathArena BrokenArXiv February 2026 (31 problems) | 4.0% ✎ | ▃▃▂▃█▃▂·▃··▂ beats 2/16 | 1.4% |
| MathArena ArXivLean March 2026 (41 problems) | 14.6% ✎ | ▂····▂·····█ beats 3/5 | 1.0% |
| IMO-AnswerBench | 81.8% ✎ | ▁▁·▁▁▁▄▅█▄▂▃ beats 25/42 | 1.0% |
| USAMO 2026 lab | 69.3% ✎ | █·██······██ beats 1/4 | 0.9% |
| MathConstraint full release, no tools (329 instances) | 42.6% ✎ | ▄··▄▄·▄▄█▄·▄ beats 5/8 | 0.7% |
| OTIS mock AIME 2024–2025 | 86.7% ✎ | ▃▃▄▃▃▃▇▇█▃▂▅ beats 132/193 | 0.5% |
vision & documents▁▁▃▂▁▃▄▂▆▇█▄ #4 of 147 · 4.4% of its score · 3 tests
Beats GPT-6 Astra, GPT-6.1 Sol, Claude Fable 5.1 here, though they rank higher overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena vision (style controlled) | 1297.7 ✎ | ▁▁▂▂▂▂▄▅▅▆██ beats 142/145 | 1.8% |
| CharXiv (reasoning questions) lab | 81.3% ✎ | ███··█·██··█ beats 5/6 | 1.7% |
| Arena document (style controlled) | 1493.0 ✎ | ▁▁▃▃▄▃▇█▅▇▄▅ beats 35/37 | 0.9% |
web search▂▁▂▆▄█▃▃▁▁·▁ #30 of 80 * · 2.1% of its score · 2 tests
Beats Gemini 3.1 Pro (Preview) here, though they rank higher overall. Trails GPT-4o mini (2024-07-18), Mistral Small 3.1 24B (2503), GPT-4o (2024-08-06) here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena search systems (style controlled) | 1212.0 ✎ | ▁·▁▁▂▂▂█▅▂▁▁ beats 26/30 | 1.1% |
| RWSearch | 79.3% ✎ | ████··█····█ beats 3/5 | 1.0% |
other tests14 not in a task · 26% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| EBR-bench (Epoch) | 19.0% ✎ | ▄▂·▆█▃▆▄▆▆·▄ beats 10/23 | 4.9% |
| Furniture Assembly (Epoch) | 33.3% ✎ | █▆▆▆▆▂▅▂▂▂·▅ beats 10/30 | 4.4% |
| Mystery Game Puzzles (Epoch) | 28.0% ✎ | █··▂▃▇▄█▂▃▁▁ beats 45/74 | 3.4% |
| Chess Puzzles (Epoch) | 7.0% ✎ | █▁▃▁▁▂▁▄▂▂▁▁ beats 52/135 | 2.2% |
| GPQA Diamond | 86.4% ✎ | ▁▁▁▁▂▄▆▄▅▇█▅ beats 153/208 | 2.1% |
| EQ-Bench 3 (emotional intelligence, judge Elo) | 1460.9 ✎ | ▁·▂▁▄▅▅▃█▄▁▃ beats 62/62 | 1.6% |
| WildClawBench | 62.2% ✎ | ▃·▅▅█·▅█▅▃▃▃ beats 17/17 | 1.6% |
| The Token Games Elo (10-model puzzle-duel tournament) | 1100.0 ✎ | █··▄█··▄·▄·▄ beats 5/7 | 1.5% |
6 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| FORTE (AGI-Eval) | 77.6% ✎ | ▄···█·····▄█ beats 4/5 | 1.1% |
| SimpleQA Verified | 51.7% ✎ | ▁▁▃▂▃▃▆▆█▃▂▅ beats 56/78 | 1.1% |
| LongSocialBench (full-context, 4-option MCQ over discussion threads) | 56.0% ✎ | ▆▂·▄█·▂▂·▄▄▃ beats 16/16 | 1.0% |
| WritingBench | 85.3% ✎ | ▁·▁▂▁··▅█▂▂▁ beats 15/20 | 1.0% |
| MirrorCode (Epoch) | 31.1% ✎ | █·▄▄·▄·▄·▄·█ beats 4/8 | 0.5% |
| Vectara hallucination leaderboard (HHEM-2.3, factual consistency rate) | 88.0% ✎ | ▁▂▁▂▅█▂▃▄▃▁▁ beats 24/98 | 0.0% |
$ where to run it
Through an API
api · $10.00/M · $5 in / $25 out per 1M tokens · 1M context · docs.anthropic.com ↗ · price sourceStandard base token rate from models.dev. Provider-specific tiers, long-context surcharges, caching and promotions may differ.
$ how the score was worked out · Epoch AI — internal evaluatio… 46%, MathArena ArXivMath / BrokenA… 21%, LMArena leaderboard dataset 11% and 12 more
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json