whatmodel.sh / Claude Opus 4.7

Claude Opus 4.7 is a closed-weights language model from Anthropic, released April 2026.

75.0±0.5#40 of 719 LLMsfrom 42 benchmark results across 15 sources

$ how it compares

The LLMs ranked either side of Claude Opus 4.7, out of 828 with a score, then more from Anthropic.

#modelscorewhereRAMreleased
39Gemini 3.1 Pro (Preview) Google75±1api $4.50/M2026-02
40Muse Spark 1.2 Meta75±1api $2.00/M2026-08
41Claude Opus 4.7 Anthropic75±1api $10.00/M2026-04
42Grok 4.5 SpaceXAI (xAI)75±1api $3.00/M2026-07
43Muse Spark 1.1 Meta75±1api $2.00/M2026-07
more from Anthropic
2Claude Opus 5.5 Anthropic87±1api $8.00/M2026-09
4Claude Fable 5.1 Anthropic85±1api $20.00/M2026-09
5Claude Sonnet 5.5 Anthropic84±1api $4.00/M2026-09

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #34 of 300 · 13% of its score · 7 tests

Beats GPT-6 Luna, GPT-5.6 Luna, Gemini 3.7 Flash here, though they rank higher overall. Trails GLM-5.3-Flash, Grok 4.7 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
SWE-bench Verified83.5% ✎▁··▁·▁▂▁▄█▄▃ beats 29/29hard · avg 19%▇▇ 4.3%sharp
Agents' Last Exam overall full-pass rate (fixed OpenClaw + GUI-as-Tool)15.1% ✎▄···█▄▄▄█▄·█ beats 8/10very hard · avg 1.7%▇ 2.5%typical
τ³-bench banking_knowledge (v1.0.1 grading)40.2% ✎▃▃▂▃·▆▃▂█▅▅▂ beats 19/25very hard · avg 4.1%▇ 2.0%at its level
Toolathlon (Tool Decathlon) lab59.3% ✎█···█··█·███ beats 3/5hard · avg 16%▇ 1.5%at its level
SWE Atlas (Codebase Q&A, Test Writing, Refactoring; mini-SWE-agent) pass@138.9% ✎▄·▄··█···▄·█ beats 6/6very hard · avg 6.1%▇ 1.4%at its level
RWSearch79.3% ✎████··█····█ beats 3/5medium · avg 44%▇ 1.0%typical
TerminalWorld-Verified (200 tasks) with Terminus-262.5% ✎▄··▄·▄·█···▄ beats 5/5hard · avg 27%▇ 0.6%blunt · at its level
coding▁▁▁▃▆██▇▆▄▃▁ #35 of 458 · 11% of its score · 3 tests

Beats GPT-5.5, GPT-5.6 Terra, GPT-5.4 here, though they rank higher overall. Trails Qwen3.8 27B, GLM-5.2, GLM-5.3-Flash here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Arena WebDev (Code Arena)1557.3 ✎▁▂▄▃▅█▄▇▆▄▁▁ beats 87/119avg 981▇▇ 4.7%sharp
SWE-bench Verified83.5% ✎▁··▁·▁▂▁▄█▄▃ beats 29/29hard · avg 19%▇▇ 4.3%sharp
SWE Atlas (Codebase Q&A, Test Writing, Refactoring; mini-SWE-agent) pass@138.9% ✎▄·▄··█···▄·█ beats 6/6very hard · avg 6.1%▇ 1.4%at its level
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #6 of 393 * · 3.0% of its score · 2 tests

Beats GPT-6 Astra, GPT-6.1 Sol, Claude Sonnet 5.5 here, though they rank higher overall. Trails Claude Opus 4.6 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
LMArena (text)1501.3 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 375/379avg 1268▇ 2.7%blunt
IFEval (aggregation unspecified)88.7% ✎█·██·█···█·█ beats 1/5easy · avg 74%▇ 0.3%maxed out
math▁▂▃▅▆▅▄█▄▁▁▁ #38 of 398 · 47% of its score · 14 tests

Trails GPT-5.2, Qwen3.7 Max, Claude Opus 4.6 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
FrontierMath tiers 1–3 v270.2% ✎▂··▁▁▃▄▄█▅▃▃ beats 59/82very hard · avg 1.2%▇▇▇▇▇ 12%sharp · at its level
FrontierMath tier 4 v231.7% ✎▁▂▁▂█▅▂▂▁▁▁▁ beats 37/63very hard · avg 0.1%▇▇▇▇ 11%sharp · at its level
MathArena ArXivMath April 2026 (40 problems)57.5% ✎▁·····▅██▄·▁ beats 12/20very hard · avg 7.2%▇▇ 6.0%sharp · at its level
MathArena ArXivMath February 2026 (32 problems)40.6% ✎▁▁▁▁█▇▄▃▁▃·▃ beats 12/24very hard · avg 9.1%▇ 3.5%at its level
MathArena ArXivMath March 2026 (30 problems)50.8% ✎█▃▅·█▃▃·▅·▃▃ beats 4/14very hard · avg 15%▇ 2.9%at its level
MathArena BrokenArXiv April 2026 (61 problems)4.1% ✎▃▂▆█▃▃▂▂▂··▂ beats 0/18very hard · avg 0.7%▇ 2.4%sharp · at its level · noisy
MathArena ArXivMath January 2026 (23 problems)52.2% ✎▂··▄▂▄█▆▆▄▄█ beats 6/23hard · avg 22%▇ 2.2%at its level
MathArena BrokenArXiv March 2026 (56 problems)5.8% ✎█·▆█▂·▂▂···▂ beats 0/14very hard · avg 0.8%▇ 1.4%sharp · noisy
6 more tests
testresultvs the others in its rundifficultycountswhy
MathArena BrokenArXiv February 2026 (31 problems)4.0% ✎▃▃▂▃█▃▂·▃··▂ beats 2/16very hard · avg 0.7%▇ 1.4%sharp · noisy
MathArena ArXivLean March 2026 (41 problems)14.6% ✎▂····▂·····█ beats 3/5very hard · avg 1.0%▇ 1.0%typical
IMO-AnswerBench81.8% ✎▁▁·▁▁▁▄▅█▄▂▃ beats 25/42hard · avg 25%▇ 1.0%noisy
USAMO 2026 lab69.3% ✎█·██······██ beats 1/4hard · avg 16%▇ 0.9%sharp · noisy
MathConstraint full release, no tools (329 instances)42.6% ✎▄··▄▄·▄▄█▄·▄ beats 5/8very hard · avg 11%▇ 0.7%at its level
OTIS mock AIME 2024–202586.7% ✎▃▃▄▃▃▃▇▇█▃▂▅ beats 132/193very hard · avg 8.5%▇ 0.5%sharp · maxed out · noisy
vision & documents▁▁▃▂▁▃▄▂▆▇█▄ #4 of 147 · 4.4% of its score · 3 tests

Beats GPT-6 Astra, GPT-6.1 Sol, Claude Fable 5.1 here, though they rank higher overall.

testresultvs the others in its rundifficultycountswhy
Arena vision (style controlled)1297.7 ✎▁▁▂▂▂▂▄▅▅▆██ beats 142/145avg 1068▇ 1.8%blunt
CharXiv (reasoning questions) lab81.3% ✎███··█·██··█ beats 5/6hard · avg 29%▇ 1.7%typical
Arena document (style controlled)1493.0 ✎▁▁▃▃▄▃▇█▅▇▄▅ beats 35/37avg 1335▇ 0.9%blunt
web search▂▁▂▆▄█▃▃▁▁·▁ #30 of 80 * · 2.1% of its score · 2 tests

Beats Gemini 3.1 Pro (Preview) here, though they rank higher overall. Trails GPT-4o mini (2024-07-18), Mistral Small 3.1 24B (2503), GPT-4o (2024-08-06) here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Arena search systems (style controlled)1212.0 ✎▁·▁▁▂▂▂█▅▂▁▁ beats 26/30avg 1055▇ 1.1%blunt
RWSearch79.3% ✎████··█····█ beats 3/5medium · avg 44%▇ 1.0%typical
other tests14 not in a task · 26% of its score
testresultvs the others in its rundifficultycountswhy
EBR-bench (Epoch)19.0% ✎▄▂·▆█▃▆▄▆▆·▄ beats 10/23very hard · avg 0.3%▇▇ 4.9%sharp
Furniture Assembly (Epoch)33.3% ✎█▆▆▆▆▂▅▂▂▂·▅ beats 10/30very hard · avg 1.2%▇▇ 4.4%sharp · at its level
Mystery Game Puzzles (Epoch)28.0% ✎█··▂▃▇▄█▂▃▁▁ beats 45/74very hard · avg 9.4%▇ 3.4%sharp · noisy
Chess Puzzles (Epoch)7.0% ✎█▁▃▁▁▂▁▄▂▂▁▁ beats 52/135very hard · avg 5.9%▇ 2.2%sharp · at its level · noisy
GPQA Diamond86.4% ✎▁▁▁▁▂▄▆▄▅▇█▅ beats 153/208hard · avg 40%▇ 2.1%sharp
EQ-Bench 3 (emotional intelligence, judge Elo)1460.9 ✎▁·▂▁▄▅▅▃█▄▁▃ beats 62/62avg 1044▇ 1.6%typical
WildClawBench62.2% ✎▃·▅▅█·▅█▅▃▃▃ beats 17/17very hard · avg 11%▇ 1.6%at its level
The Token Games Elo (10-model puzzle-duel tournament)1100.0 ✎█··▄█··▄·▄·▄ beats 5/7avg 815▇ 1.5%typical
6 more tests
testresultvs the others in its rundifficultycountswhy
FORTE (AGI-Eval)77.6% ✎▄···█·····▄█ beats 4/5medium · avg 37%▇ 1.1%at its level
SimpleQA Verified51.7% ✎▁▁▃▂▃▃▆▆█▃▂▅ beats 56/78very hard · avg 8.0%▇ 1.1%at its level
LongSocialBench (full-context, 4-option MCQ over discussion threads)56.0% ✎▆▂·▄█·▂▂·▄▄▃ beats 16/16very hard · avg 36%▇ 1.0%blunt · at its level
WritingBench85.3% ✎▁·▁▂▁··▅█▂▂▁ beats 15/20medium · avg 55%▇ 1.0%typical
MirrorCode (Epoch)31.1% ✎█·▄▄·▄·▄·▄·█ beats 4/8very hard · avg 1.5%▇ 0.5%sharp · noisy
Vectara hallucination leaderboard (HHEM-2.3, factual consistency rate)88.0% ✎▁▂▁▂▅█▂▃▄▃▁▁ beats 24/98very easy · avg 90%▇ 0.0%blunt

$ where to run it

Through an API

api · $10.00/M · $5 in / $25 out per 1M tokens · 1M context · docs.anthropic.com ↗ · price sourceStandard base token rate from models.dev. Provider-specific tiers, long-context surcharges, caching and promotions may differ.

$ how the score was worked out · Epoch AI — internal evaluatio… 46%, MathArena ArXivMath / BrokenA… 21%, LMArena leaderboard dataset 11% and 12 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Epoch AI — internal evaluations11▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 46%CC BY 4.0
MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets8▇▇▇▇▇▇ 21%CC BY-SA 4.0
LMArena leaderboard dataset5▇▇▇ 11%CC BY 4.0
meituan-longcat/LongCat-2.0 model card5▇ 4%mit
Anthropic system cards and model announcements (lab-reported scores) · lab-reported3▇ 4%Factual vendor-reported score (not licensed content)
Agents' Last Exam — authors' own fixed-harness model comparison1▇ 3%CC BY 4.0
τ²/τ³-bench leaderboard: Sierra's own evaluation runs1▇ 2%MIT
EQ-Bench 3 canonical leaderboard results1▇ 2%MIT
WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation (arXiv:2605.10912v1)1▇ 2%CC BY 4.0
The Token Games: Evaluating Language Model Reasoning with Puzzle Duels — authors' own tournament1▇ 2%CC BY-SA 4.0
SWE Atlas: Benchmarking Coding Agents Beyond Issue Resolution (arXiv:2605.08366v1)1▇ 1%CC BY 4.0
LongSocialBench: Do Long-Context LLMs Understand Online Discussion Threads? (arXiv:2610.04118v1)1▇ 1%CC BY 4.0
MathConstraint: Automated Generation of Verified Combinatorial Reasoning Instances for LLMs — authors' own model runs1▇ 1%CC BY 4.0
TerminalWorld: Benchmarking Agents on Real-World Terminal Tasks — authors' own Terminus-2 model comparison1▇ 1%CC BY 4.0
Vectara hallucination leaderboard (vectara/hallucination-leaderboard repository)1▇ 0%Apache-2.0
prior · pull toward the middle▇ 0%
weighted average= 75.0

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json