whatmodel.sh / GPT-5.2
GPT-5.2
↗ share
+ contribute
GPT-5.2 is a closed-weights language model from OpenAI, released December 2025.
$ how it compares
The LLMs ranked either side of GPT-5.2, out of 828 with a score, then more from OpenAI.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 52 | 74±1 | api $0.24/M +local | |||
| 53 | 74±1 | api $3.38/M | |||
| 54 | 74±1 | api $4.81/M | |||
| 55 | 74±1 | api $0.23/M +local | |||
| 56 | 74±1 | api $1.50/M | |||
| more from OpenAI | |||||
| 1 | 87±1 | api $20.00/M | |||
| 3 | 85±1 | api $4.00/M | |||
| 7 | 83±1 | api $4.00/M | |||
$ what it's good at
agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #58 of 300 · 23% of its score · 14 tests
Beats Gemini 3.1 Pro (Preview) here, though they rank higher overall. Trails MiniMax-M3, GLM-5.1, Claude Opus 4.5 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| SWE-bench Verified | 73.8% ✎ | ▁··▁·▁▂▁▄█▄▁ beats 14/29 | 4.4% |
| MCP-Atlas (public set) +1 | 68.0% ✎ | ▄······▄▄▄▄█ beats 6/6 | 3.2% |
| Terminal-Bench 2.0 with Terminus 2 agent (benchmark authors' runs) | 54.0% ✎ | ▃··▃·▃▃██▅▃▅ beats 13/14 | 2.7% |
| ContractBench success rate (33 observation-contract tool tasks) | 74.7% ✎ | ▆··▆▄▂▄▂▆▆█▄ beats 22/23 | 1.9% |
| τ³-bench banking_knowledge (v1.0.1 grading) | 32.2% ✎ | ▃▃▂▃·▆▃▃█▅▅▂ beats 13/25 | 1.8% |
| τ²-bench aggregate | 87.1% ✎ | ▄····█▄▄···▄ beats 4/5 | 1.5% |
| Vibe Code Bench (test split, 50 web apps) | 53.5% ✎ | ▃··▃·▃██▃▃▃█ beats 13/14 | 1.4% |
| Thinkingbox-bench pass@1 (507 stateful business-workflow agent tasks, N=20) | 46.3% ✎ | ▅··▃·▃·█▃▅██ beats 8/15 | 1.2% |
6 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| BFCL V4 (December 2025 archive) | 55.9% ✎ | ▁▁▁▂██▅▅▆▂▂▂ beats 66/77 | 1.1% |
| τ³-bench airline (tau2-bench ≥ v1.0.1) | 83.0% ✎ | ▃······▃·▃█▃ beats 5/6 | 1.1% |
| τ³-bench retail (tau2-bench ≥ v1.0.1) | 81.6% ✎ | ▄▄·█··▄·▄··▄ beats 5/6 | 1.0% |
| τ³-bench telecom (tau2-bench ≥ v1.0.1) | 89.7% ✎ | █·▄█▄······▄ beats 2/6 | 0.8% |
| τ²-bench Telecom lab | 98.7% ✎ | ▃·▅▅▃▃··█▃▃▅ beats 13/13 | 0.7% |
| τ²-Bench-Verified (GPT-5.1 user) | 80.3% ✎ | ▂··▄···▂▄▄█▄ beats 11/13 | 0.4% |
coding▁▁▁▃▆██▇▆▄▃▁ #79 of 458 · 10% of its score · 3 tests
Trails Llama 3.1 Nemotron Ultra 253B v1, GLM-4.7, Gemini 3.5 Flash-Lite here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena WebDev (Code Arena) | 1415.5 ✎ | ▁▂▄▃▅█▄▇▆▄▁▁ beats 49/119 | 4.4% |
| SWE-bench Verified | 73.8% ✎ | ▁··▁·▁▂▁▄█▄▁ beats 14/29 | 4.4% |
| Vibe Code Bench (test split, 50 web apps) | 53.5% ✎ | ▃··▃·▃██▃▃▃█ beats 13/14 | 1.4% |
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #70 of 393 * · 2.5% of its score · 1 test
Trails Gemma 4 26B-A4B, Nemotron Cascade 2 30B-A3B, Gemma 4 31B here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| LMArena (text) | 1437.3 ✎ | ▁▁▁▂▃▃▃▆▆▇█▃ beats 294/379 | 2.5% |
math▁▂▃▅▆▅▄█▄▁▁▁ #31 of 398 · 31% of its score · 9 tests
Beats DeepSeek V4.1 Flash, DeepSeek V4 Pro (0813), Claude Opus 4.7 here, though they rank higher overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| FrontierMath tiers 1–3 v2 | 67.4% ✎ | ▂··▁▁▃▄▄█▅▃▃ beats 56/82 | 12% |
| FrontierMath tier 4 v2 | 31.7% ✎ | ▁▂▁▂█▅▂▂▁▁▁▁ beats 36/63 | 8.6% |
| MathArena ArXivMath February 2026 (32 problems) | 37.5% ✎ | ▁▁▁▁█▇▄▃▁▃·▃ beats 10/24 | 3.2% |
| MathArena ArXivMath January 2026 (23 problems) | 67.9% ✎ | ▂··▄▂▄█▆▆▄▄█ beats 17/23 | 2.1% |
| MathArena ArXivMath December 2025 (17 problems) | 52.2% ✎ | ▃·▃▃█▁·▄·▁▁▁ beats 15/18 | 1.5% |
| MathArena BrokenArXiv February 2026 (31 problems) | 25.8% ✎ | ▃▂▂▃█▃▃·▃··▂ beats 13/16 | 1.2% |
| MATH-Vision | 83.0% ✎ | █·····▄▄·▄·▄ beats 2/5 | 0.9% |
| OTIS mock AIME 2024–2025 | 96.1% ✎ | ▃▃▄▃▃▃▇▇█▃▂▅ beats 166/193 | 0.6% |
1 more test
| test | result | vs the others in its run | counts |
|---|---|---|---|
| FormalProofBench (200 graduate-level Lean 4 problems, agentic) | 13.5% ✎ | ▃▅·▃··▅▃█··▃ beats 5/10 | 0.6% |
vision & documents▁▁▃▂▁▃▄▂▆▇█▄ #44 of 147 · 4.9% of its score · 5 tests
Beats MiMo-V2.6-Pro, MiMo-V2.6-Flash (309B-A15B), DeepSeek V4 Flash Vision (Exp) here, though they rank higher overall. Trails Qwen3.6 Flash, Gemini 3.5 Flash-Lite, Kimi K2.5 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena vision (style controlled) | 1242.8 ✎ | ▁▁▂▂▂▂▄▅▅▆██ beats 95/145 | 1.7% |
| CharXiv (reasoning questions) lab | 82.1% ✎ | ▄··▂█··▂···▄ beats 9/9 | 1.2% |
| MATH-Vision | 83.0% ✎ | █·····▄▄·▄·▄ beats 2/5 | 0.9% |
| Arena document (style controlled) | 1423.2 ✎ | ▁▁▃▃▄▃▇█▅▇▄▅ beats 3/37 | 0.8% |
| Diagram-MMU diagram question answering (DQA accuracy, scientific TikZ diagrams) | 81.7% ✎ | ▄·····▄▄·█·█ beats 2/6 | 0.4% |
web search▂▁▂▆▄█▃▃▁▁·▁ #51 of 80 * · 1.0% of its score · 1 test
Trails GPT-4o mini (2024-07-18), Mistral Small 3.1 24B (2503), Llama 4 Scout (109B-A17B) here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena search systems (style controlled) | 1161.5 ✎ | ▁·▁▁▂▃▂█▅▂▁▁ beats 7/30 | 1.0% |
other tests19 not in a task · 34% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| EBR-bench (Epoch) | 23.0% ✎ | ▄▂·▆█▂▆▄▆▆·▄ beats 11/23 | 4.0% |
| Furniture Assembly (Epoch) | 38.3% ✎ | █▆▆▆▆▂▅▂▂▂·▅ beats 15/30 | 3.8% |
| KMMLU-HARD (Daekeun Kim, zero-shot) | 74.6% ✎ | █···▁▁▁▂▃·▆▂ beats 18/23 | 3.3% |
| ARC-AGI-2 public evaluation set (ARC Prize model_baseline, pass@2) | 27.6% ✎ | █··▂▅▁▃▃▃·▁▃ beats 17/24 | 3.0% |
| Mystery Game Puzzles (Epoch) | 23.0% ✎ | █··▂▃▇▄█▂▃▁▁ beats 41/74 | 2.8% |
| GPQA Diamond | 91.4% ✎ | ▁▁▁▁▂▄▆▄▅▇█▅ beats 184/208 | 2.2% |
| KINA (Knowledge Index of Noah's Ark) accuracy, 899 ten-option items | 39.5% ✎ | ▁▁▂▁▃▄█▆▄▅▂▃ beats 33/39 | 1.9% |
| Chess Puzzles (Epoch) | 49.0% ✎ | █▁▁▁▁▂▁▄▂▂▃▁ beats 127/135 | 1.9% |
11 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Medmarks-V weighted mean win rate (61 models, 71 configurations) | 62.4% ✎ | ▂▃▅▂▆▃█▅█▅▃▆ beats 32/34 | 1.6% |
| EQ-Bench 3 (emotional intelligence, judge Elo) | 1314.3 ✎ | ▁·▂▁▄▅▅▃█▄▁▁ beats 53/62 | 1.5% |
| CLIcK Korean (Daekeun Kim) | 90.9% ✎ | ▆▄▄▄█▄▂·▄█·▄ beats 18/23 | 1.4% |
| ARC-AGI-1 public evaluation set (ARC Prize model_baseline, pass@2) | 95.0% ✎ | ▁·▇▃▁·█▇▁·▇▃ beats 22/27 | 1.3% |
| RPC-Bench overall, text input (Z.ai) | 35.2% ✎ | ▄··▄▄·▄▄█·▄▄ beats 7/8 | 1.2% |
| HAE-RAE 1.0 (Daekeun Kim) | 91.8% ✎ | ▄▄▄▂▂█▂▄▂█▂▄ beats 16/22 | 1.0% |
| SimpleQA Verified | 37.1% ✎ | ▁▁▃▂▃▃▆▆█▃▂▅ beats 32/78 | 1.0% |
| Icelandic LLM Leaderboard average (Miðeind, Sept 2026 suite) | 47.0% ✎ | ▁▁▃▂▂▄▁▃▄▄▄█ beats 18/38 | 0.9% |
| HLE-Verified full set, text-only (Qwen Team runs) | 43.3% ✎ | █·█·····█··█ beats 2/3 | 0.8% |
| FinSheet-Bench accuracy (501 questions, 24 spreadsheets) | 80.4% ✎ | █···██·····█ beats 2/3 | 0.6% |
| Vectara hallucination leaderboard (HHEM-2.3, factual consistency rate) | 89.2% ✎ | ▁▂▁▂▅█▂▃▄▃▁▁ beats 35/98 | 0.0% |
$ where to run it
Through an API
api · $4.81/M · $1.75 in / $14 out per 1M tokens · 400k context · platform.openai.com ↗ · price sourceStandard base token rate from models.dev. Provider-specific tiers, long-context surcharges, caching and promotions may differ.
$ how the score was worked out · Epoch AI — internal evaluatio… 41%, LMArena leaderboard dataset 10%, MathArena ArXivMath / BrokenA… 8% and 23 more
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json