whatmodel.sh / GPT-6.1 Sol
GPT-6.1 Sol
↗ share
+ contribute
GPT-6.1 Sol is a closed-weights language model from OpenAI, released September 2026. Licence: proprietary.
Catalogue identity notes
Official API model gpt-6.1-sol, distinct from GPT-6 Sol. Arena evaluation uses max reasoning.
Model information sources
$ how it compares
The LLMs ranked either side of GPT-6.1 Sol, out of 828 with a score, then more from OpenAI.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 1 | 87±1 | api $20.00/M | |||
| 2 | 87±1 | api $8.00/M | |||
| 3 | 85±1 | api $4.00/M | |||
| 4 | 85±1 | api $20.00/M | |||
| 5 | 84±1 | api $4.00/M | |||
| more from OpenAI | |||||
| 7 | 83±1 | api $4.00/M | |||
| 8 | 82±1 | api $67.50/M | |||
| 10 | 82±1 | api $8.00/M | |||
$ what it's good at
agent tasks▁▁▃▆█▆▅▅▅▄▃▃ #4 of 300 * · 18% of its score · 2 tests
Beats GPT-6 Astra here, though they rank higher overall. Trails Claude Sonnet 5.5, Claude Fable 5.1 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena Agent (October 2026 aggregate IPS) | 0.1123 IPS ✎ | ▁▁▁▄▂▃▇█▂▂▃▃ beats 45/49 | 10% |
| Terminal-Bench 4.0 | 58.2% ✎ | █▅▅▅▅·▅▃▃▅▅▅ beats 18/20 | 7.7% |
coding▁▁▁▃▆██▇▆▄▃▃ #4 of 458 * · 11% of its score · 2 tests
Trails Claude Sonnet 5.5 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena WebDev (Code Arena) | 1757.8 ✎ | ▁▂▄▃▅█▄▇▆▄▁▃ beats 116/119 | 9.0% |
| Luau Leetcode fully solved (Torpedo Software) | 87.0% ✎ | ▁▁▁▁·▁▂▃▅▃█▇ beats 47/49 | 1.8% |
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #17 of 393 * · 5.0% of its score · 1 test
Beats GPT-6 Astra here, though they rank higher overall. Trails Gemini 3.6 Flash, Claude Opus 4.6, Muse Spark 1.1 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| LMArena (text) | 1483.2 ✎ | ▁▁▁▂▃▃▃▆▆▇█▃ beats 362/379 | 5.0% |
math▁▂▃▅▆▅▄█▄▁▁▃ #2 of 398 · 18% of its score · 3 tests
Beats Claude Opus 5.5 here, though they rank higher overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| FrontierMath tier 4 v2 | 100.0% ✎ | ▁▂▁▂█▅▂▂▁▁▁▃ beats 63/63 | 11% |
| FrontierMath tiers 1–3 v2 | 93.7% ✎ | ▂··▁▁▃▄▄█▅▃▃ beats 81/82 | 6.9% |
| OTIS mock AIME 2024–2025 | 100.0% ✎ | ▃▃▄▃▃▃▇▇█▃▂▅ beats 187/193 | 0.1% |
vision & documents▁▁▃▂▁▃▄▂▆▇█▄ #13 of 147 * · 3.5% of its score · 1 test
Trails Claude Opus 4.7, Muse Spark 1.2, Qwen3.8-Flash-Next here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena vision (style controlled) | 1290.6 ✎ | ▁▁▂▂▂▂▄▅▅▆██ beats 138/145 | 3.5% |
other tests10 not in a task · 45% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| EBR-bench (Epoch) | 54.3% ✎ | ▄▂·▆█▂▆▄▆▆·▄ beats 20/23 | 15% |
| Mystery Game Puzzles (Epoch) | 80.0% ✎ | █··▂▃▇▄█▂▃▁▃ beats 73/74 | 9.3% |
| Furniture Assembly (Epoch) | 80.0% ✎ | █▆▆▆▆▂▅▂▂▂·▅ beats 28/30 | 8.4% |
| Chess Puzzles (Epoch) | 61.0% ✎ | █▁▁▁▁▂▁▄▂▂▁▃ beats 132/135 | 4.9% |
| SimpleQA Verified | 73.9% ✎ | ▁▁▃▂▃▃▆▆█▃▂▅ beats 77/78 | 1.7% |
| Icelandic LLM Leaderboard average (Miðeind, Sept 2026 suite) | 68.2% ✎ | ▁▁▃▂▂▄▁▃▄▄▄█ beats 34/38 | 1.6% |
| HealthBench Hard lab | 33.4% ✎ | ▂··▂····▂▄·█ beats 5/8 | 1.3% |
| GPQA Diamond | 95.4% ✎ | ▁▁▁▁▂▄▆▄▅▇█▅ beats 205/208 | 1.2% |
2 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| HealthBench lab | 56.7% ✎ | ▃·▃·····█▃▃▅ beats 5/8 | 1.1% |
| RobloxQA v2.0 multiple choice (Torpedo Software) | 98.6% ✎ | ▁▁▃▁█▄▃▃▆▂▂▃ beats 48/49 | 0.7% |
$ where to run it
Through an API
api · $4.00/M · $2 in / $10 out per 1M tokens · 1.1M context · developers.openai.com ↗ · price sourceObserved 2026-10-06. USD per million tokens, Standard, prompts up to 272K input tokens; longer prompts 2x input and 1.5x output. Fast/regional premiums excluded.
$ how the score was worked out · Epoch AI — internal evaluatio… 58%, LMArena leaderboard dataset 28%, Terminal-Bench 4.0 official l… 8% and 3 more
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
| source | results | share of the score |
|---|---|---|
| 9 | 58% | |
| 4 | 28% | |
| 1 | 8% | |
| 2 | 2% | |
| 2 | 2% | |
| 1 | 2% | |
| prior · pull toward the middle | 0% | |
| weighted average | = 85.3 |
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json