Best AI models for agents
A leaderboard of the best AI models for agents. Claude Opus 5.5 is #1 right now, followed by Claude Sonnet 5.5 and Claude Fable 5.1. Models are ranked on agent tests like SWE-bench and Terminal-Bench, where they use tools, write code and work in a terminal. Filter by your computer or budget to find the best one you can use.
358 models · scores combine 76 benchmarks · updated how it works · find a leaderboard · benchmark your machine
Scores use reviewed agent tasks evaluations only. Compare scores within this task. Models without task measurements are excluded.
Filter by your hardware and budget · reset
+ more
$ terminal
↗ share
detecting your OS…
Score vs API price
x
show
● open weights ◆ API only ─┘ best score for the price · x: USD per 1M tokens, 3 input : 1 output (log)
| # | model | task score↓ | where↓ | speed↓ | sources |
|---|
| # | model | task score↓ | where↓ | speed↓ | sources |
|---|---|---|---|---|---|
| 1 |  Claude Opus 5.5 | 88±1 | api $8.00/M |     | |
| 2 | Claude Sonnet 5.5 | 86±1 | api $4.00/M | | |
| 3 | Claude Fable 5.1 | 85±1 | api $20.00/M | | |
| 4 |  GPT-6.1 Sol | 85±1* | api $4.00/M | | |
| 5 | GPT-6 Astra | 84±1 | api $20.00/M |  | |
| 6 | Claude Opus 5 | 83±1 | api $10.00/M | +3 | |
| 7 | GPT-6 Sol | 83±1 | api $4.00/M | | |
| 8 | Claude Fable 5 | 82±1 | api $20.00/M | | |
| 9 |  Gemini 4 Argon (limited preview) | 81±2* | limited preview |  | |
| 10 | Claude Mythos Preview (limited preview) | 81±2† | limited preview | | |
| 11 | GPT-5.6 Sol | 80±1 | api $8.00/M | +4 | |
| 12 |  DeepSeek V4.1 Flash | 79±1 | api $0.26/M +local |  | |
| 13 | Claude Haiku 5.5 | 79±1† | api $0.20/M | | |
| 14 |  GLM-5.3 | 79±1* | api $2.15/M +local | | |
| 15 | GPT-5.5 Pro | 79±3*† | api $67.50/M | | |
| 16 | GPT-5.4 Pro | 79±3*† | api $67.50/M | | |
| 17 |  MiMo-V2.6-Pro | 78±2 | api $0.54/M +local | | |
| 18 |  Qwen3.8 Max (2.4T-A95B) | 77±2 | api $3.00/M +local | | |
| 19 | Claude Opus 4.8 | 77±1 | api $10.00/M | +3 | |
| 20 |  Grok 4.7 | 77±2* | api $3.00/M | | |
| 21 |  Hy4 preview (770B-A49B) | 77±2 | api $1.25/M +local | | |
| 22 | Qwen3.8 Max (0902) | 76±2* | api $3.00/M | | |
| 23 |  Kimi K3 | 76±1 | api $6.00/M +local | | |
| 24 | GLM-5.3-Flash | 76±1 | api $0.24/M +local | | |
| 25 | GPT-5.5 | 76±1 | api $11.25/M | +6 | |
| 26 | GPT-5.6 Terra | 76±1 | api $4.50/M | | |
| 27 | Gemini 3.8 Flash | 75±1 | api $1.50/M |  +1 | |
| 28 | MiMo-V2.6-Flash (309B-A15B) | 75±2 | api $0.17/M +local | | |
| 29 |  Muse Spark 1.3 | 75±1 | api $2.00/M | | |
| 30 | Grok 4.6 | 74±1 | api $3.00/M | | |
| 31 | DeepSeek V4 Pro (0813) | 74±1 | api $1.63/M +local | | |
| 32 | DeepSeek V4 Flash Vision (Exp) | 74±3† | local | | |
| 33 | GPT-5.4 | 74±1 | api $5.63/M | +4 | |
| 34 | Claude Opus 4.7 | 74±2 | api $10.00/M |  +1 | |
| 35 | GPT-6 Luna | 74±1 | api $0.20/M | | |
| 36 | Claude Sonnet 5 | 74±1 | api $4.00/M | | |
| 37 | GPT-5.6 Luna | 74±1 | api $0.45/M | | |
| 38 | Grok 4.5 | 73±1 | api $3.00/M | | |
| 39 |  Step 5 Preview | 73±2* | comparison only | | |
| 40 | GLM-5.2 | 73±1 | api $2.15/M +local | +3 | |
| 41 | Qwen3.8-Flash-Next | 72±2 | local |  | |
| 42 | Gemini 3.7 Flash | 72±1 | api $1.50/M | | |
| 43 | Qwen3.8-Omni-Flash | 72±3† | api $0.23/M | | |
| 44 | DeepSeek V4 Flash (0731) | 71±2 | api $0.11/M +local | | |
| 45 | Claude Sonnet 4.6 | 71±1 | api $6.00/M | +1 | |
| 46 | Qwen3.8 27B | 71±1 | api $1.60/M +local | | |
| 47 | GPT-5.3-Codex | 71±2 | api $4.81/M | | |
| 48 | Claude Opus 4.6 | 70±1 | api $10.00/M | +6 | |
| 49 | Hunyuan Hy3 (295B-A21B) | 70±1 | api $0.23/M +local | | |
| 50 | Gemini 3.5 Flash | 70±3 | api $3.38/M | | |
| 51 | Muse Spark 1.2 | 69±2* | api $2.00/M | | |
| 52 | Muse Spark 1.1 | 69±2* | api $2.00/M | | |
| 53 | Kimi K2.6 | 68±1 | api $1.71/M +local | +2 | |
| 54 | Qwen3.7 Max | 68±2 | api $3.75/M | | |
| 55 | Claude Opus 4.5 | 68±1 | api $10.00/M | +4 | |
| 56 | GLM-5.1 | 67±1 | api $2.15/M +local | +5 | |
| 57 | DeepSeek V4 Pro (Preview, Apr 2026) | 67±1 | local | | |
| 58 |  MiniMax-M3 | 67±2 | api $0.48/M +local | | |
| 59 | GPT-5.2 | 67±1 | api $4.81/M | +6 | |
| 60 | Gemini 3.1 Pro (Preview) | 66±1 | api $4.50/M | +4 | |
| 61 | Qwen3.7 Plus | 66±2 | api $0.70/M | | |
| 62 | GPT-5.4 mini | 66±2 | api $1.69/M | | |
| 63 | GPT-5.2-Codex | 66±2 | comparison only | | |
| 64 |  Mistral Large 4 (public preview) | 66±2* | api $2.06/M | | |
| 65 |  Solar Open 2 (250B-A15B) | 65±2† | local | | |
| 66 | MiMo-V2.5 (310B-A15B) | 65±2 | api $0.21/M +local | | |
| 67 | DeepSeek V4 Flash (Preview, Apr 2026) | 65±1 | local | | |
| 68 | Qwen3.5 397B-A17B | 65±1 | api $1.09/M +local | | |
| 69 |  Ornith 1.5 35B-A3B | 65±2† | local | | |
| 70 | Qwen3.6 Max Preview | 65±5* | api $2.92/M | | |
| 71 | MiMo-V2-Pro | 65±2† | comparison only | | |
| 72 | Muse Glimmer 30B | 65±2 | api $0.64/M +local | | |
| 73 | Gemini 3.6 Flash | 64±2 | api $1.50/M | | |
| 74 |  LongCat 2.0 (1.6T-A48B) | 64±6* | api $1.30/M +local | | |
| 75 | GLM-5 | 64±1 | api $1.55/M +local | +1 | |
| 76 | Qwen3.6 27B | 64±1 | api $1.20/M +local | | |
| 77 | GPT-5 Pro | 64±5*† | api $41.25/M | | |
| 78 | MiMo-V2.5-Pro (1T-A42B) | 64±1 | api $0.65/M +local | | |
| 79 | Gemini 3 Pro (Preview) | 64±1 | comparison only | +2 | |
| 80 |  Inkling Small (266B-A12B) | 64±2 | api $0.64/M +local | | |
| 81 | MiniMax-M2.7 | 64±2 | api $0.53/M +local | | |
| 82 | Gemini 3 Flash (Preview) | 64±2 | api $1.13/M | | |
| 83 | Inkling (975B-A41B) | 63±2 | api $1.73/M +local | | |
| 84 | Step 3.5 Flash (196B-A11B) | 63±2† | api $0.15/M +local | | |
| 85 | GPT-5 | 63±2 | api $3.44/M | +2 | |
| 86 | Hy3 preview (295B-A21B) | 63±2† | local | | |
| 87 |  Nemotron 3 Ultra 550B-A55B | 63±2† | api $1.35/M +local | | |
| 88 |  KAT-Coder-V2.5-Dev (35B-A3B) | 62±2† | local | | |
| 89 | Qwen3.5 27B | 62±1 | api $0.84/M +local | | |
| 90 | Qwen3.5 122B-A10B | 62±2 | api $1.10/M +local | | |
| 91 | Qwen3-Max (2026-01-23) | 62±2† | comparison only | | |
| 92 | Kimi K2.5 | 62±1 | api $1.20/M +local | +2 | |
| 93 | Qwen3.6 35B-A3B | 61±1 | api $0.31/M +local | | |
| 94 | Claude Sonnet 4.5 | 61±1 | api $6.00/M | +3 | |
| 95 | GLM-4.7 | 61±1† | api $1.00/M +local | | |
| 96 | GPT-5.4 nano | 61±2 | api $0.46/M | | |
| 97 | GPT-5.1 | 61±2 | api $3.44/M | | |
| 98 | Ornith 1.0 35B (35B-A3B) | 60±1 | local | | |
| 99 |  Nova 2 Pro (Preview) | 60±8*† | api $3.78/M | | |
| 100 | Qwen3.5 35B-A3B | 60±1 | api $0.35/M +local | | |
| 101 | MiniMax-M2.1 | 59±2 | local | | |
| 102 |  K-EXAONE 2.0 (750B-A37B) | 59±4† | local | | |
| 103 |  SmolLM3 3B | 59±11*† | local | | |
| 104 | LongCat-Flash-Thinking (560B-A27B) | 59±3† | comparison only | | |
| 105 | DeepSeek V3.2 | 59±2 | api $0.29/M +local | | |
| 106 | MiniMax-M2.5 | 59±2 | api $0.53/M +local | | |
| 107 | MiMo-V2-Flash (309B-A15B) | 58±3* | local | | |
| 108 | LongCat-Flash-Chat (560B-A27B) | 58±2† | local | | |
| 109 | Mistral Medium 3.5 (128B) | 58±2 | api $3.00/M +local | | |
| 110 | MiniMax-M2 | 58±2 | api $0.53/M +local | | |
| 111 | Qwen3.5 Plus | 58±4* | api $0.90/M | | |
| 112 | Grok 4.20 (0309 reasoning) | 58±6* | api $1.56/M | | |
| 113 | Mistral Medium 3.1 (2508) | 57±6* | comparison only | | |
| 114 |  Gemma 4 31B | 57±1 | api $0.19/M +local | +4 | |
| 115 | Grok 4.3 | 57±3 | api $1.56/M | | |
| 116 | GLM-4.6 | 57±1 | api $1.00/M +local | | |
| 117 | Grok 4.1 Fast (Reasoning) | 57±2 | api $0.28/M | | |
| 118 |  Jamba 1.5 Large | 57±10*† | local | | |
| 119 |  Spark-X2.5 4B | 56±2† | local | | |
| 120 | Qwen3.6 Plus | 56±4* | api $1.13/M | | |
| 121 | Qwen3-Max (2025-09-23) | 56±3† | api $2.40/M | | |
| 122 | Kimi K2 Thinking | 56±2 | api $1.07/M +local | | |
| 123 | EXAONE 4.5 33B | 56±3*† | local | | |
| 124 | Kimi K2 Instruct (0711) | 56±1 | api $1.00/M +local | | |
| 125 | Solar Pro 4 | 56±2* | api $0.53/M | | |
| 126 | Claude Opus 4.1 | 56±2 | comparison only | | |
| 127 | MiMo-V2.6-Distill-Qwen-9B | 56±3† | local | | |
| 128 | Grok 4 Fast | 56±6* | comparison only | | |
| 129 | o3-pro | 56±5* | api $35.00/M | | |
| 130 | GPT-5 mini | 55±1 | api $0.69/M | +5 | |
| 131 | Claude Opus 4 | 55±2 | comparison only | | |
| 132 | K-EXAONE (236B-A23B) | 55±2 | local | | |
| 133 | DeepSeek V3.1 Terminus | 55±3† | local | | |
| 134 | Claude Haiku 4.5 | 55±2 | api $2.00/M | +1 | |
| 135 |  GigaChat 3.5 Ultra Reasoning (432B-A28B) | 55±3† | local | | |
| 136 | GLM-4.5 | 55±2 | api $1.00/M +local | | |
| 137 |  MiniCPM5 2B | 55±3† | local | | |
| 138 | Grok 4 (0709) | 54±3* | comparison only | | |
| 139 | Nemotron 3 Super 120B-A12B | 54±2† | api $0.28/M +local | | |
| 140 | GPT-4o (2024-05-13) | 54±11* | api $7.50/M | | |
| 141 | Gemini 3.1 Flash-Lite | 54±6* | api $0.56/M | | |
| 142 |  Granite 4.2 30B | 54±2† | api $0.28/M +local | | |
| 143 |  HyperCLOVA X SEED 32B Think | 54±2† | comparison only | | |
| 144 | Qwen3-Coder 480B-A35B Instruct | 53±2 | api $0.67/M +local | | |
| 145 | Claude Sonnet 4 | 53±1 | comparison only | | |
| 146 | o3 | 53±1 | api $3.50/M | +1 | |
| 147 | Gemini 2.5 Pro | 53±2 | api $3.44/M | +3 | |
| 148 | Nemotron-Labs-3 Puzzle 75B-A9B | 53±2† | local | | |
| 149 |  Seed-OSS 36B Instruct | 52±3† | local | | |
| 150 | GLM-4 (0520) | 52±11*† | comparison only | | |
| 151 | Mistral Small 4 (119B-A6.5B) | 52±3* | api $0.26/M +local | | |
| 152 | Gemini 2.5 Pro Preview (03-25) | 52±6* | comparison only | | |
| 153 |  Command A+ (05-2026) | 52±2 | api price unknown +local |  | |
| 154 | DeepSeek V3.2 Exp | 52±3* | local | | |
| 155 | GLM-4.5-Air | 51±2 | api $0.42/M +local | | |
| 156 | Jamba 1.5 Mini | 51±10*† | local | | |
| 157 | Qwen3.5 9B | 51±1 | api $0.11/M +local | +3 | |
| 158 | DeepSeek V3.1 | 51±1 | api $0.42/M +local | | |
| 159 |  Mellum2.1 12B-A2.5B Thinking | 50±3† | local | | |
| 160 | Qwen3 235B-A22B Thinking 2507 | 50±1 | api $0.97/M +local | | |
| 161 | gpt-oss-120b | 49±2 | api $0.26/M +local | +1 | |
| 162 | Qwen3-Next 80B-A3B Thinking | 49±2† | api $0.41/M +local | | |
| 163 | Command A Reasoning (08-2025) | 49±3 | local | | |
| 164 | Granite 4.1 30B | 49±5*† | local | | |
| 165 | o4-mini | 49±1 | api $1.93/M | | |
| 166 | Gemma 4 12B | 48±2 | local | | |
| 167 | Qwen3-VL 235B-A22B Thinking | 48±2† | local | | |
| 168 | Gemma 4 26B-A4B | 48±1 | api $0.14/M +local | +1 | |
| 169 | GPT-4.1 | 48±1 | api $3.50/M | +4 | |
| 170 | Qwen3-VL 32B Thinking | 48±1 | api $0.28/M +local | | |
| 171 | Granite 4.2 8B | 48±2† | api $0.11/M +local | | |
| 172 | Nova Premier | 47±3*† | api $5.00/M |  | |
| 173 | o1-mini | 47±3 | comparison only | | |
| 174 | Qwen3.5 4B | 47±1 | local | +1 | |
| 175 | Qwen3 235B-A22B Instruct 2507 | 47±1 | api $0.20/M +local | +1 | |
| 176 | GPT-4.5 Preview | 47±1* | comparison only | | |
| 177 | Qwen3-VL 32B Instruct | 46±3*† | api $0.28/M +local | | |
| 178 | Gemini 1.5 Flash (002) | 46±5* | comparison only | | |
| 179 | Gemini 2.5 Flash Preview (09-2025) | 46±4 | comparison only | | |
| 180 | Solar Open 100B (102B-A12B) | 46±3† | local | | |
| 181 | GPT-4o (2024-11-20) | 46±1 | api $4.38/M | +1 | |
| 182 |  LFM2.5 2.6B | 46±2 | local | | |
| 183 | GigaChat 3.5 Ultra Instruct (432B-A28B) | 46±3† | local | | |
| 184 | GPT-4.1 mini | 46±1 | api $0.70/M | +1 | |
| 185 | Qwen3 4B Thinking 2507 | 46±2† | local | | |
| 186 | Qwen3-VL 235B-A22B Instruct | 46±6*† | local | | |
| 187 | GPT-4 Turbo (2024-04-09) | 46±1* | api $15.00/M | | |
| 188 | Nemotron-Cascade-14B-Thinking | 46±4*† | local | | |
| 189 | Qwen3 14B | 46±1 | api $0.61/M +local | | |
| 190 |  DiffusionGemma 26B-A4B | 45±5*† | comparison only | | |
| 191 | Qwen3 Coder 30B-A3B Instruct | 45±2 | api $0.12/M +local | | |
| 192 | GPT-5 nano | 45±2 | api $0.14/M | | |
| 193 | DeepSeek V3 0324 | 45±1 | local | | |
| 194 | Qwen3 30B-A3B Thinking 2507 | 45±1 | api $0.75/M +local | | |
| 195 | Nemotron 3 Nano 30B-A3B | 45±3*† | api $0.087/M +local | | |
| 196 | Granite 4.2 3B | 45±2 | api $0.052/M +local | | |
| 197 | Mellum2 12B-A2.5B Instruct | 45±4*† | local | | |
| 198 | Nemotron Nano 9B v2 | 45±4*† | api $0.10/M +local | | |
| 199 | Claude 3.7 Sonnet | 45±1 | comparison only | +1 | |
| 200 | Qwen3-VL 4B Thinking | 45±3*† | local | | |
| 201 | Gemini 2.5 Flash | 45±1 | api $0.85/M | | |
| 202 | EXAONE 4.0 32B | 45±1 | local | | |
| 203 | Qwen3-VL 30B-A3B Thinking | 44±2*† | api $0.75/M +local | | |
| 204 | Qwen3-VL 30B-A3B Instruct | 44±3*† | api $0.35/M +local | | |
| 205 | Qwen3 32B | 44±1 | api $0.13/M +local | +1 | |
| 206 | Command A (03-2025) | 44±1 | api $4.38/M +local | | |
| 207 |  Falcon-H1R 7B | 44±2*† | local | | |
| 208 | Qwen3 235B-A22B (Apr 2025, hybrid) | 44±1 | api $1.23/M +local | +1 | |
| 209 | Qwen3 8B | 44±1 | api $0.31/M +local | +1 | |
| 210 | GPT-4o (2024-08-06) | 44±2 | api $4.38/M | | |
| 211 | Gemini 2.5 Flash-Lite | 43±3* | api $0.17/M | | |
| 212 | Qwen3-Next 80B-A3B Instruct | 43±2† | api $0.34/M +local | | |
| 213 | Qwen3-VL 8B Instruct | 43±3* | api $0.31/M +local | | |
| 214 | DeepSeek R1 0528 | 43±1 | api $0.91/M +local | | |
| 215 | Nemotron-Cascade-8B | 43±4*† | local | | |
| 216 | Grok 3 Beta | 43±1* | comparison only | | |
| 217 |  Apriel 1.6 15B Thinker | 43±4† | local | | |
| 218 | Spark-X2.5 1.7B | 43±2† | local | | |
| 219 | Qwen2.5 72B Instruct | 43±1 | api $0.37/M +local | | |
| 220 | Qwen2.5 32B Instruct | 43±1* | local | | |
| 221 | Gemini 2.5 Pro Experimental (03-25) | 43±1* | comparison only | | |
| 222 | Qwen3-VL 4B Instruct | 42±3*† | local | | |
| 223 | Qwen3 30B-A3B Instruct 2507 | 42±1 | api $0.15/M +local | | |
| 224 | Gemini 2.0 Flash (001) | 42±1 | comparison only | | |
| 225 | Mistral Medium 3 (2505) | 42±3* | comparison only | | |
| 226 | Qwen3-VL 8B Thinking | 42±3*† | api $0.66/M +local | | |
| 227 | gpt-oss-20b | 42±2 | api $0.13/M +local | | |
| 228 | Gemini 2.5 Flash Preview (05-20) | 42±3* | comparison only | | |
| 229 | Llama 3.1 405B Instruct | 42±2 | api $2.40/M +local | | |
| 230 | Ministral 3 14B | 42±3 | api $0.20/M +local | | |
| 231 | Qwen3 30B-A3B (Apr 2025, hybrid) | 42±1 | api $0.35/M +local | | |
| 232 | Magistral Medium 1.0 (2506) | 42±6* | comparison only | | |
| 233 | Granite 4.1 8B | 41±2*† | api $0.11/M +local | | |
| 234 | GPT-4o mini (2024-07-18) | 41±1 | api $0.26/M | | |
| 235 | Granite 4.1 3B | 41±5*† | local | | |
| 236 | Claude 3.5 Sonnet (2024-10-22) | 41±1 | comparison only | | |
| 237 | Mistral Large 3 (675B-A41B) | 41±8* | api $0.75/M +local | | |
| 238 | Gemini 2.5 Pro Preview (05-06) | 41±1* | comparison only | | |
| 239 | Ministral 3 8B | 41±4* | api $0.15/M +local | | |
| 240 | Mistral Small 3.2 24B | 41±3* | api $0.11/M +local | | |
| 241 | Nova Pro | 41±1 | api $1.40/M | | |
| 242 | LFM2.5 8B-A1B | 41±2 | local | | |
| 243 | Qwen3 4B | 41±1 | local | | |
| 244 | Qwen2.5 14B Instruct | 40±1* | local | | |
| 245 | LFM2.5 1.2B Thinking | 40±4*† | local | | |
| 246 | Gemini 2.0 Flash Thinking Experimental (01-21) | 40±1* | comparison only | | |
| 247 | DeepSeek V3 (Dec '24) | 40±1 | api $0.46/M +local | | |
| 248 | DeepSeek R1 (Jan '25) | 40±1 | api $4.00/M +local | | |
| 249 | Mistral Small 3.1 24B (2503) | 40±1 | local | | |
| 250 | Mistral Large 2 (2411) | 40±1 | local | | |
| 251 | Mistral Large 2 (2407) | 40±1* | local | | |
| 252 | QwQ-32B | 40±1* | local | | |
| 253 | Qwen3 4B Instruct 2507 | 40±1 | local | | |
| 254 | o1 (2024-12-17) | 40±1 | api $26.25/M | | |
| 255 | Gemini 2.0 Flash-Lite (001) | 40±1* | comparison only | | |
| 256 | Claude 3 Opus | 39±1* | comparison only | | |
| 257 | Llama 3.1 Nemotron Ultra 253B v1 | 39±1* | local | | |
| 258 |  Palmyra X4 (palmyra-x-004) | 39±1 | comparison only | | |
| 259 | Gemma 4 E4B | 39±1 | local | +3 | |
| 260 |  Phi-3.5-mini-instruct | 39±11*† | local | | |
| 261 | Qwen3-VL 2B Thinking | 39±3*† | local | | |
| 262 | Nova 2 Lite | 39±3* | api $0.94/M | | |
| 263 | Nova Lite | 39±1 | api $0.10/M | | |
| 264 | Qwen2.5 7B Instruct | 38±1 | api $0.30/M +local | | |
| 265 | Granite 4.0 1B | 38±3* | local | | |
| 266 | DeepSeek-Coder-V2 Instruct (0724) | 38±1* | local | | |
| 267 | Gemini 2.5 Flash-Lite Preview (06-17) | 38±6* | comparison only | | |
| 268 | Qwen3 1.7B | 38±1 | local | | |
| 269 | Qwen3-VL 2B Instruct | 38±3*† | local | | |
| 270 | Grok 3 Mini Beta | 38±1* | comparison only | | |
| 271 | Gemma 3 27B | 38±1 | api $0.10/M +local | | |
| 272 | Ministral 3 14B Reasoning 2512 | 38±5* | local | | |
| 273 | o3-mini | 37±1 | api $1.93/M | | |
| 274 | Llama 4 Maverick (402B-A17B) | 37±1 | api $0.42/M +local | | |
| 275 | GPT-4.1 nano | 37±1 | api $0.17/M | | |
| 276 | Claude 3.5 Haiku | 37±1 | comparison only | | |
| 277 | Llama 3.1 70B Instruct | 37±1 | api $0.72/M +local | | |
| 278 | Nemotron 3 Nano 4B | 37±2 | local | | |
| 279 | GPT-3.5 Turbo (0125) | 37±1* | api $0.75/M | | |
| 280 |  Sky-T1 32B Preview | 37±1* | local | | |
| 281 | Granite 4.0 H 1B | 37±3* | local | | |
| 282 | Llama 3.3 70B Instruct | 36±1 | api $0.72/M +local | | |
| 283 | Mistral Medium (2312) | 36±1* | comparison only | | |
| 284 | LFM2.5 1.2B Instruct | 36±4*† | local | | |
| 285 | Command R7B (12-2024) | 36±1 | local | | |
| 286 | Mellum2 12B-A2.5B Thinking | 36±3† | local | | |
| 287 | Gemma 3 12B | 36±1* | api $0.075/M +local | | |
| 288 | Llama 3 70B Instruct | 36±1* | local | | |
| 289 | Nova Micro | 36±1 | api $0.061/M | | |
| 290 | Ministral 8B (2410) | 36±1* | local | | |
| 291 | Qwen2.5 3B Instruct | 36±1* | local | | |
| 292 | Mistral Small Instruct 22B (2409) | 36±4* | local | | |
| 293 | Mistral NeMo Instruct (2407) | 35±1 | local | | |
| 294 | Granite 3.1 8B Instruct | 35±4* | local | | |
| 295 | MiniCPM3-4B | 35±1* | local | | |
| 296 | Granite 3.2 8B Instruct | 35±4* | local | | |
| 297 | Llama 3.1 8B Instruct | 35±1 | api $0.22/M +local | | |
| 298 | Command R Plus (04-2024) | 34±1* | local | | |
| 299 | DeepSeek R1 0528 Qwen3 8B | 34±5* | api $0.068/M +local | | |
| 300 | Qwen2.5 1.5B Instruct | 34±1* | local | | |
| 301 | Phi-4 14B | 34±1* | api $0.087/M +local | | |
| 302 | Command R Plus (08-2024) | 34±7*† | api $4.38/M +local | | |
| 303 | Qwen3 0.6B | 34±1* | local | | |
| 304 |  Hermes 2 Pro Llama 3 8B | 34±1* | local | | |
| 305 | Granite 4.0 H 350M | 34±5*† | local | | |
| 306 | Mistral Small (2402) | 34±1* | comparison only | | |
| 307 | EXAONE 4.0 1.2B | 33±3† | local | | |
| 308 | Falcon3 10B Instruct | 33±1* | local | | |
| 309 | Llama 4 Scout (109B-A17B) | 33±1 | api $0.15/M +local | | |
| 310 | Llama 3.2 3B Instruct | 33±1 | api $0.12/M +local | | |
| 311 |  ERNIE 4.5 21B-A3B | 33±9* | comparison only | | |
| 312 | Gemma 4 E2B | 32±2 | api $0.050/M +local | +2 | |
| 313 | Falcon3 7B Instruct | 32±1* | local | | |
| 314 | Qwen3.5 2B | 32±2 | local | | |
| 315 | Magistral Small 1.0 (2506) | 31±7* | local | | |
| 316 | Mixtral 8x7B Instruct v0.1 | 31±1* | local | | |
| 317 | Mixtral 8x22B Instruct v0.1 | 31±1* | local | | |
| 318 | Qwen2 7B Instruct | 31±1* | local | | |
| 319 |  Bielik 11B v2.3 Instruct | 30±1* | local | | |
| 320 | Command R (08-2024) | 30±8*† | api $0.26/M +local | | |
| 321 | Ministral 3 3B | 30±6* | api $0.10/M +local | | |
| 322 |  ChatGLM3-6B | 30±10*† | local | | |
| 323 | GLM-4 9B Chat | 30±1 | local | | |
| 324 | Gemma 3 4B | 30±1* | api $0.063/M +local | | |
| 325 |  DBRX Instruct | 30±1* | local | | |
| 326 | Granite 4.0 350M | 30±3* | local | | |
| 327 |  Olmo 3 7B Instruct | 29±4 | local | | |
| 328 | LFM2 8B-A1B | 28±4† | comparison only | | |
| 329 |  NexusRaven V2 13B | 28±1* | local | | |
| 330 | Qwen2.5 0.5B Instruct | 28±1* | local | | |
| 331 | Qwen3.5 0.8B | 27±5*† | local | | |
| 332 | Llama 3 8B Instruct | 26±1* | local | | |
| 333 | Falcon3 3B Instruct | 26±1* | local | | |
| 334 | Phi-4-mini 3.8B | 23±1 | api $0.13/M +local | | |
| 335 | Qwen2 1.5B Instruct | 23±2* | local | | |
| 336 | Llama 3.2 1B Instruct | 18±1 | api $0.020/M +local | | |
| 337 | DeepSeek-Coder-V2 Lite Instruct (16B-A2.4B) | 18±2* | local | | |
| 338 | QwQ-32B-Preview | 17±2* | local | | |
| 339 | Falcon3 1B Instruct | 17±2* | local | | |
| 340 | Gemma 3 1B | 13±2 | local | | |
| — | Devstral 2 (2512) | not yet calibrated | local | | |
| — | Devstral Small 2 24B | not yet calibrated | local | | |
| — | GLM-4.7-Flash | not scored yet | api $0.0000/M +local | ||
| — | Granite 4.0 H Micro 3B | not yet calibrated | local | | |
| — | Granite 4.0 H Small (32B-A9B) | not yet calibrated | api $0.11/M +local | | |
| — | Granite 4.0 H Tiny (7B-A1B) | not yet calibrated | local | | |
| — | Granite 4.0 Micro 3B | not yet calibrated | local | | |
| — |  K2 Horizon 7B | not scored yet | local | ||
| — |  Laguna M.1 | not yet calibrated | api price unknown +local | | |
| — | Laguna XS 2.1 (33B-A3B) | not yet calibrated | local | | |
| — | Laguna XS.2 | not yet calibrated | local | | |
| — |  Ling 3.0 Flash (124B-A5B) | not yet calibrated | api $0.090/M +local | | |
| — | Llama 3.3 Nemotron Super 49B v1 | not scored yet | local | ||
| — | MiniMax-M1 (80k) | not yet calibrated | api $0.96/M +local | | |
| — | Nemotron Cascade 2 30B-A3B | not scored yet | local | ||
| — | Qwen3-Coder-Next (80B-A3B) | not scored yet | api $0.60/M +local | ||
| — | Step 3.7 Flash (198B-A11B) | not scored yet | api $0.44/M +local | ||
| — |  Trinity-Large-Thinking | not scored yet | api $0.39/M +local |
+ 35 models with fewer than 3 results left off, since one or two tests say little about overall ability · show them
Includes 40 comparison-only models with no verified API or download · hide them
358 of 398 catalogue models listed here · sources and licences
Models outside this leaderboard (5 models)
No current run option verified: Dola Seed 2.0 Pro · MiniMax-M1 (40k) · Seed2.0 Lite · Ring-2.6-1T
Raw results, insufficient overlap for an overall score: o1-preview
* new or thinly tested: ranked on too few benchmark results · † only the maker’s own numbers so far · ~RAM is estimated; full context may need more memory