whatmodel.sh
· find the best AI models you can run879 models · scores combine 566 benchmarks · updated how it works · find a leaderboard · benchmark your machine
Filter by your hardware and budget
+ more
$ terminal
↗ share
detecting your OS…
Score vs API price
x
show
● open weights ◆ API only ─┘ best score for the price · x: USD per 1M tokens, 3 input : 1 output (log)
| # | model | score↓ | where↓ | RAM↓ | speed↓ | sources |
|---|---|---|---|---|---|---|
| 1 |  GPT-6 Astra | 86±1 | api $20.00/M |      +4 | ||
| 2 |  Claude Opus 5.5 | 85±1 | api $8.00/M |   +1 | ||
| 3 | GPT-6.1 Sol | 84±1 | api $4.00/M | | ||
| 4 | Claude Fable 5.1 | 83±1 | api $20.00/M | +1 | ||
| 5 |  Muse Wonder Full | 82±3† | Muse Code only |  | ||
| 6 | Claude Sonnet 5.5 | 82±1 | api $4.00/M | | ||
| 7 | Claude Opus 5 | 81±1 | api $10.00/M | +11 | ||
| 8 | GPT-6 Sol | 81±1 | api $4.00/M | +1 | ||
| 9 | GPT-5.5 Pro | 81±1 | api $67.50/M | | ||
| 10 | GPT-5.6 Sol | 80±1 | api $8.00/M | +14 | ||
| 11 |  Gemini 4 Argon | 80±1 | api $4.00/M |  | ||
| 12 | Claude Fable 5 | 80±1 | api $20.00/M | +5 | ||
| 13 | Claude Mythos Preview (limited preview) | 80±1† | limited preview | | ||
| 14 | GPT-5.4 Pro | 79±1 | api $67.50/M | | ||
| 15 | GPT-5.5 | 79±0 | api $11.25/M | +15 | ||
| 16 | Muse Wonder | 78±2 | api $8.00/M | | ||
| 17 |  Hy4 preview (770B-A49B) | 78±1 | api $1.25/M +local | ~248GB | | |
| 18 |  MiMo-V2.6-Pro | 78±1 | api $0.54/M +local | ~443GB | | |
| 19 | GPT-5.6 Terra | 77±1 | api $4.50/M | +5 | ||
| 20 |  Qwen3.8 Max (2.4T-A95B) | 77±1 | api $3.00/M +local | ~380GB |  +2 | |
| 21 | Claude Opus 4.8 | 77±0 | api $10.00/M | +11 | ||
| 22 | GPT-5.4 | 76±1 | api $5.63/M | +14 | ||
| 23 |  DeepSeek V4.1 Flash | 76±1 | api $0.26/M +local | ~512GB | ~12 tok/s | |
| 24 | Muse Spark 1.3 | 76±1 | api $2.00/M | | ||
| 25 | Claude Haiku 5.5 | 76±1 | api $0.20/M | | ||
| 26 | Gemini 3.8 Flash | 76±1 | api $1.50/M |  +5 | ||
| 27 |  Kimi K3 | 76±1 | api $6.00/M +local | ~884GB | +6 | |
| 28 | GPT-5.2 Pro | 76±1 | api $57.75/M | | ||
| 29 | MiMo-V2.6-Flash (309B-A15B) | 76±1 | api $0.17/M +local | ~136GB | | |
| 30 | GPT-6 Luna | 76±1 | api $0.20/M | | ||
| 31 | GPT-5.6 Luna | 76±1 | api $0.45/M | +4 | ||
| 32 |  Grok 4.6 | 75±1 | api $3.00/M | | ||
| 33 | DeepSeek V4 Pro (0813) | 75±1 | api $1.63/M +local | ~1010GB | +2 | |
| 34 | Gemini 3.7 Flash | 75±1 | api $1.50/M | +3 | ||
| 35 |  GLM-5.3 | 75±1 | api $2.15/M +local | ~239GB | | |
| 36 | Qwen3.8 Max (0902) | 75±1 | api $3.00/M | | ||
| 37 | DeepSeek V3.2 Speciale | 75±3† | comparison only | | ||
| 38 | DeepSeek V4 Flash Vision (Exp) | 74±2 | local | ~104GB | | |
| 39 | Gemini 3.1 Pro (Preview) | 74±1 | api $4.50/M | +23 | ||
| 40 | Qwen3.8-Flash-Next | 74±1 | local | ~59GB | ~27 tok/s | |
| 41 | Muse Spark | 74±2 | comparison only | | ||
| 42 | Qwen3.8-Omni-Flash | 74±1† | api $0.23/M | | ||
| 43 | Claude Opus 4.7 | 74±1 | api $10.00/M | +9 | ||
| 44 | Muse Spark 1.2 | 74±1 | api $2.00/M | | ||
| 45 | Muse Spark 1.1 | 74±1 | api $2.00/M | | ||
| 46 | Grok 4.5 | 74±1 | api $3.00/M | +1 | ||
| 47 |  Step 5 Preview | 74±1 | comparison only | | ||
| 48 | Claude Sonnet 5 | 74±1 | api $4.00/M | +5 | ||
| 49 | Grok 4.7 | 74±1 | api $3.00/M | | ||
| 50 | Claude Opus 4.6 | 74±1 | api $10.00/M | +21 | ||
| 51 | GPT-5.3-Codex | 73±1 | api $4.81/M | | ||
| 52 | Gemini 3.5 Flash | 73±1 | api $3.38/M | +3 | ||
| 53 | Qwen3.7 Max | 73±1 | api $3.75/M | | ||
| 54 | DeepSeek V4 Flash (0731) | 73±1 | api $0.11/M +local | ~92GB | +2 | |
| 55 | GLM-5.3-Flash | 73±1 | api $0.24/M +local | ~103GB | +2 | |
| 56 | GPT-5.2 | 73±1 | api $4.81/M | +20 | ||
| 57 | Gemini 3.6 Flash | 73±1 | api $1.50/M | +2 | ||
| 58 | GLM-5.2 | 73±1 | api $2.15/M +local | ~121GB | +6 | |
| 59 | Hunyuan Hy3 (295B-A21B) | 73±1 | api $0.23/M +local | ~94GB | | |
| 60 |  Dola Seed 2.0 Pro | 72±2 | comparison only | | ||
| 61 | Qwen3.8 27B | 72±1 | api $1.60/M +local | ~18GB | ~6.7 tok/s | +3 |
| 62 | Grok 4.20 Multi-Agent (0309) | 72±2 | api $1.56/M | | ||
| 63 |  LongCat 2.0 (1.6T-A48B) | 72±2 | api $1.30/M +local | ~2155GB | | |
| 64 | Kimi K2.6 | 72±1 | api $1.71/M +local | ~317GB | +11 | |
| 65 | GPT-5 Pro | 72±1 | api $41.25/M | | ||
| 66 | GPT-5 | 72±1 | api $3.44/M | +22 | ||
| 67 | Gemini 3 Pro (Preview) | 72±1 | comparison only | +14 | ||
| 68 | Qwen3.6 Max Preview | 72±1 | api $2.92/M | | ||
| 69 | Gemini 3 Flash (Preview) | 72±1 | api $1.13/M | +6 | ||
| 70 | DeepSeek V4 Pro (Preview, Apr 2026) | 71±1 | local | ~604GB | +6 | |
| 71 | Claude Sonnet 4.6 | 71±1 | api $6.00/M | +16 | ||
| 72 | Kimi K2.7 Code | 71±1 | api $1.71/M +local | ~359GB | | |
| 73 | Claude Opus 4.5 | 71±1 | api $10.00/M | +13 | ||
| 74 | Qwen3.7 Plus | 71±1 | api $0.70/M | | ||
| 75 | DeepSeek V4 Flash (Preview, Apr 2026) | 71±1 | local | ~103GB | +4 | |
| 76 |  North Small Translate 1.0 | 71±6† | api price unknown | | ||
| 77 |  Solar Open 2 (250B-A15B) | 71±1† | local | ~527GB | | |
| 78 | Grok 4.20 (0309 reasoning) | 71±1 | api $1.56/M | | ||
| 79 | GPT-5.4 mini | 71±1 | api $1.69/M | +6 | ||
| 80 |  Ling 3.0 Flash (124B-A5B) | 70±2† | api $0.090/M +local | ~71GB | | |
| 81 | GPT-5.1 | 70±1 | api $3.44/M | +7 | ||
| 82 |  Mistral Large 4 (public preview) | 70±1 | api $2.06/M | | ||
| 83 | GLM-5.1 | 70±0 | api $2.15/M +local | ~119GB | +11 | |
| 84 | o3-pro | 70±2 | api $35.00/M | | ||
| 85 | Qwen3.5 397B-A17B | 70±0 | api $1.09/M +local | ~65GB | +15 | |
| 86 | Gemini 2.5 Pro Preview (06-05) | 70±2 | comparison only | | ||
| 87 |  KAT-Coder-V2.5-Dev (35B-A3B) | 70±2† | local | ~21GB | | |
| 88 |  Ornith 1.5 35B-A3B | 70±1† | local | ~21GB | ~80 tok/s | |
| 89 | Grok 4.3 | 70±1 | api $1.56/M | | ||
| 90 |  MiniMax-M3 | 69±1 | api $0.48/M +local | ~131GB | +2 | |
| 91 | Qwen3.6 Plus | 69±1 | api $1.13/M | +1 | ||
| 92 | Kimi K2.5 | 69±1 | api $1.20/M +local | ~160GB | +15 | |
| 93 |  Inkling Small (266B-A12B) | 69±1 | api $0.64/M +local | ~86GB | | |
| 94 | MiMo-V2-Pro | 69±1 | comparison only | | ||
| 95 | Qwen3-Max (2026-01-23) | 69±1† | comparison only | | ||
| 96 | GLM-5 | 69±1 | api $1.55/M +local | ~119GB | +11 | |
| 97 | Inkling (975B-A41B) | 69±1 | api $1.73/M +local | ~156GB | | |
| 98 | Muse Glimmer 30B | 69±1 | api $0.64/M +local | ~18GB | ~27 tok/s | |
| 99 | o3 | 69±1 | api $3.50/M | +11 | ||
| 100 | MiMo-V2.5-Pro (1T-A42B) | 69±1 | api $0.65/M +local | ~163GB | | |
| 101 |  Nemotron 3 Ultra 550B-A55B | 69±1 | api $1.35/M +local | ~89GB | | |
| 102 | Qwen3.6 27B | 69±1 | api $1.20/M +local | ~18GB | ~16 tok/s | +4 |
| 103 | Ring-2.6-1T | 69±2† | comparison only | | ||
| 104 |  A.X K2 (688B-A33B) | 69±1† | local | ~1454GB | | |
| 105 | MiMo-V2.5 (310B-A15B) | 68±1 | api $0.21/M +local | ~100GB |  | |
| 106 | GPT-5.5 Instant | 68±1 | comparison only | | ||
| 107 | Qwen3.5 Plus | 68±2 | api $0.90/M | | ||
| 108 | Gemini 3.5 Flash-Lite | 68±1 | api $0.85/M | | ||
| 109 | Qwen3.5 122B-A10B | 68±1 | api $1.10/M +local | ~71GB | +5 | |
| 110 | LongCat-Flash-Thinking (560B-A27B) | 68±1† | comparison only | | ||
| 111 | GPT-5.4 nano | 68±1 | api $0.46/M | +1 | ||
| 112 | Claude Sonnet 4.5 | 68±1 | api $6.00/M | +18 | ||
| 113 | GLM-4.7 | 68±1 | api $1.00/M +local | ~58GB | +5 | |
| 114 | GLM-5V-Turbo | 68±2 | api $1.90/M | | ||
| 115 | Qwen3.5 27B | 68±0 | api $0.84/M +local | ~18GB | ~29 tok/s | +8 |
| 116 | Gemini 2.5 Pro Experimental (03-25) | 68±2 | comparison only | | ||
| 117 | GPT-5.2-Codex | 68±2 | comparison only | | ||
| 118 | Grok 4 (0709) | 68±1 | comparison only | +1 | ||
| 119 | Step 3.5 Flash (196B-A11B) | 68±1 | api $0.15/M +local | ~118GB | ~18 tok/s | |
| 120 | MiMo-V2-Omni | 68±2 | comparison only | | ||
| 121 | DeepSeek V3.2 | 67±1 | api $0.29/M +local | ~110GB | +15 | |
| 122 | Qwen3.6 35B-A3B | 67±1 | api $0.31/M +local | ~21GB | ~63 tok/s | +4 |
| 123 | MiniMax-M2.7 | 67±1 | api $0.53/M +local | ~75GB | +2 | |
| 124 | Qwen3-Coder-Next (80B-A3B) | 67±2 | api $0.60/M +local | ~25GB | ~62 tok/s | |
| 125 | Claude Opus 4 | 67±1 | comparison only | +4 | ||
| 126 | GPT-5 mini | 67±1 | api $0.69/M | +16 | ||
| 127 | Ornith 1.0 35B (35B-A3B) | 67±1 | local | ~23GB | ~103 tok/s | |
| 128 | Gemini 2.5 Pro | 67±1 | api $3.44/M | +16 | ||
| 129 | Claude Opus 4.1 | 67±1 | comparison only | +2 | ||
| 130 | Hy3 preview (295B-A21B) | 67±1 | local | ~629GB | | |
| 131 |  Gemma 4 31B | 67±1 | api $0.19/M +local | ~24GB | ~11 tok/s | +20 |
| 132 | Kimi K2 Thinking | 67±1 | api $1.07/M +local | ~160GB | | |
| 133 | Gemini 2.5 Pro Preview (05-06) | 67±1 | comparison only | +2 | ||
| 134 | Gemini 2.5 Pro Preview (03-25) | 67±2 | comparison only | | ||
| 135 |  K-EXAONE 2.0 (750B-A37B) | 67±1† | local | ~791GB | | |
| 136 | Gemini 3.1 Flash-Lite | 67±1 | api $0.56/M | | ||
| 137 | Qwen3.7 Flash | 67±1 | api $0.055/M | | ||
| 138 |  Laguna M.1 | 66±2 | api price unknown +local | ~135GB | | |
| 139 | DeepSeek V3.1 Terminus | 66±1 | local | ~230GB | | |
| 140 | DeepSeek V3.2 Exp | 66±1 | local | ~726GB | | |
| 141 |  GigaChat 3.5 Ultra Reasoning (432B-A28B) | 66±1† | local | ~461GB | | |
| 142 | Qwen3 235B-A22B Thinking 2507 | 66±1 | api $0.97/M +local | ~76GB | +6 | |
| 143 | Kimi K2 Instruct (0711) | 66±1 | api $1.00/M +local | ~152GB | +3 | |
| 144 | Qwen3.5 35B-A3B | 66±0 | api $0.35/M +local | ~21GB | ~50 tok/s | +12 |
| 145 | Step 3.7 Flash (198B-A11B) | 66±1 | api $0.44/M +local | ~104GB | | |
| 146 | o1 (2024-12-17) | 66±1 | api $26.25/M | +13 | ||
| 147 | o4-mini | 66±1 | api $1.93/M | +12 | ||
| 148 | Grok 4.1 Fast (Reasoning) | 66±1 | api $0.28/M | +4 | ||
| 149 | LongCat-Flash-Chat (560B-A27B) | 66±1 | local | ~333GB | | |
| 150 |  Spark-X2.5 4B | 66±1† | local | ~3.5GB | ~114 tok/s | |
| 151 | DeepSeek V3.1 | 66±1 | api $0.42/M +local | ~110GB | +3 | |
| 152 | Qwen3.6 Flash | 66±1 | api $0.56/M | | ||
| 153 | GLM-4.6 | 66±1 | api $1.00/M +local | ~58GB | +1 | |
| 154 | Claude Sonnet 4 | 66±1 | comparison only | +12 | ||
| 155 | Qwen3-Max (2025-09-23) | 66±1 | api $2.40/M | | ||
| 156 | MiMo-V2-Flash (309B-A15B) | 66±1 | local | ~103GB | | |
| 157 | MiniMax-M2.5 | 65±1 | api $0.53/M +local | ~75GB | +3 | |
| 158 | o3-mini | 65±1 | api $1.93/M | +13 | ||
| 159 | Claude 3.7 Sonnet | 65±1 | comparison only | +16 | ||
| 160 | DeepSeek R1 0528 | 65±1 | api $0.91/M +local | ~104GB | +6 | |
| 161 | MiniMax-M2.1 | 65±1 | local | ~79GB | | |
| 162 | Nemotron Cascade 2 30B-A3B | 65±1 | local | ~20GB | ~90 tok/s | |
| 163 | ChatGPT-4o (2025-03-26) | 65±2 | comparison only | | ||
| 164 | MiMo-V2.6-Distill-Qwen-9B | 65±2† | local | ~7.8GB | | |
| 165 | Laguna XS 2.1 (33B-A3B) | 65±2† | local | ~21GB | | |
| 166 | K-EXAONE (236B-A23B) | 65±1 | local | ~152GB | | |
| 167 | Qwen3 235B-A22B Instruct 2507 | 65±1 | api $0.20/M +local | ~73GB | ~15 tok/s | +3 |
| 168 |  INTELLECT-3 | 65±1 | local | ~48GB | | |
| 169 | GLM-4.5 | 65±1 | api $1.00/M +local | ~58GB | +3 | |
| 170 | EXAONE 4.5 33B | 64±2† | local | ~24GB | | |
| 171 | Qwen3.5 Flash | 64±1 | api $0.17/M | | ||
| 172 | Solar Pro 4 | 64±1 | api $0.53/M | | ||
| 173 | Nemotron 3 Super 120B-A12B | 64±1 | api $0.28/M +local | ~73GB | ~20 tok/s | |
| 174 | MiniMax-M2 | 64±1 | api $0.53/M +local | ~75GB | | |
| 175 | Mistral Medium 3.5 (128B) | 64±1 | api $3.00/M +local | ~43GB | | |
| 176 | Laguna XS.2 | 64±1 | local | ~21GB | | |
| 177 | Mistral Medium 3.1 (2508) | 64±2 | comparison only | | ||
| 178 | Claude Haiku 4.5 | 64±1 | api $2.00/M | +9 | ||
| 179 | Command A+ (05-2026) | 64±1 | api price unknown +local | ~71GB |  | |
| 180 | Qwen3-VL 235B-A22B Thinking | 64±1 | local | ~106GB | | |
| 181 | Gemma 4 26B-A4B | 64±1 | api $0.14/M +local | ~18GB | ~55 tok/s | +12 |
| 182 | Qwen3-VL 235B-A22B Instruct | 64±1 | local | ~128GB | | |
| 183 | Kimi K2 Instruct (0905) | 64±2 | local | ~298GB | | |
| 184 | Nemotron-Labs-3 Puzzle 75B-A9B | 64±1† | local | ~35GB | | |
| 185 | Qwen3-Coder 480B-A35B Instruct | 64±1 | api $0.67/M +local | ~78GB | | |
| 186 | Grok 3 Beta | 64±1 | comparison only | | ||
| 187 | Grok 3 Mini Beta | 64±1 | comparison only | +2 | ||
| 188 |  MiniCPM5 2B | 64±1† | local | ~2.4GB | | |
| 189 | DeepSeek R1 (Jan '25) | 64±1 | api $4.00/M +local | ~104GB | +15 | |
| 190 | o1-preview | 64±1 | comparison only | +7 | ||
| 191 | Gemini 2.5 Flash Preview (09-2025) | 63±1 | comparison only | | ||
| 192 | Qwen3-Next 80B-A3B Instruct | 63±1 | api $0.34/M +local | ~26GB | ~55 tok/s | |
| 193 |  Nova 2 Pro (Preview) | 63±2 | api $3.78/M | | ||
| 194 | Qwen3-Next 80B-A3B Thinking | 63±1 | api $0.41/M +local | ~25GB | +3 | |
| 195 |  Granite 4.2 30B | 63±1 | api $0.28/M +local | ~19GB | | |
| 196 | GPT-4.5 Preview | 63±1 | comparison only | +6 | ||
| 197 | Gemini 2.5 Flash Preview (04-17) | 63±1 | comparison only | | ||
| 198 | GPT-4.1 | 63±1 | api $3.50/M | +17 | ||
| 199 | GLM-4.5-Air | 63±1 | api $0.42/M +local | ~35GB | ~23 tok/s | +3 |
| 200 | Gemma 4 12B | 63±1 | local | ~9.2GB | ~29 tok/s | |
| 201 |  Trinity-Large-Thinking | 63±2 | api $0.39/M +local | ~141GB | | |
| 202 | Qwen3.5 9B | 62±0 | api $0.11/M +local | ~6.7GB | ~22 tok/s | +17 |
| 203 |  Seed-OSS 36B Instruct | 62±1 | local | ~23GB | | |
| 204 |  HyperCLOVA X SEED 32B Think | 62±2† | comparison only | | ||
| 205 | MiniMax-M1 (80k) | 62±1 | api $0.96/M +local | ~959GB | | |
| 206 | GLM-4.6V | 62±2 | api $0.45/M +local | ~50GB | | |
| 207 | Magistral Medium 1.2 (2509) | 62±2† | comparison only | | ||
| 208 | Gemini 2.5 Flash | 62±1 | api $0.85/M | +10 | ||
| 209 | Nemotron 3.5 Lightning 30B-A3B | 62±2 | api $0.087/M +local | ~20GB | ~64 tok/s | |
| 210 | Gemini 2.5 Flash Preview (05-20) | 62±1 | comparison only | +1 | ||
| 211 | Qwen3-VL 32B Thinking | 62±1 | api $0.28/M +local | ~22GB | | |
| 212 | Gemini 2.0 Flash-Lite (001) | 62±2 | comparison only | | ||
| 213 | gpt-oss-120b | 62±1 | api $0.26/M +local | ~64GB | ~56 tok/s | +19 |
| 214 | GPT-5 nano | 62±1 | api $0.14/M | +7 | ||
| 215 | Mistral Large 3 (675B-A41B) | 62±1 | api $0.75/M +local | ~108GB | +1 | |
| 216 |  Apriel 1.6 15B Thinker | 62±1† | local | ~10GB | | |
| 217 | Gemini 2.5 Flash-Lite Preview (06-17) | 62±2 | comparison only | | ||
| 218 | A.X K1 (519B-A33B) | 62±1† | local | ~1091GB | | |
| 219 | Devstral 2 (2512) | 62±2 | local | ~74GB | | |
| 220 | o1-mini | 61±1 | comparison only | +12 | ||
| 221 | GLM-4.5V | 61±2 | api $0.90/M +local | ~69GB | | |
| 222 | MiniMax-M1 (40k) | 61±1† | comparison only | | ||
| 223 | Grok 4 Fast | 61±1 | comparison only | | ||
| 224 | Llama 3.1 Nemotron Ultra 253B v1 | 61±1 | local | ~82GB | | |
| 225 | Gemini 2.0 Pro Experimental (02-05) | 61±1 | comparison only | | ||
| 226 | DeepSeek V3 0324 | 61±1 | local | ~102GB | +11 | |
| 227 | GPT-4.1 mini | 61±1 | api $0.70/M | +13 | ||
| 228 | Qwen3 30B-A3B Thinking 2507 | 61±1 | api $0.75/M +local | ~19GB | +8 | |
| 229 | Claude 3.5 Sonnet (2024-10-22) | 61±1 | comparison only | +14 | ||
| 230 | Qwen3.5 4B | 61±1 | local | ~3.8GB | +10 | |
| 231 | Qwen3 30B-A3B Instruct 2507 | 61±1 | api $0.15/M +local | ~19GB | ~100 tok/s | +4 |
| 232 | Gemini 2.0 Flash (001) | 61±1 | comparison only | +7 | ||
| 233 |  ERNIE 4.5 300B-A47B | 60±1† | local | ~97GB | | |
| 234 |  Mellum2.1 12B-A2.5B Thinking | 60±1† | local | ~8.3GB | | |
| 235 | Mistral Medium 3 (2505) | 60±1 | comparison only | | ||
| 236 | Nemotron-Cascade-14B-Thinking | 60±1† | local | ~10GB | | |
| 237 | Qwen3-VL 32B Instruct | 60±1† | api $0.28/M +local | ~22GB | | |
| 238 | Devstral Small 2 24B | 60±3† | local | ~16GB | | |
| 239 |  Gemma 2 9B IT SimPO | 60±1 | local | ~7.6GB | | |
| 240 | Gemma 2 9B IT DPO (Princeton) | 60±1 | local | ~7.6GB | | |
| 241 |  Falcon-H1R 7B | 60±1† | local | ~5.3GB | | |
| 242 | Qwen3 235B-A22B (Apr 2025, hybrid) | 60±0 | api $1.23/M +local | ~73GB | +14 | |
| 243 | DeepSeek V3 (Dec '24) | 60±1 | api $0.46/M +local | ~337GB | +10 | |
| 244 | Mistral Small 4 (119B-A6.5B) | 60±2 | api $0.26/M +local | ~37GB | | |
| 245 | Gemini 2.0 Flash-Lite Preview (02-05) | 60±2 | comparison only | | ||
| 246 | Qwen3-VL 30B-A3B Thinking | 60±1† | api $0.75/M +local | ~20GB | | |
| 247 | Granite 4.2 8B | 60±1 | api $0.11/M +local | ~6.8GB | | |
| 248 | QwQ-32B | 60±1 | local | ~21GB | +7 | |
| 249 | Solar Open 100B (102B-A12B) | 60±1† | local | ~41GB | | |
| 250 | OpenReasoning-Nemotron-32B | 59±2† | local | ~21GB | | |
| 251 | Trinity-Large-Preview | 59±2 | local | ~155GB | | |
| 252 | GLM-4.7-Flash | 59±1 | api $0.0000/M +local | ~18GB | ~44 tok/s | |
| 253 | EXAONE 4.0 32B | 59±1 | local | ~20GB | | |
| 254 |  Phi-4-reasoning-plus 14B | 59±1 | local | ~10GB | | |
| 255 |  Mercury 2 | 59±2 | comparison only | | ||
| 256 | Qwen3 14B | 59±1 | api $0.61/M +local | ~10GB | +6 | |
| 257 |  Olmo 3.1 32B Think | 59±1 | local | ~21GB | | |
| 258 | Nemotron-Cascade-8B | 59±1† | local | ~6.3GB | | |
| 259 |  DiffusionGemma 26B-A4B | 59±1† | comparison only | | ||
| 260 | gpt-oss-20b | 58±1 | api $0.13/M +local | ~13GB | ~79 tok/s | +15 |
| 261 | Llama 3.3 Nemotron Super 49B v1 | 58±2 | local | ~22GB | | |
| 262 | DeepSeek R1 Distill Llama 70B | 58±1 | api $0.80/M +local | ~30GB | +1 | |
| 263 | GPT-4o (2024-08-06) | 58±1 | api $4.38/M | +23 | ||
| 264 | Command A (03-2025) | 58±1 | api $4.38/M +local | ~37GB | | |
| 265 | Olmo 3 32B Think | 58±1 | local | ~21GB | | |
| 266 | Phi-4-reasoning 14B | 58±1 | api $0.22/M +local | ~10GB | | |
| 267 | GPT-4o (2024-05-13) | 58±0 | api $7.50/M | +19 | ||
| 268 | Qwen3-VL 30B-A3B Instruct | 58±1† | api $0.35/M +local | ~20GB | | |
| 269 | Qwen3-VL 8B Thinking | 58±1 | api $0.66/M +local | ~6.9GB | | |
| 270 | Nova 2 Lite | 58±1 | api $0.94/M | | ||
| 271 | Magistral Small 1.2 | 58±1 | api $0.75/M +local | ~16GB | | |
| 272 | GPT-4o (2024-11-20) | 58±1 | api $4.38/M | +7 | ||
| 273 | Claude 3.5 Sonnet (2024-06-20) | 58±1 | comparison only | +16 | ||
| 274 | Qwen3 32B | 58±0 | api $0.13/M +local | ~20GB | +17 | |
| 275 | Nemotron-Cascade-8B-Thinking | 58±2† | local | ~6.3GB | | |
| 276 | Qwen3 Coder 30B-A3B Instruct | 58±1 | api $0.12/M +local | ~19GB | ~93 tok/s | |
| 277 | Gemini 2.0 Flash Thinking Experimental (01-21) | 58±1 | comparison only | | ||
| 278 | Qwen2.5-Max (2025-01-25) | 58±1 | comparison only | | ||
| 279 | Gemini 2.5 Flash-Lite | 58±2 | api $0.17/M | +1 | ||
| 280 | Llama 4 Maverick (402B-A17B) | 58±1 | api $0.42/M +local | ~65GB | +14 | |
| 281 | Llama 3.3 Nemotron Super 49B v1.5 | 58±1 | local | ~18GB | | |
| 282 | Qwen2.5 Coder 32B Instruct | 58±1 | api $0.74/M +local | ~21GB | +5 | |
| 283 | DeepSeek R1 0528 Qwen3 8B | 58±1 | api $0.068/M +local | ~6.5GB | ~21 tok/s | |
| 284 | Granite 4.2 3B | 57±1 | api $0.052/M +local | ~3.3GB | | |
| 285 | Gemini 1.5 Pro Experimental (0827) | 57±1 | comparison only | | ||
| 286 | Nemotron 3 Nano 30B-A3B | 57±1 | api $0.087/M +local | ~20GB | ~90 tok/s | +3 |
| 287 | Gemini 1.5 Pro (002) | 57±1 | comparison only | +5 | ||
| 288 |  Athene-V2-Chat 72B | 57±1 | local | ~44GB | | |
| 289 | Grok 2 (1212) | 57±1 | comparison only | | ||
| 290 | Granite 4.1 30B | 57±1† | local | ~19GB | ~25 tok/s | |
| 291 | Qwen2.5-Omni 7B | 57±2 | local | ~5.8GB | | |
| 292 | Gemini 2.0 Flash Experimental | 57±1 | comparison only | | ||
| 293 | Ministral 3 14B Reasoning 2512 | 57±1 | local | ~10GB | | |
| 294 | Qwen Plus (2025-01-25) | 57±1 | api $0.60/M | | ||
| 295 |  Sky-T1 32B Preview | 57±4 | local | ~21GB | | |
| 296 | Qwen3 4B Thinking 2507 | 57±1 | local | ~4.2GB | ~67 tok/s | +2 |
| 297 | DeepSeek-V2.5 (1210) | 57±1 | local | ~82GB | | |
| 298 |  QED-Nano | 57±2 | local | ~4.1GB | | |
| 299 | Mistral Small 3.2 24B | 57±1 | api $0.11/M +local | ~15GB | +4 | |
| 300 | GPT-4 Turbo (2024-04-09) | 57±0 | api $15.00/M | +18 | ||
| 301 | Qwen3-VL 4B Thinking | 56±1 | local | ~4.4GB | | |
| 302 | Qwen2.5-VL 72B Instruct | 56±1 | local | ~46GB | +3 | |
| 303 |  Yi-Lightning | 56±1 | api price unknown | | ||
| 304 | Gemini 1.5 Pro Experimental (0801) | 56±1 | comparison only | | ||
| 305 | Qwen2.5 72B Instruct | 56±1 | api $0.37/M +local | ~31GB | +24 | |
| 306 | Mistral Large 2 (2411) | 56±1 | local | ~77GB | +8 | |
| 307 | Llama 3.1 405B Instruct | 56±1 | api $2.40/M +local | ~160GB | +13 | |
| 308 | Qwen3 8B | 56±1 | api $0.31/M +local | ~6.3GB | ~25 tok/s | +14 |
| 309 | DeepSeek R1 Distill Qwen 32B | 56±1 | api $1.59/M +local | ~21GB | ~7.3 tok/s | +5 |
| 310 | Qwen2.5 Coder 14B Instruct | 56±1 | local | ~11GB | ~18 tok/s | |
| 311 | DeepSeek R1 Distill Qwen 14B | 56±1 | local | ~11GB | ~15 tok/s | +2 |
| 312 | Ministral 3 14B | 56±1 | api $0.20/M +local | ~9.1GB | ~46 tok/s | +1 |
| 313 | Qwen2.5 32B Instruct | 56±1 | local | ~21GB | +11 | |
| 314 | Nemotron Nano 9B v2 | 56±1 | api $0.10/M +local | ~7.6GB | | |
| 315 | Molmo 2 8B | 56±2 | local | ~6.8GB | | |
| 316 | Magistral Medium 1.0 (2506) | 56±1 | comparison only | | ||
| 317 | EXAONE Deep 32B | 56±2† | local | ~22GB | | |
| 318 | Qwen3 4B Instruct 2507 | 56±1 | local | ~4.2GB | ~107 tok/s | +4 |
| 319 | Qwen3 30B-A3B (Apr 2025, hybrid) | 56±0 | api $0.35/M +local | ~18GB | +10 | |
| 320 | Magistral Small 1.0 (2506) | 56±1 | local | ~16GB | | |
| 321 | Qwen3-VL 8B Instruct | 56±1 | api $0.31/M +local | ~6.9GB | | |
| 322 |  Bielik 11B v3.0 Instruct | 56±2 | local | ~8.1GB | | |
| 323 | Spark-X2.5 1.7B | 56±1† | local | ~1.9GB | ~166 tok/s | |
| 324 | Nova Premier | 55±2† | api $5.00/M |  | ||
| 325 | Granite 4.1 8B | 55±1 | api $0.11/M +local | ~7.1GB | ~70 tok/s | |
| 326 | Llama 3.3 70B Instruct | 55±1 | api $0.72/M +local | ~25GB | ~13 tok/s | +21 |
| 327 | Magistral Medium 1.1 (2507) | 55±1† | comparison only | | ||
| 328 | Mistral Large 2 (2407) | 55±1 | local | ~45GB | +10 | |
| 329 | Falcon-H1 34B Instruct | 55±3 | local | ~23GB | | |
| 330 | Qwen2.5-Math 72B Instruct | 55±2† | local | ~44GB | | |
| 331 | Llama 4 Scout (109B-A17B) | 55±1 | api $0.15/M +local | ~36GB | ~19 tok/s | +8 |
| 332 | Bielik 11B v2.6 Instruct | 55±3 | local | ~8.1GB | | |
| 333 | GigaChat 3.5 Ultra Instruct (432B-A28B) | 55±1† | local | ~457GB | | |
| 334 | GPT-4 Turbo Preview (1106) | 55±1 | comparison only | +5 | ||
| 335 | Mistral Small 3.1 24B (2503) | 55±1 | local | ~16GB | +7 | |
| 336 | Llama 3.1 Tulu 3 70B | 55±1 | local | ~43GB | | |
| 337 | Pixtral Large (2411) | 55±3 | local | ~51GB | | |
| 338 | Olmo 3.1 32B Instruct | 55±2 | local | ~21GB | | |
| 339 |  OpenThinker2 32B | 55±1 | local | ~21GB | | |
| 340 | GPT-4 Turbo Preview (0125) | 55±1 | comparison only | +3 | ||
| 341 | DeepSeek-V2.5 | 55±1 | local | ~151GB | +1 | |
| 342 | OpenThinker 32B | 55±1† | local | ~21GB | | |
| 343 | Claude 3.5 Haiku | 55±1 | comparison only | +9 | ||
| 344 | DeepSeek-V2 Chat (0628) | 55±1 | local | ~66GB | | |
| 345 | Command A Reasoning (08-2025) | 55±2 | local | ~34GB | | |
| 346 | Magistral Small 1.1 (2507) | 55±1† | local | ~16GB | | |
| 347 | Mellum2 12B-A2.5B Thinking | 55±1† | local | ~8.6GB | | |
| 348 | Ministral 3 8B Reasoning 2512 | 55±1 | local | ~6.5GB | | |
| 349 | Nemotron 3 Nano 4B | 54±1 | local | ~2.9GB | ~52 tok/s | |
| 350 | Llama 3.1 Tulu 3 70B DPO | 54±1 | local | ~22GB | | |
| 351 | Gemini 1.5 Flash Experimental (0827) | 54±1 | comparison only | | ||
| 352 | GPT-4o mini (2024-07-18) | 54±0 | api $0.26/M | +32 | ||
| 353 | Gemini 1.5 Pro (001) | 54±1 | comparison only | +3 | ||
| 354 | DeepSeek-Coder-V2 Instruct (0614) | 54±1 | local | ~92GB | +2 | |
| 355 | DeepSeek-Coder-V2 Instruct (0724) | 54±1 | local | ~151GB | | |
| 356 | EXAONE Deep 7.8B | 54±2† | local | ~6.5GB | | |
| 357 | Mistral Small 3 24B (2501) | 54±1 | local | ~15GB | +6 | |
| 358 | Gemini 1.5 Flash (002) | 54±1 | comparison only | +5 | ||
| 359 | Qwen Turbo (2024-11-01) | 54±2 | comparison only | | ||
| 360 |  GLM-4 9B Chat 1M | 54±4 | local | ~8.1GB | | |
| 361 | GPT-4 (0314) | 54±1 | comparison only |  +21 | ||
| 362 | Claude 3 Opus | 54±0 | comparison only | +15 | ||
| 363 | Qwen2-VL 72B Instruct | 54±1 | local | ~34GB | | |
| 364 | Qwen2.5-VL 32B Instruct | 54±2 | local | ~23GB | +1 | |
| 365 | Yi-Large Preview | 54±1 | comparison only | | ||
| 366 | Llama 3.1 70B Instruct | 54±0 | api $0.72/M +local | ~27GB | +22 | |
| 367 | Gemma 3 27B | 54±1 | api $0.10/M +local | ~19GB | +23 | |
| 368 |  Hermes 3 Llama 3.1 405B | 54±1 | local | ~114GB | | |
| 369 | GPT-4.1 nano | 54±1 | api $0.17/M | +11 | ||
| 370 | Phi-4 14B | 53±1 | api $0.087/M +local | ~10GB | +11 | |
| 371 | GLM-4 (0520) | 53±1 | comparison only | | ||
| 372 | Bielik 11B v2.1 Instruct | 53±3 | local | ~8.5GB | | |
| 373 | Ministral 3 8B | 53±1 | api $0.15/M +local | ~6.5GB | ~68 tok/s | +2 |
| 374 | Olmo 3 7B Think | 53±1 | local | ~5.8GB | | |
| 375 |  s1.1 32B | 53±1 | local | ~22GB | | |
| 376 | Qwen3-VL 4B Instruct | 53±1 | local | ~4.4GB | | |
| 377 | Gemma 4 E4B | 53±1 | local | ~6.4GB | ~21 tok/s | +7 |
| 378 | Qwen2.5-Math 7B Instruct | 53±2† | local | ~5.4GB | | |
| 379 | Llama 3.1 Nemotron 70B Instruct | 53±1 | local | ~43GB | +4 | |
| 380 |  LFM2.5 2.6B | 53±1 | local | ~2.3GB | | |
| 381 | ERNIE 4.5 21B-A3B | 53±1 | comparison only | | ||
| 382 | Bielik 11B v2.2 Instruct | 53±3 | local | ~8.5GB | | |
| 383 | GPT-4 (0613) | 53±1 | api $37.50/M | +11 | ||
| 384 | Nemotron-4 340B Instruct | 53±2 | comparison only | | ||
| 385 |  Palmyra X4 (palmyra-x-004) | 53±3 | comparison only | | ||
| 386 | Granite 4.0 H Small (32B-A9B) | 53±1 | api $0.11/M +local | ~21GB | +1 | |
| 387 | LFM2.5 8B-A1B | 53±1 | local | ~5.5GB | ~174 tok/s | |
| 388 | Llama 3.1 Nemotron 51B Instruct | 53±2 | local | ~34GB | | |
| 389 | Aya Expanse 32B | 53±2 | api $0.75/M +local | ~22GB | +1 | |
| 390 | Qwen2.5 Coder 7B Instruct | 53±1 | local | ~5.4GB | ~3.8 tok/s | |
| 391 |  OpenCoder-8B-Instruct | 53±1 | local | ~6.4GB | | |
| 392 | Gemma 3 12B | 53±1 | api $0.075/M +local | ~10GB | ~13 tok/s | +10 |
| 393 | Qwen2.5 14B Instruct | 53±1 | local | ~11GB | +7 | |
| 394 | Yi-Large | 52±1 | comparison only | | ||
| 395 |  Cogito v1 Preview Llama 8B | 52±4 | local | ~6.2GB | | |
| 396 | Llama-3-Instruct-8B-SimPO | 52±1 | local | ~6.6GB | | |
| 397 | Llama-3-Instruct-8B-SimPO-ExPO | 52±1 | local | ~6.6GB | | |
| 398 | Athene-70B | 52±1 | local | ~29GB | | |
| 399 |  Jamba 1.5 Large | 52±1 | local | ~839GB | | |
| 400 | Qwen2 72B Instruct | 52±1 | local | ~33GB | +14 | |
| 401 | Command A Translate (08-2025) | 52±4† | api price unknown | | ||
| 402 |  CodeQwen1.5 7B Chat | 52±1 | local | ~6.4GB | | |
| 403 |  OpenCodeInterpreter-DS-33B | 52±1 | local | ~22GB | | |
| 404 | LFM2 24B-A2B | 52±1 | local | ~14GB | | |
| 405 | Gemini 1.5 Flash (001) | 52±1 | comparison only | +3 | ||
| 406 | Qwen3 4B | 52±1 | local | ~4GB | +8 | |
| 407 | Bielik 11B v2.0 Instruct | 52±3 | local | ~8.5GB | | |
| 408 | Flan-U-PaLM 540B | 52±1† | never released | | ||
| 409 | DeepSeek-Coder 33B Instruct | 51±1 | local | ~21GB | +1 | |
| 410 | Codestral 22B v0.1 | 51±1 | local | ~15GB | | |
| 411 | GLM-4 (0116) | 51±1 | comparison only | | ||
| 412 | Gemma 2 27B IT | 51±1 | local | ~19GB | +10 | |
| 413 | Llama 3 70B Instruct | 51±0 | local | ~24GB | +17 | |
| 414 | Llama 3.2 90B Vision Instruct | 51±1 | local | ~58GB | +1 | |
| 415 | Bielik 11B v2.3 Instruct | 51±2 | local | ~8.6GB | | |
| 416 |  WizardCoder 33B V1.1 | 51±1 | local | ~22GB | | |
| 417 | Flan-PaLM 540B | 51±1† | never released | | ||
| 418 | Llama-3-8B-ProLong-512k-Instruct | 51±4 | local | ~35GB | | |
| 419 | Nova Pro | 51±1 | api $1.40/M | | ||
| 420 | Mellum2 12B-A2.5B Instruct | 51±2† | local | ~7.6GB | | |
| 421 | WizardLM-2 8x22B | 51±1 | local | ~91GB | | |
| 422 | Mistral Small Instruct 22B (2409) | 51±2 | local | ~15GB | | |
| 423 | OpenThinker3 7B | 51±1 | local | ~6GB | | |
| 424 | Granite 4.1 3B | 51±1† | local | ~3.7GB | ~131 tok/s | |
| 425 | OpenCodeInterpreter-DS-6.7B | 51±1 | local | ~5.8GB | | |
| 426 | Qwen2-Math 72B Instruct | 51±1 | local | ~32GB | | |
| 427 | Molmo 72B (0924) | 51±2 | local | ~309GB | | |
| 428 | AceReason-Nemotron-1.0-14B | 51±2† | local | ~10GB | | |
| 429 |  Artigenz-Coder-DS-6.7B | 51±1 | local | ~5.8GB | | |
| 430 | Yi 34B 200K (base) | 51±4 | local | ~23GB | | |
| 431 | Hermes 3 Llama 3.1 70B | 51±1 | local | ~43GB | | |
| 432 | OLMo 2 32B Instruct (0325) | 50±1 | local | ~21GB | | |
| 433 |  speechless-codellama-34b-v2.0 | 50±1 | local | ~23GB | | |
| 434 | Ministral 3 3B Reasoning 2512 | 50±1 | local | ~3.4GB | | |
| 435 |  Aya 23 35B | 50±2 | local | ~22GB | | |
| 436 | Qwen2.5-VL 7B Instruct | 50±1 | local | ~5.8GB | | |
| 437 | Claude 3 Sonnet | 50±0 | comparison only | +12 | ||
| 438 | Mixtral 8x22B Instruct v0.1 | 50±1 | local | ~56GB | +9 | |
| 439 | EXAONE Deep 2.4B | 50±2† | local | ~3.2GB | | |
| 440 |  Magicoder-S-DS 6.7B | 50±1 | local | ~5.8GB | | |
| 441 | Pixtral 12B (2409) | 50±2 | local | ~9.6GB | | |
| 442 | Nova Lite | 50±2 | api $0.10/M | | ||
| 443 | Qwen2.5 7B Instruct | 50±1 | api $0.30/M +local | ~5.4GB | ~54 tok/s | +12 |
| 444 | Yi-Coder 9B Chat | 50±1 | local | ~6.3GB | | |
| 445 |  InternLM2.5 7B Chat | 50±2 | local | ~6.1GB | | |
| 446 |  XwinCoder-34B | 50±1 | local | ~23GB | | |
| 447 |  Code Millenials 34B | 50±1 | local | ~23GB | | |
| 448 | LFM2.5 1.2B Thinking | 50±2 | local | ~1.3GB | | |
| 449 |  StarChat2 15B v0.1 | 50±1 | local | ~12GB | | |
| 450 | WaveCoder-Ultra-6.7B | 50±1 | local | ~5.8GB | | |
| 451 |  Reka Core (2024-05-01) | 50±1 | comparison only | | ||
| 452 | Qwen2-Math 7B Instruct | 50±2† | local | ~6GB | | |
| 453 | GPT-4o Audio Preview (2024-12-17) | 50±2 | comparison only | | ||
| 454 | Gemini 1.5 Flash-8B (001) | 50±2 | comparison only | | ||
| 455 | Qwen3-VL 2B Thinking | 50±1 | local | ~2.7GB | | |
| 456 | Phi-3.5-MoE-instruct | 49±1 | local | ~25GB | | |
| 457 |  MegaBeam-Mistral-7B-512k | 49±4 | local | ~5.9GB | | |
| 458 | Gemma 3n E4B | 49±1 | local | ~5.6GB | | |
| 459 | Claude 3 Haiku | 49±0 | comparison only | +16 | ||
| 460 | OpenThinker2 7B | 49±2† | local | ~6.4GB | | |
| 461 | DeepSeek-Coder 7B Instruct v1.5 | 49±1 | local | ~5.9GB | | |
| 462 | Hermes 2 Theta Llama-3 70B | 49±2 | local | ~47GB | | |
| 463 | DeepSeek-Coder 6.7B Instruct | 49±1 | local | ~8.8GB | | |
| 464 | Qwen2 57B-A14B Instruct | 49±2 | local | ~35GB | | |
| 465 | Granite 4.0 H Tiny (7B-A1B) | 49±1 | local | ~4.5GB | ~12 tok/s | |
| 466 | Claude 1.3 | 49±1 | comparison only | +1 | ||
| 467 | MiniCPM3-4B | 49±2 | local | ~4GB | | |
| 468 | Bielik 4.5B v3.0 Instruct | 49±2 | local | ~4.3GB | | |
| 469 | Qwen2.5 Coder 3B Instruct | 49±1 | local | ~2.6GB | ~9.5 tok/s | |
| 470 | Gemma 2 9B IT | 49±1 | local | ~8.9GB | +14 | |
| 471 | Yi-1.5 34B (base) | 49±2 | local | ~22GB | | |
| 472 | GPT-4o mini Audio Preview (2024-12-17) | 49±2 | comparison only | | ||
| 473 | Command R Plus (08-2024) | 49±1 | api $4.38/M +local | ~63GB | +1 | |
| 474 | GLM-4 9B Chat | 49±2 | local | ~7.1GB | +1 | |
| 475 | AceReason-Nemotron-1.1-7B | 49±2† | local | ~6GB | | |
| 476 |  WhiteRabbitNeo-33B-v1 | 49±1 | local | ~22GB | | |
| 477 | Qwen1.5 110B Chat | 49±1 | local | ~45GB | +1 | |
| 478 | speechless-coder-ds-6.7b | 48±1 | local | ~5.8GB | | |
| 479 | Magicoder-S-CL-7B | 48±1 | local | ~5.8GB | | |
| 480 |  Phind CodeLlama 34B v2 | 48±1 | local | ~23GB | | |
| 481 | DeepSeek R1 Distill Qwen 7B | 48±1 | local | ~5.4GB | ~35 tok/s | +6 |
| 482 | Jamba 1.5 Mini | 48±1 | local | ~34GB | | |
| 483 | Mistral Large (2402) | 48±1 | comparison only | +3 | ||
| 484 |  InternVL2-26B | 48±2 | local | ~55GB | | |
| 485 | Aya Expanse 8B | 48±2 | local | ~6.4GB | | |
| 486 | U-PaLM 540B | 48±1† | never released | | ||
| 487 | GPT-3.5 Turbo (0125) | 48±1 | api $0.75/M | +11 | ||
| 488 |  EuroLLM 9B Instruct | 48±2 | local | ~6.9GB | | |
| 489 | Flan-UL2 20B | 48±4 | comparison only | | ||
| 490 | GPT-3.5 Turbo (1106) | 48±1 | comparison only | +2 | ||
| 491 | Granite 4.0 H Micro 3B | 48±1 | local | ~3.4GB | | |
| 492 | Minerva 540B | 48±1† | never released | | ||
| 493 | Code Llama 70B Instruct | 48±1 | local | ~28GB | +1 | |
| 494 | OLMo 2 13B Instruct (1124) | 48±1 | local | ~9.6GB | | |
| 495 | InternLM2.5 7B Chat 1M | 48±4 | local | ~6.4GB | | |
| 496 | Falcon-H1 7B Instruct | 48±3 | local | ~6GB | | |
| 497 | Qwen3.5 2B | 48±1 | local | ~2.2GB | ~137 tok/s | +7 |
| 498 | GPT-3.5 Turbo (0301) | 48±1 | comparison only | +24 | ||
| 499 | CogVLM2 Llama3 Chinese Chat 19B | 48±7† | comparison only | | ||
| 500 | Llama 3 70B (base) | 48±2 | local | ~43GB | | |
| 501 | MedGemma 4B IT | 48±3 | local | ~4.1GB | | |
| 502 | Nova Micro | 47±2 | api $0.061/M | | ||
| 503 | Gemma 4 E2B | 47±1 | api $0.050/M +local | ~4.5GB | +6 | |
| 504 |  OpenChat 3.5 0106 | 47±1 | local | ~6.1GB | +1 | |
| 505 | Command R (08-2024) | 47±1 | api $0.26/M +local | ~21GB | +3 | |
| 506 | Tulu 2 70B | 47±2† | local | ~28GB | | |
| 507 | Hermes 2 Pro Llama 3 8B | 47±3 | local | ~6.6GB | | |
| 508 | EXAONE 4.0 1.2B | 47±1† | local | ~2.2GB | | |
| 509 | Claude 2.0 | 47±1 | comparison only | +2 | ||
| 510 | Gemini 1.0 Pro (001) | 47±2 | comparison only | | ||
| 511 | Yi 1.5 34B Chat | 47±1 | local | ~22GB | +5 | |
| 512 |  DBRX Instruct | 47±1 | local | ~85GB | +3 | |
| 513 | Mistral Medium (2312) | 47±1 | comparison only | | ||
| 514 | GPT-3.5 Turbo (0613) | 47±1 | comparison only | +5 | ||
| 515 | Granite 34B Code Instruct (8K) | 47±1 | local | ~22GB | | |
| 516 | WizardCoder Python 34B V1.0 | 47±1 | local | ~22GB | | |
| 517 | Codex code-davinci-002 (GPT-3.5 base) | 47±0 | comparison only | +20 | ||
| 518 | Granite 4.0 Micro 3B | 47±1 | local | ~3.5GB | ~6.2 tok/s | |
| 519 | Cogito v1 Preview Llama 3B | 47±4 | local | ~3.4GB | | |
| 520 | InternLM2.5 20B Chat | 47±2 | local | ~14GB | | |
| 521 |  StarCoder2-15B-Instruct-v0.1 | 47±1 | local | ~11GB | | |
| 522 | Qwen2.5-Math 1.5B Instruct | 47±2† | local | ~1.8GB | | |
| 523 | Flan-cont-PaLM 62B | 47±1† | never released | | ||
| 524 | Qwen1.5 72B Chat | 47±1 | local | ~31GB | +9 | |
| 525 | Granite 3.3 8B Instruct | 47±1 | local | ~6.3GB | | |
| 526 | speechless-starcoder2-15b | 47±1 | local | ~12GB | | |
| 527 | OpenChat 3.5 0106 Gemma | 47±2 | local | ~6.9GB | | |
| 528 | Qwen2-VL 7B Instruct | 47±1 | local | ~5.8GB | | |
| 529 | DeepSeek R1 Distill Llama 8B | 47±1 | local | ~6.2GB | +1 | |
| 530 | LFM2 8B-A1B | 47±1 | comparison only | | ||
| 531 | Phi-3 Medium 128K Instruct | 47±1 | local | ~10GB | | |
| 532 | Zephyr ORPO 141B-A35B v0.1 | 47±2 | local | ~56GB | | |
| 533 | Claude 2.1 | 47±1 | comparison only | | ||
| 534 | PaLM 540B | 47±0† | never released | +5 | ||
| 535 | Phi-4-mini-reasoning 3.8B | 47±2 | api $0.13/M +local | ~4GB | | |
| 536 | Phi-3-medium-4k-instruct | 47±1 | local | ~10GB | +1 | |
| 537 | QwQ-32B-Preview | 46±2 | local | ~21GB | +2 | |
| 538 | DeepSeek-Coder-V2 Lite Instruct (16B-A2.4B) | 46±1 | local | ~9.6GB | +1 | |
| 539 | Mistral Small (2402) | 46±1 | comparison only | | ||
| 540 | Minerva 62B | 46±2† | never released | | ||
| 541 | Llama 3.1 8B Instruct | 46±0 | api $0.22/M +local | ~6.2GB | ~47 tok/s | +25 |
| 542 | Ministral 3 3B | 46±1 | api $0.10/M +local | ~3.4GB | ~128 tok/s | +2 |
| 543 | Olmo 3 7B Instruct | 46±1 | local | ~5.8GB | | |
| 544 | Qwen2-Math 1.5B Instruct | 46±2† | local | ~2.4GB | | |
| 545 | Command R Plus (04-2024) | 46±1 | local | ~43GB | +6 | |
| 546 | GPT-3.5 text-davinci-003 | 46±1 | comparison only | +34 | ||
| 547 | Mistral NeMo Instruct (2407) | 46±1 | local | ~8.8GB | +9 | |
| 548 | GPT-4o Audio Preview (2024-10-01) | 46±2 | comparison only | | ||
| 549 | Yi 1.5 9B Chat | 46±1 | local | ~6.8GB | +1 | |
| 550 | Llama 3.1 Tulu 3 8B | 46±1 | local | ~6.2GB | | |
| 551 | Phi-3-mini-4k-instruct (June 2024 update) | 46±1 | local | ~5.7GB | | |
| 552 | Qwen1.5 32B Chat | 46±1 | local | ~22GB | | |
| 553 | Xwin-LM 70B v0.1 | 46±1 | local | ~28GB | | |
| 554 |  Eurus-2-7B-PRIME | 46±2 | local | ~6.4GB | | |
| 555 | Qwen2 7B Instruct | 46±1 | local | ~5.4GB | +4 | |
| 556 | Gemma 3 4B | 46±1 | api $0.063/M +local | ~3.8GB | ~74 tok/s | +11 |
| 557 |  LLaVA-OneVision Qwen2 72B (ov-sft) | 46±3 | local | ~155GB | | |
| 558 | Granite 20B Code Instruct (8K) | 46±1 | local | ~14GB | | |
| 559 | Command R7B (12-2024) | 46±1 | local | ~6.2GB | | |
| 560 |  Dolphin 2.6 Mixtral 8x7B | 46±1 | local | ~29GB | | |
| 561 | Phi-4-mini 3.8B | 45±1 | api $0.13/M +local | ~4GB | +4 | |
| 562 | Ministral 8B (2410) | 45±1 | local | ~6.2GB | +6 | |
| 563 | Granite 3.0 8B Instruct | 45±1 | local | ~6.6GB | | |
| 564 | Granite 8B Code Instruct (4K) | 45±1 | local | ~6.6GB | | |
| 565 | Falcon3 7B Instruct | 45±3 | local | ~5.9GB | | |
| 566 | Code Llama 70B Python | 45±1 | local | ~28GB | | |
| 567 | Code Tulu 2 34B | 45±2† | local | ~72GB | | |
| 568 | OpenThinker 7B | 45±2† | local | ~6GB | | |
| 569 | Falcon3 10B Instruct | 45±3 | local | ~7.6GB | ~13 tok/s | |
| 570 | Granite 3.2 8B Instruct | 45±1 | local | ~6.6GB | | |
| 571 | Yi 34B Chat | 45±1 | local | ~23GB | +1 | |
| 572 | Hermes 2 Theta Llama 3 8B | 45±2 | local | ~6.6GB | | |
| 573 | Phi-3.5-mini-instruct | 45±1 | local | ~5.7GB | +4 | |
| 574 | Qwen2.5-VL 3B Instruct | 45±1 | local | ~2.8GB | | |
| 575 | Llama 3.1 8B (base) | 45±3 | local | ~6.2GB | | |
| 576 | Gemma 3n E2B IT | 45±2 | local | ~4.1GB | | |
| 577 | Code Llama 70B (base) | 45±1 | local | ~28GB | | |
| 578 | Qwen3-VL 2B Instruct | 45±1 | local | ~2.7GB | | |
| 579 | Claude Instant 1.1 | 45±2 | comparison only | | ||
| 580 | Reka Flash 21B (2024-02-26) | 45±1 | comparison only | | ||
| 581 | LFM2.5 1.2B Instruct | 45±2 | local | ~1.3GB | | |
| 582 | Qwen3 1.7B | 45±1 | local | ~2.6GB | ~96 tok/s | +10 |
| 583 | Granite 3.1 8B Instruct | 45±1 | local | ~6.7GB | | |
| 584 | Llama 3.2 11B Vision Instruct | 45±2 | local | ~8.9GB | | |
| 585 | GPT-3.5 text-davinci-002 | 45±0 | comparison only | +22 | ||
| 586 | Flan-PaLM 62B | 45±1† | never released | | ||
| 587 | CogVLM2 Llama3 Chat 19B | 44±3 | local | ~43GB | | |
| 588 | Qwen2.5 3B Instruct | 44±1 | local | ~2.6GB | ~61 tok/s | +5 |
| 589 | LFM2 2.6B | 44±1 | local | ~2GB | | |
| 590 | Qwen2-Audio 7B Instruct | 44±3 | local | ~6.5GB | | |
| 591 | MiniCPM-V 2.6 | 44±2 | local | ~5.8GB | | |
| 592 | Tulu 2 DPO 70B | 44±1 | local | ~32GB | +1 | |
| 593 | Phi-3-small-8k-instruct | 44±2 | local | ~17GB | | |
| 594 | CodeGemma 7B IT (v1.0) | 44±1 | local | ~7.1GB | | |
| 595 | Yi-1.5 9B (base) | 44±2 | local | ~6.8GB | | |
| 596 | Claude Instant 1.2 | 44±1 | comparison only | | ||
| 597 | DeepSeek-Coder 1.3B Instruct | 44±1 | local | ~2.9GB | | |
| 598 | Aya 23 8B | 44±3 | local | ~6.2GB | | |
| 599 | Qwen2.5 Coder 1.5B Instruct | 44±1 | local | ~1.8GB | | |
| 600 | SmolLM3 3B | 44±1 | local | ~2.9GB | | |
| 601 | WizardLM 70B V1.0 | 44±1 | local | ~32GB | | |
| 602 | Mathstral 7B v0.1 | 44±1 | local | ~5.6GB | | |
| 603 | Aya Vision 32B | 44±3 | api price unknown +local | ~71GB | | |
| 604 | Hermes 3 Llama 3.1 8B | 44±1 | local | ~6.6GB | | |
| 605 | Llama 3 8B Instruct | 44±0 | local | ~6.6GB | +19 | |
| 606 | WizardCoder Python 13B V1.0 | 44±2 | local | ~15GB | | |
| 607 | OpenChat 3.5 | 43±1 | local | ~6.1GB | | |
| 608 | Command R (03-2024) | 43±1 | local | ~33GB | +6 | |
| 609 | Granite 34B Code Base (8K) | 43±1 | local | ~24GB | | |
| 610 | speechless-starcoder2-7b | 43±1 | local | ~6.1GB | | |
| 611 | Falcon2 11B (base) | 43±3 | local | ~8.2GB | | |
| 612 |  Snowflake Arctic Instruct | 43±2 | local | ~1007GB | | |
| 613 | OLMo 2 7B Instruct (1124) | 43±1 | local | ~5.8GB | | |
| 614 | WizardCoder-15B-V1.0 | 43±1 | local | ~12GB | | |
| 615 | Ministral 3B (2410) | 43±1 | comparison only | | ||
| 616 | Phi-3-vision-128k-instruct | 43±2 | local | ~10GB | | |
| 617 | cont-PaLM 62B (PaLM 62B trained to 1.3T tokens) | 43±1† | never released | | ||
| 618 | DeepSeek LLM 67B Chat | 43±1 | local | ~31GB | | |
| 619 | Qwen1.5 14B Chat | 43±1 | local | ~11GB | +3 | |
| 620 | Llama 2 70B (base) | 43±1 | local | ~32GB | | |
| 621 | Mixtral 8x7B v0.1 (base) | 43±1 | local | ~29GB | | |
| 622 | InternVL2-4B | 43±2 | local | ~10GB | | |
| 623 | Code Llama 34B Python | 43±1 | local | ~23GB | | |
| 624 | DeepSeek-Coder 33B Base | 43±1 | local | ~22GB | | |
| 625 | speechless-coding-7b-16k-tora | 43±1 | local | ~16GB | | |
| 626 | InternLM2 Chat 20B | 43±1 | local | ~14GB | | |
| 627 | CodeQwen1.5 7B (base) | 43±1 | local | ~6.4GB | | |
| 628 | Mixtral 8x7B Instruct v0.1 | 42±0 | local | ~28GB | +15 | |
| 629 | Nous Hermes 2 Mistral 7B DPO | 42±3 | local | ~6.1GB | | |
| 630 | U-PaLM 62B | 42±2† | never released | | ||
| 631 | Granite 4.0 1B | 42±1 | local | ~2.4GB | | |
| 632 | OpenHermes-2.5-Code-290k-13B | 42±1 | local | ~9.8GB | | |
| 633 | Granite 4.0 H 1B | 42±1 | local | ~2.3GB | | |
| 634 | Nous Hermes 2 Mixtral 8x7B DPO | 42±2 | local | ~30GB | | |
| 635 | Molmo 7B-D (0924) | 42±1 | local | ~35GB | | |
| 636 | North Micro Vision Instruct (2.4B) | 42±2† | local | ~3.8GB | | |
| 637 |  Deita 7B v1.0 | 42±2 | local | ~32GB | | |
| 638 |  Vicuna 13B v1.1 | 42±2 | comparison only | | ||
| 639 | OpenHermes 2.5 Mistral 7B | 42±1 | local | ~5.9GB | +2 | |
| 640 | Code Llama 34B Instruct | 42±1 | local | ~22GB | +1 | |
| 641 | Starling-LM 7B beta | 42±1 | local | ~6GB | +3 | |
| 642 | Code Llama 34B (base) | 42±1 | local | ~23GB | +1 | |
| 643 | Vicuna 33B v1.3 | 41±1 | local | ~23GB | +2 | |
| 644 | Phi-3-mini-128k-instruct (Apr 2024) | 41±2 | local | ~9.5GB | +1 | |
| 645 | Bielik 1.5B v3.0 Instruct | 41±3 | local | ~2.4GB | | |
| 646 |  Starling-LM 7B alpha | 41±1 | local | ~6.1GB | +2 | |
| 647 |  LLaVA-v1.6-34B | 41±2 | local | ~24GB | | |
| 648 | Code Tulu 2 13B | 41±2† | local | ~29GB | | |
| 649 |  Llama3-OpenBioLLM-8B | 41±2 | local | ~6.6GB | | |
| 650 | Mistral 7B Instruct v0.3 | 41±1 | local | ~5.6GB | +4 | |
| 651 | Granite 3.3 2B Instruct | 41±1† | local | ~3GB | | |
| 652 | DeepSeek-Coder 6.7B Base | 41±1 | local | ~8.8GB | | |
| 653 | Granite 3.0 2B Instruct | 41±1 | local | ~3.2GB | | |
| 654 | LFM2 1.2B | 41±1 | local | ~1.3GB | | |
| 655 | Llama 2 70B Chat | 41±1 | local | ~32GB | +13 | |
| 656 | Llama 3.2 3B Instruct | 41±1 | api $0.12/M +local | ~3.3GB | ~139 tok/s | +11 |
| 657 | Granite 8B Code Base (4K) | 41±1 | local | ~6.6GB | | |
| 658 | StarCoder2 15B | 41±1 | local | ~11GB | | |
| 659 | Falcon-H1 3B Instruct | 41±3 | local | ~3.4GB | | |
| 660 | Phi-2 (2.7B) | 40±1 | local | ~4.7GB | +2 | |
| 661 | speechless-code-mistral-7b-v1.0 | 40±1 | local | ~17GB | | |
| 662 | Llama-3-Instruct-8B-SimPO-v0.2 | 40±1 | local | ~6.6GB | | |
| 663 | Qwen-14B-Chat | 40±1 | local | ~11GB | | |
| 664 | Tulu 2 13B | 40±2 | local | ~9.8GB | | |
| 665 | Falcon-180B-Chat | 40±2 | local | ~115GB | | |
| 666 | Code Llama 13B Instruct | 40±1 | local | ~15GB | | |
| 667 |  MistralHermes-CodePro-7B-v1 | 40±1 | local | ~6.1GB | | |
| 668 | Phi-3-mini-4k-instruct (Apr 2024) | 40±2 | local | ~6GB | | |
| 669 | CodeGemma 7B (v1.0) | 40±1 | local | ~7.1GB | | |
| 670 | LLaMA 65B | 40±1 | comparison only | +7 | ||
| 671 | Code Llama 13B Python | 40±1 | local | ~9.8GB | | |
| 672 |  Apertus 8B Instruct (2509) | 40±3 | local | ~6.3GB | | |
| 673 | DeepSeek-V2 Lite Chat (16B-A2.4B) | 40±1 | local | ~11GB | | |
| 674 | Granite 3B Code Instruct (2K) | 40±1 | local | ~3.7GB | | |
| 675 | Tulu 2 DPO 13B | 40±1 | local | ~9.8GB | | |
| 676 | PaLM 62B | 40±1† | never released | +4 | ||
| 677 |  BioMistral-7B | 39±3 | local | ~6.1GB | | |
| 678 | SOLAR 10.7B Instruct v1.0 | 39±1 | local | ~8.3GB | +2 | |
| 679 | Code Tulu 2 7B | 39±2† | local | ~16GB | | |
| 680 | Gemma 2 2B IT | 39±1 | local | ~3.2GB | +4 | |
| 681 | Yi-1.5 6B (base) | 39±3 | local | ~5.1GB | | |
| 682 | Flan-T5 XXL | 39±1 | local | ~49GB | +12 | |
| 683 | Dolphin 2.2.1 Mistral 7B | 39±2 | local | ~5.9GB | | |
| 684 | Phi-3.5-vision-instruct | 39±2 | local | ~10GB | | |
| 685 | Gemma 1.1 7B IT | 39±1 | local | ~7.1GB | +2 | |
| 686 | Granite 3.1 2B Instruct | 39±1 | local | ~3.1GB | | |
| 687 | Granite 20B Code Base (8K) | 39±1 | local | ~15GB | | |
| 688 | Qwen1.5 7B Chat | 39±1 | local | ~9.7GB | +4 | |
| 689 | Code Llama 7B Python | 39±1 | local | ~5.8GB | | |
| 690 | Granite 3.2 2B Instruct | 39±1 | local | ~3GB | | |
| 691 | Falcon3 3B Instruct | 39±3 | local | ~3.4GB | | |
| 692 | Qwen2.5 Coder 0.5B Instruct | 39±1 | local | ~1GB | | |
| 693 | Vicuna 13B v1.5 | 38±1 | local | ~9.8GB | | |
| 694 | Zephyr 7B alpha | 38±1 | local | ~6.1GB | | |
| 695 | Code Llama 13B (base) | 38±1 | local | ~9.2GB | +1 | |
| 696 | Yi 1.5 6B Chat | 38±2 | local | ~4.4GB | | |
| 697 | Qwen2-VL 2B Instruct | 38±1 | local | ~2.1GB | | |
| 698 | WizardLM 13B V1.2 | 38±1 | local | ~9.8GB | | |
| 699 | Qwen2.5 1.5B Instruct | 38±1 | local | ~1.8GB | ~98 tok/s | +6 |
| 700 | Qwen3.5 0.8B | 38±1 | local | ~1.4GB | ~94 tok/s | +2 |
| 701 | Mistral 7B Instruct v0.2 | 38±1 | local | ~5.8GB | +9 | |
| 702 | Code Llama 7B Instruct | 38±1 | local | ~5.5GB | | |
| 703 | Tulu 2 7B | 38±2 | local | ~5.8GB | | |
| 704 |  MPT-30B-Chat | 38±2 | comparison only | | ||
| 705 | LFM2 700M | 38±1 | local | ~1GB | | |
| 706 | EXAONE 3.5 2.4B Instruct | 38±2 | local | ~3GB | | |
| 707 |  xDAN-L1-Chat-RL-v1 | 38±1 | local | ~6.1GB | | |
| 708 | Flan-PaLM 8B | 38±2† | never released | | ||
| 709 | LLaMA 33B | 37±1 | comparison only | +9 | ||
| 710 | Llama 3 8B (base) | 37±1 | local | ~6.6GB | | |
| 711 | Mistral 7B v0.1 (base) | 37±1 | local | ~5.8GB | +4 | |
| 712 | Flan-T5 XL | 37±1 | local | ~14GB | +8 | |
| 713 | Gemma 7B (base) | 37±1 | local | ~7.1GB | +3 | |
| 714 | Tulu 2 DPO 7B | 37±1 | local | ~5.8GB | | |
| 715 | Vicuna 13B v1.3 | 37±2 | local | ~29GB | | |
| 716 | DeepSeek R1 Distill Qwen 1.5B | 37±2 | local | ~1.9GB | +1 | |
| 717 | Granite 3.1 3B-A800M Instruct | 37±2† | local | ~3.6GB | ~23 tok/s | |
| 718 | Granite 3.0 3B-A800M Instruct | 37±1 | local | ~3.7GB | | |
| 719 | StarCoder2 7B | 37±1 | local | ~5.4GB | | |
| 720 | DeepSeek LLM 7B Chat | 37±2† | local | ~5.7GB | | |
| 721 | Vicuna 7B v1.1 | 37±2 | comparison only | | ||
| 722 | StarCoder 15.5B | 37±1 | local | ~11GB | | |
| 723 | Eurus-2-7B-SFT | 37±3† | local | ~6.4GB | | |
| 724 | Falcon 40B (base) | 36±1 | local | ~27GB | +2 | |
| 725 | Nous-Hermes-13b | 36±2 | local | ~9.8GB | | |
| 726 | PaLM 2 Chat (chat-bison@001) | 36±2 | comparison only | | ||
| 727 | Code Llama 7B (base) | 36±1 | local | ~5.5GB | +2 | |
| 728 | Llama 2 13B Chat | 36±1 | local | ~15GB | +10 | |
| 729 | Llama 2 13B (base) | 36±1 | local | ~9.3GB | +4 | |
| 730 | Zephyr 7B beta | 36±1 | local | ~6.1GB | +3 | |
| 731 |  Guanaco 33B | 35±1 | local | ~70GB | | |
| 732 | Qwen3 0.6B | 35±1 | local | ~1.9GB | ~182 tok/s | +4 |
| 733 | StarCoder2 3B | 35±1 | local | ~3.4GB | | |
| 734 | Vicuna 7B v1.5 | 35±1 | local | ~5.8GB | +1 | |
| 735 | Granite 3B Code Base (2K) | 35±1 | local | ~3.7GB | | |
| 736 | StarCoderBase 15.5B | 35±1 | local | ~12GB | | |
| 737 | Minerva 8B | 35±2† | never released | | ||
| 738 | OLMo 2 1B Instruct (0425) | 35±1 | local | ~2.4GB | | |
| 739 | ChatGLM3 6B 128K | 35±4 | local | ~5.8GB | | |
| 740 | Orca 2 13B | 35±3 | local | ~9.8GB | | |
| 741 | Vicuna 7B v1.3 | 35±2 | local | ~5.8GB | | |
| 742 |  Stable Code 3B | 35±1 | local | ~4.8GB | | |
| 743 |  T0 11B | 35±3 | comparison only | | ||
| 744 | Qwen1.5 4B Chat | 34±2 | local | ~4.1GB | | |
| 745 | DeepSeek-Coder 1.3B Base | 34±1 | local | ~2.4GB | | |
| 746 | Gemma 7B IT | 34±1 | local | ~7.1GB | +5 | |
| 747 | Mistral 7B Instruct v0.1 | 34±1 | local | ~5.9GB | +3 | |
| 748 | LaMDA 137B (pre-trained, LaMDA-PT) | 34±1† | never released | | ||
| 749 | GPT-3 text-davinci-001 | 34±1 | comparison only | +5 | ||
| 750 | CodeGemma 2B (v1.0) | 34±1 | local | ~3.2GB | | |
| 751 | Qwen2 1.5B Instruct | 34±1 | local | ~1.8GB | +1 | |
| 752 |  Ghost 7B Alpha | 34±2 | local | ~6.1GB | | |
| 753 | Falcon-H1 1.5B Instruct | 33±4 | local | ~2.4GB | | |
| 754 | Gemma 3 1B | 33±1 | local | ~1.7GB | ~98 tok/s | +7 |
| 755 | SmolLM2 1.7B Instruct | 33±1 | local | ~3GB | | |
| 756 | Qwen-7B (base) | 33±1 | local | ~6.6GB | | |
| 757 | LFM2 350M | 33±1 | local | ~1.7GB | | |
| 758 | OPT-175B | 33±1 | comparison only | | ||
| 759 | BLOOMZ 176B | 33±2 | comparison only | | ||
| 760 | Codex code-davinci-001 | 33±1 | comparison only | | ||
| 761 | StarCoderBase 7B | 33±1 | local | ~6GB | | |
| 762 | Llama 3.2 1B Instruct | 33±1 | api $0.020/M +local | ~1.6GB | ~28 tok/s | +13 |
| 763 | Phi-1.5 (1.3B) | 33±1 | local | ~2.4GB | | |
| 764 | LLaMA 13B | 32±1 | comparison only | +19 | ||
| 765 | Llama 2 7B Chat | 32±1 | local | ~8.8GB | +13 | |
| 766 | Qwen-7B-Chat | 32±1 | local | ~6.6GB | | |
| 767 | OLMo 7B Instruct | 32±2 | local | ~16GB | | |
| 768 | Llama 2 7B (base) | 32±1 | local | ~8.5GB | +6 | |
| 769 |  Koala 13B | 32±1 | comparison only | +1 | ||
| 770 | GPT-3 davinci (API base model) | 32±1 | comparison only | +13 | ||
| 771 | Flan-T5 Large | 32±1 | local | ~4.8GB | +5 | |
| 772 | Granite 3.1 1B-A400M Instruct | 31±2† | local | ~2.3GB | ~20 tok/s | |
| 773 | Falcon 40B Instruct | 31±2 | local | ~27GB | | |
| 774 | Gemma 2B (base) | 31±1 | local | ~3.2GB | +3 | |
| 775 | Gemma 1.1 2B IT | 31±1 | local | ~3.2GB | +1 | |
| 776 | Falcon 7B (base) | 31±1 | local | ~5.9GB | +4 | |
| 777 |  Alpaca 7B | 31±1 | comparison only | | ||
| 778 |  Baichuan2-7B-Base | 30±1 | local | ~17GB | | |
| 779 | NexusRaven V2 13B | 30±3 | local | ~9.3GB | | |
| 780 | MPT-7B (base) | 30±1 | comparison only | | ||
| 781 | LLaMA 7B | 30±1 | comparison only | +17 | ||
| 782 | ChatGLM3-6B | 30±2 | local | ~5.8GB | | |
| 783 | Qwen2.5 0.5B Instruct | 30±2 | local | ~1GB | +1 | |
| 784 | OLMo 7B | 30±1† | local | ~30GB | | |
| 785 |  OpenLLaMA 7B v2 | 30±1 | local | ~9.1GB | | |
| 786 | StableLM-3B-4E1T | 30±1 | local | ~3.3GB | | |
| 787 | StarCoderBase 3B | 30±1 | local | ~3.4GB | | |
| 788 | Granite 3.0 1B-A400M Instruct | 30±1 | local | ~2.3GB | | |
| 789 | OPT-66B | 30±1 | local | ~141GB | +2 | |
| 790 | MPT-7B-Chat | 30±2 | comparison only | | ||
| 791 | StableLM-Base-Alpha 7B v2 | 30±1 | local | ~30GB | | |
| 792 |  GPT4All-13B-Snoozy | 29±2 | local | ~56GB | | |
| 793 | Alpaca 13B | 29±2 | comparison only | | ||
| 794 | EuroLLM 1.7B Instruct | 29±3 | local | ~2.4GB | | |
| 795 | Granite 4.0 H 350M | 29±1† | local | ~1.7GB | | |
| 796 | BLOOMZ 7.1B | 29±2 | comparison only | | ||
| 797 | BLOOM 176B | 29±1 | local | ~372GB | +1 | |
| 798 | Gemma 2B IT | 29±1 | local | ~3.1GB | +3 | |
| 799 | Granite 4.0 350M | 28±1 | local | ~1.7GB | | |
| 800 | OPT-30B | 28±1 | local | ~64GB | +5 | |
| 801 | UL2 20B | 28±3† | comparison only | | ||
| 802 |  GPT-NeoX-20B | 28±1 | local | ~14GB | +1 | |
| 803 | Qwen2 0.5B Instruct | 28±2 | local | ~1GB | | |
| 804 |  RedPajama-INCITE 7B Base | 28±1 | local | ~16GB | | |
| 805 | ChatGLM2-6B | 28±2 | local | ~15GB | | |
| 806 |  RWKV-4-Raven 14B | 28±2 | comparison only | | ||
| 807 | LaMDA 68B (pre-trained) | 27±1† | never released | | ||
| 808 | BLOOMZ 3B | 27±2 | comparison only | | ||
| 809 | Qwen1.5 1.8B Chat | 26±2 | local | ~2.7GB | | |
| 810 | Tk-Instruct 11B (def) | 26±4 | comparison only | | ||
| 811 | Falcon3 1B Instruct | 26±4 | local | ~2.4GB | | |
| 812 | OPT-13B (13 billion parameters) | 26±1 | local | ~29GB | +4 | |
| 813 | PaLM 8B | 26±1† | never released | | ||
| 814 | Falcon 7B Instruct | 26±2 | local | ~5.9GB | +1 | |
| 815 |  OpenAssistant SFT-4 Pythia 12B | 25±1 | local | ~9.5GB | +1 | |
| 816 | GPT-3 curie (API base model) | 25±1 | comparison only | +1 | ||
| 817 | RedPajama-INCITE Base 3B v1 | 25±3 | local | ~3.4GB | | |
| 818 | Pythia 12B | 25±1 | local | ~9.5GB | +1 | |
| 819 | Flan-T5 Base | 25±1 | local | ~2.5GB | +3 | |
| 820 | OpenLLaMA 3B v2 | 25±1 | local | ~4.2GB | | |
| 821 | GPT-J 6B | 25±1 | local | ~14GB | +6 | |
| 822 | ChatGLM-6B | 25±1 | local | ~16GB | +3 | |
| 823 | StableLM-Base-Alpha 3B v2 | 24±1 | local | ~13GB | | |
| 824 | OPT-6.7B | 24±1 | local | ~16GB | +5 | |
| 825 | T0 3B | 23±4 | comparison only | | ||
| 826 | BLOOMZ 1.7B | 23±3 | comparison only | | ||
| 827 | Qwen1.5 0.5B Chat | 23±3 | local | ~1.7GB | | |
| 828 | Pythia 6.9B | 23±1 | local | ~6.1GB | +2 | |
| 829 | T0++ (T0pp) 11B | 23±3 | comparison only | | ||
| 830 | Phi-1 (1.3B) | 22±4 | local | ~2.4GB | | |
| 831 | Dolly v2 12B | 22±1 | comparison only | +3 | ||
| 832 | SmolLM2 360M Instruct | 22±3 | local | ~1GB | | |
| 833 | FastChat-T5 3B | 21±2 | local | ~8.5GB | | |
| 834 | BLOOM 7.1B | 21±1 | local | ~7.1GB | +7 | |
| 835 | OLMo 1B | 21±2† | local | ~2.2GB | | |
| 836 | Pythia 2.8B | 20±1 | local | ~3.4GB | | |
| 837 | Pythia 2.8B (deduped) | 20±1 | local | ~3.4GB | | |
| 838 | Falcon-RW 1B | 20±2 | local | ~4.3GB | | |
| 839 | OPT-2.7B | 19±1 | local | ~7.1GB | +3 | |
| 840 | GPT-Neo 2.7B | 18±1 | local | ~13GB | +8 | |
| 841 | StableLM-Tuned-Alpha 7B | 18±2 | local | ~6.9GB | | |
| 842 | BLOOMZ 1.1B | 18±3 | comparison only | | ||
| 843 | T5 Large | 17±2 | local | ~4.6GB | | |
| 844 | Gemma 3 270M IT | 16±4 | local | ~1.1GB | | |
| 845 | BLOOM 3B | 16±1 | local | ~4GB | +2 | |
| 846 | Flan-T5 Small | 16±3 | local | ~1.8GB | | |
| 847 | GPT-3 babbage (API base model) | 16±1 | comparison only | | ||
| 848 | BLOOMZ 560M | 15±4 | comparison only | | ||
| 849 | OPT-1.3B | 14±1 | local | ~4.3GB | +5 | |
| 850 | T5 Base | 14±3 | local | ~2.4GB | | |
| 851 | Pythia 1.4B | 14±1 | local | ~2.4GB | | |
| 852 | LaMDA 8B (pre-trained) | 12±2† | never released | | ||
| 853 | Pythia 1B | 12±1 | local | ~2.2GB | | |
| 854 | GPT-3 text-curie-001 | 12±1 | comparison only | +3 | ||
| 855 | GPT-Neo 1.3B | 12±2 | local | ~7.1GB | +3 | |
| 856 | T5 Small | 12±3 | local | ~1.8GB | | |
| 857 | BLOOM 1.7B | 11±1 | local | ~3.1GB | +1 | |
| 858 |  Zyte-1B | 10±3 | local | ~2.2GB | | |
| 859 | LaMDA 2B (pre-trained) | 10±2† | never released | | ||
| 860 | StableLM-Base-Alpha 7B | 8±1 | local | ~35GB | | |
| 861 | Pythia 410M | 8±2 | local | ~1.8GB | | |
| 862 | GPT-3 ada (API base model) | 8±1 | comparison only | | ||
| 863 | BLOOM 1.1B | 7±1 | local | ~2.6GB | | |
| 864 | GPT-2 XL (1.5B) | 7±1 | local | ~2.8GB | ~75 tok/s | +9 |
| 865 | GPT-3 text-babbage-001 | 4±2 | comparison only | | ||
| 866 | GPT-3 text-ada-001 | 1±3 | comparison only | | ||
| 867 | OPT-350M | 1±1 | local | ~2.2GB | +1 | |
| 868 | LaMDA 422M (pre-trained) | 1±3† | never released | | ||
| 869 | StableLM-Base-Alpha 3B | 1±2 | local | ~17GB | | |
| 870 | BLOOM 560M | 0±1 | local | ~2.1GB | +1 | |
| 871 | Pythia 160M | -2±2 | local | ~1.6GB | | |
| 872 | GPT-2 Large (774M) | -3±1 | local | ~2GB | ~137 tok/s | +3 |
| 873 | OPT-125M | -3±1 | local | ~1.8GB | +1 | |
| 874 | GPT-Neo 125M | -3±2 | local | ~2.1GB | | |
| 875 | GPT-2 Medium (355M) | -5±1 | local | ~1.8GB | +3 | |
| 876 | Pythia 70M | -13±2 | local | ~1.6GB | | |
| 877 | GPT-2 Small (124M) | -13±2 | local | ~1.6GB | +3 | |
| — | Grok Build 0.1 | no reviewed results | api $1.25/M | |||
| — |  K2 Horizon 7B | not scored yet | local | ~8GB |
+ 305 models with fewer than 3 results left off, since one or two tests say little about overall ability · show them
Includes 231 comparison-only models with no verified API or download · hide them
879 of 1212 catalogue models listed here · sources and licences
Models outside this leaderboard (28 models)
No current run option verified: GPT-3 Small (125M, Brown et al. 2020 paper model) · GPT-3 Medium (350M, Brown et al. 2020 paper model) · GPT-3 Large (760M, Brown et al. 2020 paper model) · GPT-3 XL (1.3B, Brown et al. 2020 paper model) · GPT-3 2.7B (Brown et al. 2020 paper model) · GPT-3 6.7B (Brown et al. 2020 paper model) · GPT-3 13B (Brown et al. 2020 paper model) · GPT-3 175B (Brown et al. 2020 paper model) · Jurassic-1 Jumbo (J1-Jumbo, 178B) · Jurassic-1 Large (J1-Large, 7.5B) · Gopher (280B) · Chinchilla (70B) · GLaM 0.1B/64E (MoE) · GLaM 1.7B/64E (MoE) · GLaM 8B/64E (MoE) · GLaM (64B/64E, 1.2T MoE) · GLaM dense 0.1B · GLaM dense 1.7B · GLaM dense 8B · GLaM dense 137B · Luminous Base (13B) · Luminous Extended (30B) · Luminous Supreme (70B) · Gopher family 417M · Gopher family 1.4B · Gopher family 7.1B · Gopher family 44M · Gopher family 117M
* new or thinly tested: ranked on too few benchmark results · † only the maker’s own numbers so far · ~RAM is estimated; full context may need more memory