whatmodel.sh · find the best AI models you can run

Best AI models for math for a 64GB graphics card

A leaderboard of the best AI models for math for a 64GB graphics card (with 32GB of system RAM). The best one that runs on it right now is INTELLECT-3, followed by GLM-4.7 and Qwen3-Coder-Next (80B-A3B). Models are ranked on math tests, from competition problems like AIME to research problems like FrontierMath. Models that run on it show the download that fits and the command to run it.

415 models · scores combine 59 benchmarks · updated how it works · find a leaderboard · benchmark your machine

Scores use reviewed math evaluations only. Compare scores within this task. Models without task measurements are excluded.

Models for 32GB RAM · 64GB graphics card → ~64GB fast · reset
+ more
$ terminal

detecting your OS…

Score vs API price

#modeltask score↓where↓speed↓RAM↓context↓get itsources
1GPT-6 Astra OpenAI92±1api $20.00/M1.1Mplatform.openai.com ↗MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsEpoch AI — internal evaluations
2GPT-6.1 Sol OpenAI90±2api $4.00/M1.1Mdevelopers.openai.com ↗Epoch AI — internal evaluations
3Claude Opus 5.5 Anthropic86±1api $8.00/M1Mdocs.anthropic.com ↗Epoch AI — internal evaluations
4Claude Fable 5.1 Anthropic84±1api $20.00/M1Mdocs.anthropic.com ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
5GPT-6 Sol OpenAI84±1api $4.00/M1.1Mplatform.openai.com ↗Epoch AI — internal evaluations
6Claude Fable 5 Anthropic82±1api $20.00/M1Mdocs.anthropic.com ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
7GPT-5.6 Sol OpenAI82±1api $8.00/M1.1Mplatform.openai.com ↗Epoch AI — internal evaluationsOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
8Claude Sonnet 5.5 Anthropic81±1api $4.00/M1Mplatform.claude.com ↗Epoch AI — internal evaluations
9Claude Mythos Preview (limited preview) Anthropic81±7*†limited preview1MAnthropic system cards and model announcements (lab-reported scores)
10GPT-5.5 Pro OpenAI81±1*api $67.50/M1.1Mdevelopers.openai.com ↗Epoch AI — internal evaluations
11GPT-5.5 OpenAI80±1api $11.25/M1.1Mplatform.openai.com ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsMathConstraint: Automated Generation of Verified Combinatorial Reasoning Instances for LLMs — authors' own model runsmeituan-longcat/LongCat-2.0 model card
12Claude Opus 5 Anthropic80±1api $10.00/M1Mdocs.anthropic.com ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
13GPT-5.6 Terra OpenAI79±1api $4.50/M1.1Mplatform.openai.com ↗Epoch AI — internal evaluationsOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
14GPT-5.4 Pro OpenAI77±1api $67.50/M1.1Mdevelopers.openai.com ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
15GPT-5.6 Luna OpenAI77±1api $0.45/M1.1Mplatform.openai.com ↗Epoch AI — internal evaluationsOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
16GPT-6 Luna OpenAI76±1api $0.20/M1.1Mplatform.openai.com ↗Epoch AI — internal evaluations
17Claude Opus 4.8 Anthropic76±1api $10.00/M1Mdocs.anthropic.com ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsAnthropic system cards and model announcements (lab-reported scores)meituan-longcat/LongCat-2.0 model card
18GPT-5.4 OpenAI75±1api $5.63/M1.1Mplatform.openai.com ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
19Qwen3.8 Max (2.4T-A95B) Alibaba75±1api $3.00/M~380GB262kdeepinfra.com ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
21Claude Haiku 5.5 Anthropic74±1api $0.20/M1Mplatform.claude.com ↗Epoch AI — internal evaluations
22GPT-5.2 Pro OpenAI74±1*api $57.75/M400kdevelopers.openai.com ↗Epoch AI — internal evaluations
23Muse Spark 1.3 Meta74±1api $2.00/M1Mdev.meta.ai ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
24Kimi K3 Moonshot AI74±1api $6.00/M~884GB1Mplatform.moonshot.ai ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
25Gemini 3.7 Flash Google72±1api $1.50/M1Mai.google.dev ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
26Qwen3.8 Max (0902) Alibaba72±1api $3.00/M1Mwww.alibabacloud.com ↗Epoch AI — internal evaluations
27Qwen3.7 Max Alibaba72±1api $3.75/M1Mdeepinfra.com ↗Epoch AI — internal evaluations
28Grok 4.6 SpaceXAI (xAI)72±1api $3.00/M500kdocs.x.ai ↗Epoch AI — internal evaluations
29GLM-5.3 Z.ai72±1api $2.15/M~239GB1Mdocs.z.ai ↗Epoch AI — internal evaluations
30Gemini 3.1 Pro (Preview) Google71±1api $4.50/M1Mai.google.dev ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsMathConstraint: Automated Generation of Verified Combinatorial Reasoning Instances for LLMs — authors' own model runsMathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval — authors' own model runsmeituan-longcat/LongCat-2.0 model card
31Gemini 3.8 Flash Google71±1api $1.50/M1Mai.google.dev ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
32GPT-5.2 OpenAI71±1api $4.81/M400kplatform.openai.com ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsQwen/Qwen3.5-397B-A17B model cardFormalProofBench (Vals AI, arXiv:2603.26996v1)
33DeepSeek V4.1 Flash DeepSeek71±1api $0.26/M~537GB1Mapi-docs.deepseek.com ↗Epoch AI — internal evaluationsdeepseek-ai/DeepSeek-V4.1-Flash model card
34DeepSeek V4 Pro (0813) DeepSeek71±1api $1.63/M~1010GB1Mdeepinfra.com ↗Epoch AI — internal evaluationsdeepseek-ai/DeepSeek-V4.1-Flash model card
35Claude Sonnet 5 Anthropic71±1api $4.00/M1Mdocs.anthropic.com ↗Epoch AI — internal evaluationsAnthropic system cards and model announcements (lab-reported scores)
36Muse Spark 1.1 Meta70±2*api $2.00/M1Mdev.meta.ai ↗MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
37Grok 4.5 SpaceXAI (xAI)70±1api $3.00/M500kdocs.x.ai ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
38Claude Opus 4.6 Anthropic70±1api $10.00/M1Mdocs.anthropic.com ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsMathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval — authors' own model runs
39Claude Opus 4.7 Anthropic70±1api $10.00/M1Mdocs.anthropic.com ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsMathConstraint: Automated Generation of Verified Combinatorial Reasoning Instances for LLMs — authors' own model runsAnthropic system cards and model announcements (lab-reported scores)meituan-longcat/LongCat-2.0 model card
40DeepSeek V4 Flash (0731) DeepSeek70±1api $0.11/M~92GB1Mdeepinfra.com ↗Epoch AI — internal evaluationsdeepseek-ai/DeepSeek-V4.1-Flash model card
41Gemini 3.5 Flash Google70±1api $3.38/M1Mai.google.dev ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
42Kimi K2.6 Moonshot AI70±1api $1.71/M~317GB262kplatform.moonshot.ai ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsNVIDIA — Nemotron 3 Ultra technical reportMathConstraint: Automated Generation of Verified Combinatorial Reasoning Instances for LLMs — authors' own model runsA.X K2 Technical Report (SK Telecom), arXiv 2608.30181v1
43GLM-5.2 Z.ai69±1api $2.15/M~121GB1Mdocs.z.ai ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetszai-org/GLM-5.2 model card
45Gemini 3.6 Flash Google69±1api $1.50/M1Mai.google.dev ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
46GPT-5 OpenAI69±1api $3.44/M400kplatform.openai.com ↗Epoch AI — internal evaluationsMathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval — authors' own model runsFormalProofBench (Vals AI, arXiv:2603.26996v1)
48GPT-5 Pro OpenAI69±1*api $41.25/M400kdevelopers.openai.com ↗Epoch AI — internal evaluations
49GLM-5.3-Flash Z.ai69±1api $0.24/M~103GB1Mdocs.z.ai ↗Epoch AI — internal evaluations
50Grok 4.7 SpaceXAI (xAI)68±1api $3.00/M500kdocs.x.ai ↗Epoch AI — internal evaluations
53Gemini 3 Flash (Preview) Google68±1api $1.13/M1Mai.google.dev ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsFormalProofBench (Vals AI, arXiv:2603.26996v1)
54Kimi K2.7 Code Moonshot AI68±1api $1.71/M~359GB262kplatform.kimi.ai ↗Epoch AI — internal evaluations
55INTELLECT-3 · 2-bit Prime Intellect67±2†local~48GBllama.cpp › Prime Intellect INTELLECT-3 model card: Evaluation table (Environments Hub runs)
56Grok 4.20 (0309 reasoning) SpaceXAI (xAI)67±1api $1.56/M1Mdocs.x.ai ↗Epoch AI — internal evaluations
57Inkling Small (266B-A12B) Thinking Machines67±1api $0.64/M +local~86GB1Mdeepinfra.com ↗Epoch AI — internal evaluationsthinkingmachines/Inkling-Small model card
58GLM-4.7 · 1-bit Z.ai67±2local~58GB205kllama.cpp › zai-org/GLM-4.7 model cardGLM-5 Team (Zhipu AI) — GLM-5 technical reportEpoch AI — internal evaluationsFormalProofBench (Vals AI, arXiv:2603.26996v1)
59GPT-5.4 mini OpenAI67±1api $1.69/M400kplatform.openai.com ↗Epoch AI — internal evaluations
60LongCat 2.0 (1.6T-A48B) Meituan67±6*†api $1.30/M~2155GB1Mlongcat.chat ↗meituan-longcat/LongCat-2.0 model card
63Grok 4.3 SpaceXAI (xAI)67±1api $1.56/M1Mdocs.x.ai ↗Epoch AI — internal evaluations
64GPT-5 mini OpenAI66±1api $0.69/M400kplatform.openai.com ↗Epoch AI — internal evaluationsMathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval — authors' own model runsQwen/Qwen3.5-27B model cardFormalProofBench (Vals AI, arXiv:2603.26996v1)
65GPT-5.4 nano OpenAI66±1api $0.46/M400kplatform.openai.com ↗Epoch AI — internal evaluations
66Qwen3-Coder-Next (80B-A3B) · 4-bit Alibaba66±5*local~52GB262kOllama › Vector Institute Evaluation Leaderboard (Inspect Evals runs)
67Qwen3.6 Max Preview Alibaba66±4*api $2.92/M256kwww.alibabacloud.com ↗Epoch AI — internal evaluations
68o3-pro OpenAI66±4*†api $35.00/M200kdevelopers.openai.com ↗OpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
69Qwen3.6 Plus Alibaba66±1api $1.13/M1Mdocs.together.ai ↗Epoch AI — internal evaluationsMathConstraint: Automated Generation of Verified Combinatorial Reasoning Instances for LLMs — authors' own model runs
70Qwen3 235B-A22B Thinking 2507 Alibaba66±1api $0.97/M +local~76GB131knovita.ai ↗Meituan LongCat-Flash-Thinking model card (evaluation table)Qwen3-VL-235B-A22B-Thinking model cardQwen/Qwen3-Next-80B-A3B-Thinking model cardEpoch AI — internal evaluationsQwen/Qwen3-235B-A22B-Thinking-2507 model card
71EXAONE 4.5 33B · 8-bit LG AI Research65±4*†local~45GB262kllama.cpp › LG AI Research vendor-reported benchmark scores for its own EXAONE models (Hugging Face model cards)
72Kimi K2.5 Moonshot AI65±2api $1.20/M~160GB262kdocs.aws.amazon.com ↗MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsEpoch AI — internal evaluationsQwen/Qwen3.5-397B-A17B model card
73GLM-5 Z.ai65±1api $1.55/M~119GB205kdocs.z.ai ↗MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsGLM-5 Team (Zhipu AI) — GLM-5 technical reportzai-org/GLM-5.1 model cardEpoch AI — internal evaluations
74Granite 4.2 30B · 8-bit IBM65±3*†local~39GB131kOllama › ibm-granite/granite-4.2-30b model card
77GLM-5.1 Z.ai65±1api $2.15/M~119GB200kdocs.z.ai ↗Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetszai-org/GLM-5.2 model cardzai-org/GLM-5.1 model cardNVIDIA — Nemotron 3 Ultra technical reportA.X K2 Technical Report (SK Telecom), arXiv 2608.30181v1
79GPT-5.1 OpenAI65±3*api $3.44/M400kplatform.openai.com ↗Epoch AI — internal evaluations
80DeepSeek V3.2 DeepSeek65±2api $0.29/M~110GB128kdeepinfra.com ↗MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsdeepseek-ai/DeepSeek-V3.2 model cardEpoch AI — internal evaluationsMathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval — authors' own model runsFormalProofBench (Vals AI, arXiv:2603.26996v1)
81Qwen3.5 122B-A10B Alibaba64±2†api $1.10/M +local~79GB262kwww.alibabacloud.com ↗Qwen/Qwen3.5-122B-A10B model cardQwen/Qwen3.5-27B model card
82Step 3.5 Flash (196B-A11B) StepFun64±1api $0.15/M~126GB256kplatform.stepfun.ai ↗MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsstepfun-ai/Step-3.5-Flash model card
83Qwen3.7 Plus Alibaba64±1*api $0.70/M1Mwww.alibabacloud.com ↗Epoch AI — internal evaluations
84Qwen3.6 27B · 8-bit Alibaba64±1local~37GB262kOllama › Epoch AI — internal evaluationsQwen/Qwen3.6-27B model card
85o4-mini OpenAI64±1api $1.93/M200kplatform.openai.com ↗Epoch AI — internal evaluationsQwen/Qwen3-235B-A22B-Thinking-2507 model cardOpenAI simple-evals README benchmark results (OpenAI's own models)
86Qwen3.5 Plus Alibaba64±3*api $0.90/M1Mwww.alibabacloud.com ↗Epoch AI — internal evaluations
87o3 OpenAI64±1api $3.50/M200kplatform.openai.com ↗Epoch AI — internal evaluationsMeituan LongCat-Flash-Thinking model card (evaluation table)OpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)Qwen/Qwen3-235B-A22B-Thinking-2507 model cardOpenAI simple-evals README benchmark results (OpenAI's own models)
88Qwen3.5 397B-A17B Alibaba64±1api $1.09/M +local~65GB262kdeepinfra.com ↗Epoch AI — internal evaluationsQwen/Qwen3.5-397B-A17B model cardMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsNVIDIA — Nemotron 3 Ultra technical reportQwen/Qwen3.6-27B model cardLGAI-EXAONE/K-EXAONE-2.0-750B-A37B model card+1
90Gemini 2.5 Flash Google64±2api $0.85/M1Mai.google.dev ↗Meituan LongCat-Flash-Chat model card (evaluation table)MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval — authors' own model runs
91GLM-4.6 · 1-bit Z.ai64±2†local~58GB205kllama.cpp › zai-org/GLM-4.7 model cardzai-org/GLM-4.6 model card
92Spark-X2.5 4B · 16-bit iFLYTEK (SparkLLM)64±2†local~10GB1MOllama › XHToken/Spark-X2.5-4B model card
94Inkling (975B-A41B) Thinking Machines64±1api $1.73/M~156GB1Mdeepinfra.com ↗Epoch AI — internal evaluationsthinkingmachines/Inkling-Small model card
95Grok 4.1 Fast (Reasoning) SpaceXAI (xAI)64±2api $0.28/M128kazure.microsoft.com ↗MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsFormalProofBench (Vals AI, arXiv:2603.26996v1)
96Qwen3 235B-A22B Instruct 2507 Alibaba63±1api $0.20/M +local~76GB262kdeepinfra.com ↗Meituan LongCat-Flash-Chat model card (evaluation table)Qwen/Qwen3-Next-80B-A3B-Instruct model cardQwen3-VL-235B-A22B-Instruct model cardQwen/Qwen3-235B-A22B-Instruct-2507 model card
97DeepSeek V3.1 DeepSeek63±1api $0.42/M~110GB131kdeepinfra.com ↗Meituan LongCat-Flash-Thinking model card (evaluation table)deepseek-ai/DeepSeek-V3.1 model cardMeituan LongCat-Flash-Chat model card (evaluation table)
98GLM-4.5-Air · 2-bit Z.ai63±2local~35GB131kllama.cpp › Prime Intellect INTELLECT-3 model card: Evaluation table (Environments Hub runs)GLM-4.5 Team (Zhipu AI & Tsinghua) — GLM-4.5 technical report
99Qwen3.5 27B · 8-bit Alibaba63±1local~37GB262kOllama › MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsQwen/Qwen3.5-122B-A10B model cardQwen/Qwen3.6-27B model cardQwen/Qwen3.6-35B-A3B model cardQwen/Qwen3.5-27B model card
100Claude Opus 4.5 Anthropic63±1api $10.00/M200kdocs.anthropic.com ↗Epoch AI — internal evaluationsQwen/Qwen3.5-397B-A17B model cardFormalProofBench (Vals AI, arXiv:2603.26996v1)
101Nemotron Cascade 2 30B-A3B · 8-bit NVIDIA63±2†local~37GB256kllama.cpp › NVIDIA — Nemotron-Cascade 2 technical report
104Gemma 4 26B-A4B · 8-bit Google63±2local~30GB262kllama.cpp › Epoch AI — internal evaluationsgoogle/diffusiongemma-26B-A4B-it model cardGemma Team — Gemma 4 Technical Report
105Qwen3-Next 80B-A3B Instruct · 4-bit Alibaba63±3†local~52GB131kOllama › Qwen/Qwen3-Next-80B-A3B-Instruct model card
106DeepSeek R1 0528 DeepSeek63±1api $0.91/M~110GB164kdeepinfra.com ↗Epoch AI — internal evaluationsPrime Intellect INTELLECT-3 model card: Evaluation table (Environments Hub runs)deepseek-ai/DeepSeek-R1-0528 model carddeepseek-ai/DeepSeek-V3.1 model carddeepseek-ai/DeepSeek-R1-0528-Qwen3-8B model card
107Kimi K2 Thinking Moonshot AI63±3*api $1.07/M~160GB262kdocs.aws.amazon.com ↗Epoch AI — internal evaluationsstepfun-ai/Step-3.5-Flash model card
108Step 3.7 Flash (198B-A11B) StepFun63±1api $0.44/M~104GB256kplatform.stepfun.ai ↗MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
110gpt-oss-120b OpenAI62±1api $0.26/M +local~67GB131kconsole.groq.com ↗Prime Intellect INTELLECT-3 model card: Evaluation table (Environments Hub runs)OpenAI — gpt-oss-120b & gpt-oss-20b Model CardEpoch AI — internal evaluationsMathConstraint: Automated Generation of Verified Combinatorial Reasoning Instances for LLMs — authors' own model runs
111Command A+ (05-2026) Cohere62±2api price unknown +local~71GB128kdocs.cohere.com ↗Solar Open 2 Technical Report (Upstage, arXiv:2607.20062v2)Cohere vendor-reported benchmark scores for its own models (cohere.com blog)
112Qwen3-VL 32B Thinking · 8-bit Alibaba62±2local~39GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)allenai/Olmo-3.1-32B-Think model card
113Claude Haiku 4.5 Anthropic62±1*api $2.00/M200kdocs.anthropic.com ↗Epoch AI — internal evaluations
114Claude Sonnet 4.5 Anthropic62±1api $6.00/M200kdocs.anthropic.com ↗Epoch AI — internal evaluationsQwen/Qwen3.5-27B model cardFormalProofBench (Vals AI, arXiv:2603.26996v1)
115Nemotron 3 Ultra 550B-A55B NVIDIA62±2api $1.35/M~89GB1Mdocs.together.ai ↗Epoch AI — internal evaluationsNVIDIA — Nemotron 3 Ultra technical reportA.X K2 Technical Report (SK Telecom), arXiv 2608.30181v1
117Nemotron-Labs-3 Puzzle 75B-A9B · 4-bit NVIDIA62±3*†local~56GBllama.cpp › NVIDIA vendor-reported benchmark scores for its own Nemotron models (Hugging Face model cards)
118GLM-4.5 · 1-bit Z.ai62±1local~58GB131kllama.cpp › Meituan LongCat-Flash-Thinking model card (evaluation table)Prime Intellect INTELLECT-3 model card: Evaluation table (Environments Hub runs)GLM-4.5 Team (Zhipu AI & Tsinghua) — GLM-4.5 technical reportzai-org/GLM-4.6 model card
120Olmo 3.1 32B Think · 8-bit Ai262±2†local~43GB66kOllama › Olmo 3allenai/Olmo-3.1-32B-Think model card
121Qwen3-Max (2025-09-23) Alibaba62±1api $2.40/M262kwww.alibabacloud.com ↗Epoch AI — internal evaluations
122Gemini 3.1 Flash-Lite Google62±1api $0.56/M1Mai.google.dev ↗Epoch AI — internal evaluationsMathConstraint: Automated Generation of Verified Combinatorial Reasoning Instances for LLMs — authors' own model runs
123Gemma 4 31B · 8-bit Google61±2local~36GB262kllama.cpp › Epoch AI — internal evaluationsGemma Team — Gemma 4 Technical Report
125Nemotron 3 Super 120B-A12B NVIDIA61±1api $0.28/M +local~78GB262kdocs.aws.amazon.com ↗NVIDIA — Nemotron-Cascade 2 technical reportMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsNVIDIA vendor-reported benchmark scores for its own Nemotron models (Hugging Face model cards)
126Gemini 2.5 Pro Google61±1api $3.44/M1Mai.google.dev ↗Epoch AI — internal evaluationsMeituan LongCat-Flash-Thinking model card (evaluation table)
127o3-mini OpenAI61±1api $1.93/M200kdevelopers.openai.com ↗Epoch AI — internal evaluationsMicrosoft — Phi-4-reasoning Technical ReportVector Institute Evaluation Leaderboard (Inspect Evals runs)OpenAI simple-evals README benchmark results (OpenAI's own models)
128Nemotron-Cascade-14B-Thinking · 8-bit NVIDIA61±2*†local~18GBllama.cpp › NVIDIA — Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Models
130Granite 4.2 8B · 8-bit IBM61±3*†local~11GB131kllama.cpp › ibm-granite/granite-4.2-30b model card
131Falcon-H1R 7B · 8-bit TII61±2†local~12GB262kllama.cpp › Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scaling
132Qwen3-Next 80B-A3B Thinking · 4-bit Alibaba61±2†local~52GB131kOllama › Qwen/Qwen3-Next-80B-A3B-Thinking model cardQwen/Qwen3.5-9B model card
133Qwen3-VL 30B-A3B Thinking · 8-bit Alibaba61±3*†local~37GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
134Qwen3.5 35B-A3B · 8-bit Alibaba61±1local~47GB262kOllama › NVIDIA — Nemotron-Cascade 2 technical reportQwen/Qwen3.5-122B-A10B model cardMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsQwen/Qwen3.6-35B-A3B model cardEpoch AI — internal evaluationsQwen/Qwen3.5-27B model card
135Qwen3.6 35B-A3B · 8-bit Alibaba61±1local~40GB262kllama.cpp › Epoch AI — internal evaluationsMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsQwen/Qwen3.6-27B model cardQwen/Qwen3.6-35B-A3B model card
137GPT-5 nano OpenAI60±1api $0.14/M400kplatform.openai.com ↗Epoch AI — internal evaluationsMathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval — authors' own model runsQwen/Qwen3.5-4B model cardFormalProofBench (Vals AI, arXiv:2603.26996v1)
139Nemotron-Cascade-8B · 8-bit NVIDIA60±2*†local~11GBllama.cpp › NVIDIA — Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Models
140Qwen3.7 Flash Alibaba60±1*api $0.055/M1Mwww.alibabacloud.com ↗Epoch AI — internal evaluations
141Kimi K2 Instruct (0711) Moonshot AI60±2*api $1.00/M~160GB131knovita.ai ↗Meituan LongCat-Flash-Chat model card (evaluation table)
143Olmo 3 32B Think · 8-bit Ai260±1†local~43GB66kOllama › Olmo 3allenai/Olmo-3.1-32B-Think model card
144o1 (2024-12-17) OpenAI60±1api $26.25/M200kdevelopers.openai.com ↗Epoch AI — internal evaluationsMicrosoft — Phi-4-reasoning Technical ReportVector Institute Evaluation Leaderboard (Inspect Evals runs)OpenAI simple-evals README benchmark results (OpenAI's own models)
145Gemini 3.5 Flash-Lite Google60±1api $0.85/M1Mai.google.dev ↗Epoch AI — internal evaluations
146gpt-oss-20b · MXFP4 OpenAI60±1local~15GB131kOllama › Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time ScalingByteDance-Seed/Seed-OSS-36B-Instruct model cardEpoch AI — internal evaluationsOpenAI — gpt-oss-120b & gpt-oss-20b Model Card
147MiniCPM5 2B · 8-bit OpenBMB60±2†local~4.3GB131kllama.cpp › openbmb/MiniCPM5-2B model card
148MiniMax-M3 MiniMax60±2*api $0.48/M~137GB1Mdeepinfra.com ↗Epoch AI — internal evaluations
149Seed-OSS 36B Instruct · 8-bit ByteDance Seed60±2local~48GB524kllama.cpp › ByteDance-Seed/Seed-OSS-36B-Instruct model cardEpoch AI — internal evaluations
150Qwen3 30B-A3B Instruct 2507 · 8-bit Alibaba59±1local~41GB262kOllama › Qwen/Qwen3-30B-A3B-Instruct-2507 model cardEpoch AI — internal evaluationsQwen/Qwen3-Next-80B-A3B-Instruct model card
152Qwen3.6 Flash Alibaba59±1*api $0.56/M1Mwww.alibabacloud.com ↗Epoch AI — internal evaluations
153Nemotron 3 Nano 30B-A3B · 8-bit NVIDIA59±2†local~42GB262kOllama › NVIDIA — Nemotron-Cascade 2 technical report
155Qwen3.5 9B · 8-bit Alibaba59±1local~12GB262kllama.cpp › XHToken/Spark-X2.5-4B model cardMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsQwen/Qwen3.5-9B model cardEpoch AI — internal evaluationsLiquidAI/LFM2.5-2.6B model cardQwen/Qwen3.5-4B model card
156Qwen3 14B · 8-bit Alibaba59±2*local~21GB33kOllama › Epoch AI — internal evaluations
157QwQ-32B · 8-bit Alibaba58±2local~43GB131kOllama › Epoch AI — internal evaluations2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct models
158Qwen3-VL 8B Thinking · 8-bit Alibaba58±2local~12GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)allenai/Olmo-3-7B-Think model card
159Claude Sonnet 4.6 Anthropic58±2api $6.00/M1Mdocs.anthropic.com ↗Epoch AI — internal evaluationsAnthropic system cards and model announcements (lab-reported scores)MathConstraint: Automated Generation of Verified Combinatorial Reasoning Instances for LLMs — authors' own model runs
160Qwen3.5 4B · 8-bit Alibaba58±1local~6.2GB262kllama.cpp › openbmb/MiniCPM5-2B model cardXHToken/Spark-X2.5-4B model cardQwen/Qwen3.5-9B model cardEpoch AI — internal evaluationsLiquidAI/LFM2.5-2.6B model cardQwen/Qwen3.5-4B model card
161DeepSeek R1 (Jan '25) DeepSeek58±1api $4.00/M~110GB128kdocs.together.ai ↗Epoch AI — internal evaluationsdeepseek-ai/DeepSeek-R1 model carddeepseek-ai/DeepSeek-R1-0528-Qwen3-8B model carddeepseek-ai/DeepSeek-R1-0528 model cardMicrosoft — Phi-4-reasoning Technical ReportVector Institute Evaluation Leaderboard (Inspect Evals runs)
162EXAONE 4.0 32B · 8-bit LG AI Research58±2†local~42GB131kllama.cpp › LG AI Research vendor-reported benchmark scores for its own EXAONE models (Hugging Face model cards)
163Granite 4.2 3B · 8-bit IBM58±1local~5.6GB131kllama.cpp › openbmb/MiniCPM5-2B model cardibm-granite/granite-4.2-30b model card
164DeepSeek R1 0528 Qwen3 8B · 8-bit DeepSeek58±1local~12GB128kOllama › Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time ScalingEpoch AI — internal evaluationsdeepseek-ai/DeepSeek-R1-0528-Qwen3-8B model card
165Qwen3-VL 4B Thinking · 8-bit Alibaba57±2*†local~6.9GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
166Qwen3 30B-A3B Thinking 2507 · 8-bit Alibaba57±1local~41GB262kOllama › ByteDance-Seed/Seed-OSS-36B-Instruct model cardMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasetsEpoch AI — internal evaluationsQwen/Qwen3-30B-A3B-Thinking-2507 model cardQwen/Qwen3-Next-80B-A3B-Thinking model cardQwen/Qwen3.5-9B model card
168Qwen3.5 Flash Alibaba57±1*api $0.17/M1Mwww.alibabacloud.com ↗Epoch AI — internal evaluations
169Olmo 3 7B Think · 8-bit Ai257±1†local~11GB66kOllama › Olmo 3allenai/Olmo-3-7B-Think model card
171Phi-4-reasoning-plus 14B · 8-bit Microsoft57±1local~18GBllama.cpp › Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time ScalingMicrosoft — Phi-4-reasoning Technical Reportmicrosoft/Phi-4-reasoning model card
172Qwen3-VL 32B Instruct · 8-bit Alibaba57±2*†local~39GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
173GLM-4.7-Flash · 8-bit Z.ai57±2*local~35GB200kllama.cpp › Epoch AI — internal evaluations
174Gemma 4 12B · 8-bit Google57±2local~15GB262kllama.cpp › XHToken/Spark-X2.5-4B model cardGemma Team — Gemma 4 Technical Report
176MiMo-V2.5 (310B-A15B) Xiaomi57±2*api $0.21/M~100GB1Mnovita.ai ↗Solar Open 2 Technical Report (Upstage, arXiv:2607.20062v2)
177Nemotron Nano 9B v2 · 8-bit NVIDIA57±1local~13GB131kllama.cpp › Olmo 3NVIDIA — Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Modelsallenai/Olmo-3-7B-Think model cardNVIDIA vendor-reported benchmark scores for its own Nemotron models (Hugging Face model cards)
179Qwen3-VL 30B-A3B Instruct · 8-bit Alibaba56±2*†local~37GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
180MiniMax-M2.7 MiniMax56±2*api $0.53/M +local~75GB205kplatform.minimax.io ↗NVIDIA — Nemotron 3 Ultra technical reportA.X K2 Technical Report (SK Telecom), arXiv 2608.30181v1
181DeepSeek R1 Distill Llama 70B · 4-bit DeepSeek56±1local~46GB131kOllama › Epoch AI — internal evaluationsdeepseek-ai/DeepSeek-R1 model cardMicrosoft — Phi-4-reasoning Technical Report
184OpenThinker3 7B · 16-bit Open Thoughts56±1local~21GB33khow to run › Olmo 3allenai/Olmo-3-7B-Think model card
185OpenThinker2 32B · 8-bit Open Thoughts56±2†local~38GB33kllama.cpp › open-thoughts/OpenThinker2-32B model card
186Qwen3 32B · 8-bit Alibaba56±1local~43GB131kOllama › Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time ScalingByteDance-Seed/Seed-OSS-36B-Instruct model cardEpoch AI — internal evaluationsQwen/Qwen3-Next-80B-A3B-Thinking model cardallenai/Olmo-3.1-32B-Think model cardQwen/Qwen3-Next-80B-A3B-Instruct model card
187Qwen3 8B · 8-bit Alibaba55±1local~12GB33kOllama › Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scalingallenai/Olmo-3-7B-Think model cardEpoch AI — internal evaluationsQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)allenai/Olmo-3-7B-Instruct model card
188DeepSeek R1 Distill Qwen 32B · 8-bit DeepSeek55±1local~43GB131kOllama › deepseek-ai/DeepSeek-R1 model cardopen-thoughts/OpenThinker2-32B model cardEpoch AI — internal evaluationsallenai/Olmo-3.1-32B-Think model cardopen-thoughts/OpenThinker-32B model cardTHINK-Bench: Evaluating Thinking Efficiency and Chain-of-Thought Quality of Large Reasoning Models (arXiv:2505.22113v1)
189DeepSeek R1 Distill Qwen 14B · 8-bit DeepSeek55±1local~21GB131kOllama › Epoch AI — internal evaluationsdeepseek-ai/DeepSeek-R1 model cardTHINK-Bench: Evaluating Thinking Efficiency and Chain-of-Thought Quality of Large Reasoning Models (arXiv:2505.22113v1)
190Phi-4-reasoning 14B · 8-bit Microsoft55±2†local~21GB33kOllama › Microsoft — Phi-4-reasoning Technical Reportmicrosoft/Phi-4-reasoning model card
191GPT-4.1 mini OpenAI55±1api $0.70/M1Mplatform.openai.com ↗Epoch AI — internal evaluationsOpenAI simple-evals README benchmark results (OpenAI's own models)
192Mistral Medium 3.5 (128B) · 2-bit Mistral55±2*local~42GB262kllama.cpp › Solar Open 2 Technical Report (Upstage, arXiv:2607.20062v2)
194Solar Open 100B (102B-A12B) · 2-bit Upstage55±2*†local~41GB131kllama.cpp › Solar Open 2 Technical Report (Upstage, arXiv:2607.20062v2)
196Qwen3 4B Instruct 2507 · 8-bit Alibaba54±1local~7.1GB262kOllama › Marco-MoE: Open Multilingual Mixture-of-Expert Language Models with Efficient UpcyclingEpoch AI — internal evaluationsQwen/Qwen3-4B-Instruct-2507 model cardQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
197Phi-4-mini-reasoning 3.8B · 8-bit Microsoft54±2*†local~5.8GB128kllama.cpp › microsoft/Phi-4-mini-reasoning model card
198Magistral Small 1.2 · 8-bit Mistral54±1local~32GB131kllama.cpp › mistralai/Magistral-Small-2509 model cardEpoch AI — internal evaluations
201OpenThinker 32B · 8-bit Open Thoughts53±1†local~38GB33kllama.cpp › open-thoughts/OpenThinker2-32B model cardopen-thoughts/OpenThinker-32B model card
202Qwen3 4B Thinking 2507 · 8-bit Alibaba53±2local~7.1GB262kOllama › Qwen/Qwen3-4B-Thinking-2507 model cardMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
203GPT-4.1 OpenAI53±1api $3.50/M1Mplatform.openai.com ↗Epoch AI — internal evaluationsMeituan LongCat-Flash-Chat model card (evaluation table)OpenAI simple-evals README benchmark results (OpenAI's own models)MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval — authors' own model runs
206QED-Nano · 16-bit LM Provers52±2local~9.9GB262khow to run › MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
207Qwen3-VL 8B Instruct · 8-bit Alibaba52±2local~12GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)allenai/Olmo-3-7B-Instruct model card
210DeepSeek R1 Distill Qwen 7B · 8-bit DeepSeek52±1local~12GB131kOllama › deepseek-ai/DeepSeek-R1 model cardopen-thoughts/OpenThinker2-7B model cardallenai/Olmo-3-7B-Think model cardmicrosoft/Phi-4-mini-reasoning model cardMicrosoft — Phi-4-Mini Technical Reportopen-thoughts/OpenThinker-7B model card+1
211EXAONE Deep 32B · 4-bit LG AI Research52±2†local~22GB33kllama.cpp › LG AI Research vendor-reported benchmark scores for its own EXAONE models (Hugging Face model cards)
212Nemotron 3 Nano 4B · 8-bit NVIDIA51±1local~7GB262kOllama › openbmb/MiniCPM5-2B model cardNVIDIA vendor-reported benchmark scores for its own Nemotron models (Hugging Face model cards)
213s1.1 32B · 8-bit Simple Scaling51±1local~38GB33kllama.cpp › open-thoughts/OpenThinker2-32B model cardopen-thoughts/OpenThinker-32B model card
214Spark-X2.5 1.7B · 16-bit iFLYTEK (SparkLLM)51±2†local~5.1GB1MOllama › XHToken/Spark-X2.5-4B model card
217Qwen3 30B-A3B (Apr 2025, hybrid) · 8-bit Alibaba50±1local~41GB33kOllama › Qwen/Qwen3-4B-Thinking-2507 model cardQwen/Qwen3-30B-A3B-Thinking-2507 model cardQwen/Qwen3-30B-A3B-Instruct-2507 model cardQwen/Qwen3-4B-Instruct-2507 model cardEpoch AI — internal evaluations
218Qwen2.5-VL 72B Instruct · 4-bit Alibaba50±4*†local~51GB33kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
219EXAONE Deep 7.8B · 4-bit LG AI Research50±2†local~6.5GB33kOllama › LG AI Research vendor-reported benchmark scores for its own EXAONE models (Hugging Face model cards)
220OpenThinker2 7B · 4-bit Open Thoughts50±2†local~6.4GB33kllama.cpp › open-thoughts/OpenThinker2-7B model card
221Llama 4 Maverick (402B-A17B) Meta50±1api $0.42/M +local~65GB1Mdocs.aws.amazon.com ↗Epoch AI — internal evaluationsMathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval — authors' own model runs
222Gemma 3 27B · 8-bit Google50±1local~37GB131kOllama › Epoch AI — internal evaluationsallenai/Olmo-3.1-32B-Think model cardGoogle DeepMind Gemma 3 270M IT model card2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsGemma Team — Gemma 4 Technical Report
223Ministral 3 14B · 8-bit Mistral50±3*†local~20GB262kOllama › mistralai/Ministral-3-8B-Instruct-2512 model cardmistralai/Ministral-3-14B-Instruct-2512 model card
224Magistral Small 1.0 (2506) · 8-bit Mistral50±1local~32GB128kOllama › mistralai/Magistral-Small-2509 model cardEpoch AI — internal evaluations
225Mistral Small 3.2 24B · 8-bit Mistral50±2*local~32GB128kOllama › Epoch AI — internal evaluationsmistralai/Mistral-Small-3.2-24B-Instruct-2506 model card
228Olmo 3 7B Instruct · 8-bit Ai249±1†local~11GB66kOllama › Olmo 3allenai/Olmo-3-7B-Instruct model card
229MiniMax-M2.1 · 2-bit MiniMax49±2local (slow)~79GBllama.cpp › stepfun-ai/Step-3.5-Flash model card
230Qwen3 235B-A22B (Apr 2025, hybrid) Alibaba49±1api $1.23/M +local~76GB131kwww.alibabacloud.com ↗Epoch AI — internal evaluationsQwen/Qwen3-30B-A3B-Thinking-2507 model cardQwen/Qwen3-30B-A3B-Instruct-2507 model cardQwen/Qwen3-235B-A22B-Thinking-2507 model cardQwen/Qwen3-235B-A22B-Instruct-2507 model cardTHINK-Bench: Evaluating Thinking Efficiency and Chain-of-Thought Quality of Large Reasoning Models (arXiv:2505.22113v1)
231Gemma 3 12B · 8-bit Google49±1local~17GB131kOllama › Marco-MoE: Open Multilingual Mixture-of-Expert Language Models with Efficient UpcyclingEpoch AI — internal evaluationsGoogle DeepMind Gemma 3 270M IT model card
232DeepSeek R1 Distill Llama 8B · 8-bit DeepSeek49±1local~12GB131kOllama › deepseek-ai/DeepSeek-R1 model cardmicrosoft/Phi-4-mini-reasoning model cardMicrosoft — Phi-4-Mini Technical Report
233Magistral Small 1.1 (2507) · 16-bit Mistral49±2*†local~51GB40khow to run › mistralai/Magistral-Small-2509 model card
235Qwen3-VL 4B Instruct · 8-bit Alibaba49±2*†local~6.9GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
237GPT-4.1 nano OpenAI49±1api $0.17/M1Mdevelopers.openai.com ↗Epoch AI — internal evaluationsOpenAI simple-evals README benchmark results (OpenAI's own models)
238Command A Reasoning (08-2025) · 2-bit Cohere49±4*†local~34GBllama.cpp › Cohere vendor-reported benchmark scores for its own models (cohere.com blog)
239LFM2.5 1.2B Thinking · 8-bit Liquid AI49±3†local~3.5GB33kOllama › LiquidAI/LFM2.5-1.2B-Thinking model card
240Ministral 3 8B · 8-bit Mistral48±2local~13GB262kOllama › Marco-MoE: Open Multilingual Mixture-of-Expert Language Models with Efficient Upcyclingmistralai/Ministral-3-8B-Instruct-2512 model cardmistralai/Ministral-3-14B-Instruct-2512 model card
242LFM2.5 8B-A1B · 8-bit Liquid AI48±1local~13GB128kOllama › openbmb/MiniCPM5-2B model cardLiquidAI/LFM2.5-8B-A1B model card
243Qwen2.5-Math 72B Instruct · 4-bit Alibaba48±2†local~51GB4kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
244Qwen3 4B · 8-bit Alibaba48±1local~7.1GB33kOllama › Qwen/Qwen3-4B-Thinking-2507 model cardQwen/Qwen3-4B-Instruct-2507 model cardLFM2 Technical Report — Liquid AI own SmolLM3 evaluationHuggingFaceTB/SmolLM3-3B model card (Evaluation section)
245LFM2 24B-A2B · 8-bit Liquid AI48±2local~32GB33kOllama › Marco-MoE: Open Multilingual Mixture-of-Expert Language Models with Efficient Upcycling
246Qwen Plus (2025-01-25) Alibaba48±1*api $0.60/M131kwww.alibabacloud.com ↗Epoch AI — internal evaluations
247Pixtral Large (2411) · 2-bit Mistral48±7*†local~51GBllama.cpp › Mistral AI vendor-reported benchmark scores for its own models (Hugging Face model cards)
248DeepSeek V3 (Dec '24) DeepSeek48±1api $0.46/M~337GB131kdeepinfra.com ↗Epoch AI — internal evaluationsdeepseek-ai/DeepSeek-R1 model card
249Phi-4 14B · 8-bit Microsoft48±1local~21GB16kOllama › Epoch AI — internal evaluationsmicrosoft/phi-4 model cardMicrosoft Research — Phi-4 Technical Report
251Qwen3-VL 2B Thinking · 8-bit Alibaba48±2*†local~4.2GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
254Qwen2.5 72B Instruct · 4-bit Alibaba47±1local~48GB33kllama.cpp › Epoch AI — internal evaluationsWildEval ZeroEval published results2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsMicrosoft Research — Phi-4 Technical Report
255Llama 4 Scout (109B-A17B) · 2-bit Meta47±1*local~36GB328kllama.cpp › Epoch AI — internal evaluations
257Qwen2-Math 72B Instruct · 4-bit Alibaba47±2†local~51GB4kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
258Granite 4.0 H Small (32B-A9B) · 8-bit IBM47±1local~38GB131kllama.cpp › Marco-MoE: Open Multilingual Mixture-of-Expert Language Models with Efficient Upcyclingibm-granite/granite-4.0-h-small model card
259DeepSeek-V2.5 (1210) · 2-bit DeepSeek47±4*†local (slow)~82GBllama.cpp › DeepSeek vendor-reported benchmark scores for its own models (Hugging Face model cards)
260Gemini 2.5 Flash-Lite Google46±6*api $0.17/M1Mai.google.dev ↗Qwen/Qwen3.5-4B model card
261Tulu 2 70B · 4-bit Allen Institute for AI46±5*†local~45GBllama.cpp › Tulu 2 — base and instruction-tuned evaluations
262OpenThinker 7B · 8-bit Open Thoughts46±2†local~10GB33kllama.cpp › open-thoughts/OpenThinker2-7B model cardopen-thoughts/OpenThinker-7B model card
264EXAONE Deep 2.4B · 4-bit LG AI Research46±2†local~3.2GB33kllama.cpp › LG AI Research vendor-reported benchmark scores for its own EXAONE models (Hugging Face model cards)
265Qwen2.5-Math 7B Instruct · 4-bit Alibaba46±2†local~6.4GB4kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
266Qwen2.5 32B Instruct · 8-bit Alibaba46±1local~43GB131kOllama › Epoch AI — internal evaluationsWildEval ZeroEval published resultsallenai/Olmo-3.1-32B-Think model card2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct models
267Llama 3.1 Nemotron 51B Instruct · 8-bit NVIDIA46±5*†local~59GBllama.cpp › Puzzle: Distillation-Based NAS for Inference-Optimized LLMs (arXiv:2411.19146v5)
268LFM2.5 2.6B · 8-bit Liquid AI46±1local~4.5GB131kllama.cpp › openbmb/MiniCPM5-2B model cardLiquidAI/LFM2.5-2.6B model card
271Tulu 2 DPO 70B · 4-bit Ai245±5*†local~45GBllama.cpp › Tulu 2 — base and instruction-tuned evaluations
272GPT-4o (2024-08-06) OpenAI45±1api $4.38/M128kdevelopers.openai.com ↗Epoch AI — internal evaluationsWildEval ZeroEval published resultsVector Institute Evaluation Leaderboard (Inspect Evals runs)OpenAI simple-evals README benchmark results (OpenAI's own models)
273Qwen2.5 14B Instruct · 8-bit Alibaba45±2local~21GB131kOllama › 2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsmicrosoft/phi-4 model cardMicrosoft Research — Phi-4 Technical Report
274Granite 4.0 H Tiny (7B-A1B) · 4-bit IBM45±2†local~5.9GB131kllama.cpp › ibm-granite/granite-4.0-h-small model card
275DeepSeek R1 Distill Qwen 1.5B · 8-bit DeepSeek45±1local~4.3GB131kOllama › deepseek-ai/DeepSeek-R1 model cardEpoch AI — internal evaluationsTHINK-Bench: Evaluating Thinking Efficiency and Chain-of-Thought Quality of Large Reasoning Models (arXiv:2505.22113v1)
278GPT-4o (2024-05-13) OpenAI45±1api $7.50/M128kdevelopers.openai.com ↗Epoch AI — internal evaluationsWildEval ZeroEval published resultsopen-thoughts/OpenThinker-7B model cardOpenAI simple-evals README benchmark results (OpenAI's own models)Microsoft Phi-3.5-vision-instruct model card: Benchmarks tablePixtral 12B (Mistral AI, arXiv 2410.07073v2)
279GPT-4o mini (2024-07-18) OpenAI45±1api $0.26/M128kdevelopers.openai.com ↗Epoch AI — internal evaluationsWildEval ZeroEval published resultsmicrosoft/Phi-4-mini-instruct model cardVector Institute Evaluation Leaderboard (Inspect Evals runs)2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsOpenAI simple-evals README benchmark results (OpenAI's own models)+2
281Llama 3.1 Tulu 3 70B · 4-bit Ai245±3*†local~47GB131kOllama › Tülu 3: Pushing Frontiers in Open Language Model Post-Training (Lambert et al., Ai2)
282Qwen2.5-VL 7B Instruct · 8-bit Alibaba45±3*†local~11GBOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
283Command A (03-2025) · 2-bit Cohere44±3*†local~37GB256kllama.cpp › Cohere — Command A technical report
284Gemma 4 E4B · 8-bit Google44±1local~9.9GB131kllama.cpp › openbmb/MiniCPM5-2B model cardXHToken/Spark-X2.5-4B model cardGemma Team — Gemma 4 Technical ReportLiquidAI/LFM2.5-2.6B model card
285Mistral Large 2 (2411) · 4-bit Mistral44±1*local (slow)~78GB128kllama.cpp › Epoch AI — internal evaluations
286Qwen2-VL 72B Instruct · 4-bit Alibaba44±3local~53GBllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Pixtral 12B (Mistral AI, arXiv 2410.07073v2)
287Llama 3.1 405B Instruct Meta44±1api $2.40/M~160GB128kdocs.aws.amazon.com ↗Epoch AI — internal evaluationsCohere — Command A technical reportWildEval ZeroEval published results
288GPT-4o (2024-11-20) OpenAI44±1api $4.38/M128kdevelopers.openai.com ↗Epoch AI — internal evaluationsOpenAI simple-evals README benchmark results (OpenAI's own models)
290Mixtral 8x7B v0.1 (base) · 8-bit Mistral AI44±2*†local~54GB32kOllama › Mixtral of Experts — base-model evaluations
291EXAONE 4.0 1.2B · 8-bit LG AI Research44±2*†local~3.6GB66kllama.cpp › LG AI Research vendor-reported benchmark scores for its own EXAONE models (Hugging Face model cards)
292Qwen2.5 7B Instruct · 8-bit Alibaba44±1local~12GB131kOllama › WildEval ZeroEval published resultsmicrosoft/Phi-4-mini-instruct model card2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsallenai/Olmo-3-7B-Instruct model cardEpoch AI — internal evaluations
293SmolLM3 3B · 8-bit Hugging Face44±2local~5.9GB66kllama.cpp › LFM2 Technical Report — Liquid AI own SmolLM3 evaluationHuggingFaceTB/SmolLM3-3B model card (Evaluation section)
294Gemma 3 4B · 8-bit Google43±2local~7.4GB131kOllama › Google DeepMind Gemma 3 270M IT model cardLFM2 Technical Report — Liquid AI own SmolLM3 evaluationEpoch AI — internal evaluations
295Mistral Small 3.1 24B (2503) · 8-bit Mistral43±1local~32GB128kOllama › Epoch AI — internal evaluationsmistralai/Mistral-Small-3.2-24B-Instruct-2506 model cardMistral AI vendor-reported benchmark scores for its own models (Hugging Face model cards)
296GPT-4 Turbo (2024-04-09) OpenAI43±1api $15.00/M128kdevelopers.openai.com ↗Epoch AI — internal evaluationsWildEval ZeroEval published resultsOpenAI simple-evals README benchmark results (OpenAI's own models)Phi-3 Technical Report (Microsoft, arXiv 2404.14219v3)
297Granite 3.3 8B Instruct · 8-bit IBM43±1local~11GB128kllama.cpp › ibm-granite/granite-3.3-8b-instruct model cardallenai/Olmo-3-7B-Instruct model card
299Mistral Large 2 (2407) · 2-bit Mistral43±1local~45GB128kllama.cpp › Epoch AI — internal evaluationsWildEval ZeroEval published resultsVector Institute Evaluation Leaderboard (Inspect Evals runs)Jamba-1.5: Hybrid Transformer-Mamba Models at Scale (AI21, arXiv 2408.12570v1)
300InternVL2-26B · 16-bit Shanghai AI Laboratory (OpenGVLab)43±7*†local~55GBhow to run › OpenGVLab InternVL2 model cards (InternVL2-4B and InternVL2-26B), Evaluation tables
301DeepSeek-V2 Chat (0628) · 2-bit DeepSeek43±3*local (slow)~66GBllama.cpp › WildEval ZeroEval published results
302InternVL2-4B · 16-bit Shanghai AI Laboratory (OpenGVLab)43±5*local~10GBhow to run › Microsoft Phi-3.5-vision-instruct model card: Benchmarks tableOpenGVLab InternVL2 model cards (InternVL2-4B and InternVL2-26B), Evaluation tables
304Xwin-LM 70B v0.1 · 4-bit Xwin-LM43±5*local~45GBllama.cpp › Tulu 2 — base and instruction-tuned evaluations
305Qwen3 1.7B · 8-bit Alibaba43±1local~4.6GB33kOllama › Marco-MoE: Open Multilingual Mixture-of-Expert Language Models with Efficient UpcyclingLiquidAI/LFM2.5-1.2B-Thinking model cardQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)LiquidAI/LFM2-1.2B model cardQwen/Qwen3.5-2B model cardHuggingFaceTB/SmolLM3-3B model card (Evaluation section)+1
306Mistral Small 3 24B (2501) · 8-bit Mistral43±1*local~32GB32kOllama › Epoch AI — internal evaluations
307Granite 4.0 H Micro 3B · 4-bit IBM43±2†local~3.5GB131kllama.cpp › ibm-granite/granite-4.0-h-small model card
308Llama 3.1 Tulu 3 70B DPO · 4-bit Ai243±1local~46GB131kllama.cpp › Epoch AI — internal evaluationsTülu 3: Pushing Frontiers in Open Language Model Post-Training (Lambert et al., Ai2)
309Llama 3.3 70B Instruct · 4-bit Meta42±1local~46GB128kOllama › Epoch AI — internal evaluations2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsCohere — Command A technical reportMathConstraint: Automated Generation of Verified Combinatorial Reasoning Instances for LLMs — authors' own model runsMicrosoft Research — Phi-4 Technical Report
310Ministral 3 3B · 8-bit Mistral42±1local~6.9GB262kOllama › Marco-MoE: Open Multilingual Mixture-of-Expert Language Models with Efficient Upcyclingmistralai/Ministral-3-8B-Instruct-2512 model cardmistralai/Ministral-3-14B-Instruct-2512 model card
312Qwen2-Math 7B Instruct · 8-bit Alibaba42±2†local~10GB4kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
313Granite 4.0 Micro 3B · 8-bit IBM42±2local~5.3GB131kllama.cpp › ibm-granite/granite-4.0-h-small model cardEpoch AI — internal evaluations
315Granite 8B Code Base (4K) · 4-bit IBM42±2*†local~6.6GBllama.cpp › Granite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
317Llama 3.2 90B Vision Instruct · 4-bit Meta42±1local~58GB128kOllama › Epoch AI — internal evaluationsPixtral 12B (Mistral AI, arXiv 2410.07073v2)
318Qwen2 72B Instruct · 4-bit Alibaba41±1local~51GB131kllama.cpp › Epoch AI — internal evaluationsWildEval ZeroEval published resultsQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
319Llama 3.1 70B Instruct · 4-bit Meta41±1local~46GB128kOllama › Epoch AI — internal evaluationsWildEval ZeroEval published resultsVector Institute Evaluation Leaderboard (Inspect Evals runs)2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsPuzzle: Distillation-Based NAS for Inference-Optimized LLMs (arXiv:2411.19146v5)
322Gemma 4 E2B · 8-bit Google41±1local~6.8GB131kllama.cpp › openbmb/MiniCPM5-2B model cardXHToken/Spark-X2.5-4B model cardGemma Team — Gemma 4 Technical ReportLiquidAI/LFM2.5-2.6B model card
323Qwen2.5-Math 1.5B Instruct · 4-bit Alibaba41±2†local~2.5GB4kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
325Phi-4-mini 3.8B · 8-bit Microsoft41±2†local~6.9GB128kOllama › microsoft/Phi-4-mini-instruct model cardMicrosoft — Phi-4-Mini Technical Report
327Phi-2 (2.7B) · 4-bit Microsoft40±3*local~7.3GB2khow to run › MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies (Hu et al.)
328Molmo 2 8B · 4-bit Ai240±7*†local~38GBhow to run › Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding (Ai2, arXiv 2601.10611v4)
329Pixtral 12B (2409) · 16-bit Mistral40±3*†local~28GBhow to run › Pixtral 12B (Mistral AI, arXiv 2410.07073v2)
330StarCoder2 15B · 8-bit BigCode40±2*†local~19GB16kOllama › StarCoder 2 and The Stack v2: The Next Generation — authors' own runs
331LFM2 2.6B · 4-bit Liquid AI40±3*†local~3.1GB33kllama.cpp › LFM2 Technical Report — Liquid AI own SmolLM3 evaluation
332Qwen3.5 2B · 8-bit Alibaba40±1local~4.9GB262kOllama › openbmb/MiniCPM5-2B model cardXHToken/Spark-X2.5-4B model cardQwen/Qwen3.5-2B model cardMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets
333Llama 3.1 Nemotron 70B Instruct · 4-bit NVIDIA40±3*local~47GB128kOllama › Tülu 3: Pushing Frontiers in Open Language Model Post-Training (Lambert et al., Ai2)
334Qwen2.5-VL 3B Instruct · 8-bit Alibaba40±3*†local~6.3GBOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
336Qwen3-VL 2B Instruct · 8-bit Alibaba40±2*†local~4.2GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
337Gemma 7B (base) · 8-bit Google40±2local~11GB8kOllama › Granite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsGemma report — original evaluations
338InternLM2.5 7B Chat · 8-bit Shanghai AI Laboratory (InternLM)39±3*†local~12GBOllama › InternLM GitHub repository model cards (Shanghai AI Laboratory)
339Qwen2-Math 1.5B Instruct · 8-bit Alibaba39±2†local~3.2GB4kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
340CodeGemma 7B (v1.0) · 8-bit Google39±2*local~11GBOllama › Granite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
341Code Tulu 2 34B · 16-bit Allen Institute for AI39±5*†local (slow)~72GBhow to run › Tulu 2 — base and instruction-tuned evaluations
342LFM2 1.2B · 4-bit Liquid AI39±3*†local~2.3GB33kllama.cpp › LiquidAI/LFM2-1.2B model card
343WizardLM 70B V1.0 · 4-bit Microsoft38±4*local~45GBOllama › Orca 2: Teaching Small Language Models How to Reason (Mitra et al., Microsoft)
345Llama 3.2 11B Vision Instruct · 8-bit Meta38±3*local~16GB128kOllama › Pixtral 12B (Mistral AI, arXiv 2410.07073v2)
347LFM2.5 1.2B Instruct · 4-bit Liquid AI38±2†local~2.3GB33kllama.cpp › LiquidAI/LFM2.5-1.2B-Thinking model card
348Gemma 2 27B IT · 8-bit Google38±1local~36GB8kOllama › Epoch AI — internal evaluationsWildEval ZeroEval published resultsallenai/Olmo-3.1-32B-Think model card2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct models
350Llama 2 70B (base) · 4-bit Meta38±2local~45GB4kllama.cpp › Mixtral of Experts — base-model evaluationsTulu 2 — base and instruction-tuned evaluations
351Phi-3-vision-128k-instruct · 16-bit Microsoft38±6*†local~10GBhow to run › Phi-3 Technical Report (Microsoft, arXiv 2404.14219v3)
352Mathstral 7B v0.1 · 8-bit Mistral AI38±3*†local~11GB32kOllama › Mistral AI vendor-reported benchmark scores for its own models (Hugging Face model cards)
353Granite 3.3 2B Instruct · 8-bit IBM38±2†local~4.3GB128kllama.cpp › ibm-granite/granite-3.3-8b-instruct model card
355Phi-3.5-vision-instruct · 16-bit Microsoft38±7*†local~10GBhow to run › Microsoft Phi-3.5-vision-instruct model card: Benchmarks table
356DeepSeek-Coder 33B Base · 8-bit DeepSeek38±2*local~39GB16kllama.cpp › StarCoder 2 and The Stack v2: The Next Generation — authors' own runs
357GPT-4 (0613) OpenAI37±1api $37.50/M8kdevelopers.openai.com ↗Epoch AI — internal evaluationsTulu 2 — base and instruction-tuned evaluations
358Tulu 2 DPO 13B · 16-bit Allen Institute for AI37±5*†local~29GBhow to run › Tulu 2 — base and instruction-tuned evaluations
359Llama 3 70B Instruct · 4-bit Meta37±1local~47GB8kOllama › Epoch AI — internal evaluationsWildEval ZeroEval published results
360Jamba 1.5 Mini · 4-bit AI21 Labs37±4*†local~34GBllama.cpp › Jamba-1.5: Hybrid Transformer-Mamba Models at Scale (AI21, arXiv 2408.12570v1)
361Yi 1.5 34B Chat · 8-bit 01.AI37±1local~45GB4kOllama › Epoch AI — internal evaluationsWildEval ZeroEval published results
362Llama 3.1 Tulu 3 8B · 8-bit Ai237±1local~12GB131kOllama › microsoft/Phi-4-mini-instruct model card2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct models
363Hermes 2 Theta Llama-3 70B · 4-bit Nous Research37±1*local~47GB8kllama.cpp › Epoch AI — internal evaluations
364Granite 3.2 8B Instruct · 8-bit IBM37±2†local~12GB131kOllama › ibm-granite/granite-3.3-8b-instruct model card
366Granite 4.0 1B · 16-bit IBM37±2local~6.1GB128kOllama › ibm-granite/granite-4.0-h-1b model cardLiquidAI/LFM2.5-1.2B-Thinking model cardEpoch AI — internal evaluations
367Qwen2.5 3B Instruct · 8-bit Alibaba37±1local~5.9GB33kOllama › WildEval ZeroEval published resultsmicrosoft/Phi-4-mini-instruct model card
368OLMo 2 32B Instruct (0325) · 8-bit Ai237±1†local~38GBllama.cpp › allenai/Olmo-3.1-32B-Think model card2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct models
369Llama 3.1 8B Instruct · 8-bit Meta37±1local~12GB128kOllama › Epoch AI — internal evaluationsWildEval ZeroEval published resultsmicrosoft/Phi-4-mini-instruct model cardIBM Granite 3.0 Language Models technical report (GitHub)2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct models
370Granite 3.1 8B Instruct · 8-bit IBM36±2†local~12GB128kOllama › ibm-granite/granite-3.3-8b-instruct model cardibm-granite/granite-3.1-3b-a800m-instruct model card
371OLMo 2 13B Instruct (1124) · 8-bit Allen Institute for AI36±2*†local~19GB4kOllama › 2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct models
372Gemma 2 9B IT · 8-bit Google36±1local~14GB8kOllama › Epoch AI — internal evaluationsWildEval ZeroEval published resultsmicrosoft/Phi-4-mini-instruct model card2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsInternLM GitHub repository model cards (Shanghai AI Laboratory)
373Tulu 2 13B · 16-bit Allen Institute for AI36±4*†local~29GBhow to run › Tulu 2 — base and instruction-tuned evaluations
374Granite 3.0 8B Instruct · 8-bit IBM36±2*†local~12GB4kOllama › IBM Granite 3.0 Language Models technical report (GitHub)
377Granite 4.0 H 1B · 8-bit IBM36±2local~3.2GB131kOllama › ibm-granite/granite-4.0-h-1b model cardLiquidAI/LFM2.5-1.2B-Thinking model card
378Athene-70B · 4-bit Nexusflow35±1*local~46GBllama.cpp › WildEval ZeroEval published results
379Qwen3 0.6B · 8-bit Alibaba35±2local~3GB33kOllama › Olmo 3LiquidAI/LFM2-1.2B model card
380Phi-3 Medium 128K Instruct · 8-bit Microsoft35±1*local~20GB128kOllama › Epoch AI — internal evaluations
381Code Llama 34B (base) · 8-bit Meta35±2*local~39GB16kOllama › StarCoder 2 and The Stack v2: The Next Generation — authors' own runsTulu 2 — base and instruction-tuned evaluations
382Qwen2 7B Instruct · 8-bit Alibaba35±1local~12GB131kOllama › WildEval ZeroEval published resultsQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)InternLM GitHub repository model cards (Shanghai AI Laboratory)
384Ministral 8B (2410) · 16-bit Mistral34±1local~22GB128khow to run › Epoch AI — internal evaluationsmicrosoft/Phi-4-mini-instruct model card2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsMistral AI vendor-reported benchmark scores for its own models (Hugging Face model cards)
385Code Tulu 2 13B · 16-bit Allen Institute for AI34±5*†local~29GBhow to run › Tulu 2 — base and instruction-tuned evaluations
387LFM2 700M · 4-bit Liquid AI34±3*†local~2GB33kllama.cpp › LiquidAI/LFM2-1.2B model card
390Phi-3.5-mini-instruct · 8-bit Microsoft34±1local~6.8GB128kOllama › WildEval ZeroEval published resultsmicrosoft/Phi-4-mini-instruct model card
392Qwen2-VL 7B Instruct · 8-bit Alibaba34±2local~11GBllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Pixtral 12B (Mistral AI, arXiv 2410.07073v2)
393Code Llama 34B Instruct · 8-bit Meta33±5*local~45GB16kOllama › Tulu 2 — base and instruction-tuned evaluations
394Yi 1.5 9B Chat · 8-bit 01.AI33±1*local~13GB4kOllama › WildEval ZeroEval published results
396Granite 3.0 2B Instruct · 8-bit IBM33±2*†local~5.3GB4kOllama › IBM Granite 3.0 Language Models technical report (GitHub)
397OLMo 2 7B Instruct (1124) · 8-bit Allen Institute for AI33±2†local~11GB4kOllama › 2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsallenai/Olmo-3-7B-Instruct model card
398Qwen3.5 0.8B · 8-bit Alibaba33±4†local~3.1GB262kOllama › Qwen/Qwen3.5-2B model card
399Qwen2.5 1.5B Instruct · 8-bit Alibaba33±2local~4GB33kOllama › 2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsSmolLM2 paper (Hugging Face) — authors' own instruct-model evaluations
400GPT-3.5 Turbo (0125) OpenAI33±1api $0.75/M16kdevelopers.openai.com ↗Epoch AI — internal evaluationsWildEval ZeroEval published results2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct models
401Mistral 7B v0.1 (base) · 16-bit Mistral AI33±1local~17GB8khow to run › Mixtral of Experts — base-model evaluationsMistral 7B — authors' own runsMiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies (Hu et al.)Gemma report — original evaluations
402Llama 3.2 3B Instruct · 8-bit Meta32±1local~6.1GB131kOllama › microsoft/Phi-4-mini-instruct model cardIBM Granite 3.0 Language Models technical report (GitHub)microsoft/Phi-4-mini-reasoning model cardMicrosoft — Phi-4-Mini Technical ReportLFM2 Technical Report — Liquid AI own SmolLM3 evaluation
404Mistral NeMo Instruct (2407) · 8-bit Mistral32±1*local~18GB128kOllama › Epoch AI — internal evaluationsWildEval ZeroEval published results
405DBRX Instruct · 4-bit Databricks32±1*local (slow)~85GB32kOllama › Epoch AI — internal evaluations
406Tulu 2 DPO 7B · 16-bit Allen Institute for AI32±5*†local~16GBhow to run › Tulu 2 — base and instruction-tuned evaluations
408Tulu 2 7B · 16-bit Allen Institute for AI32±5*†local~16GBhow to run › Tulu 2 — base and instruction-tuned evaluations
409Phi-3-mini-4k-instruct (June 2024 update) · 8-bit Microsoft32±1*local~5.8GBllama.cpp › WildEval ZeroEval published results
410Command R Plus (04-2024) · 2-bit Cohere32±1*local~43GB128kllama.cpp › WildEval ZeroEval published resultsVector Institute Evaluation Leaderboard (Inspect Evals runs)
411Code Tulu 2 7B · 16-bit Allen Institute for AI32±5*†local~16GBhow to run › Tulu 2 — base and instruction-tuned evaluations
412Gemma 3 1B · 4-bit Google31±1local~2.7GB32kOllama › Google DeepMind Gemma 3 270M IT model cardLiquidAI/LFM2.5-1.2B-Thinking model card2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsLiquidAI/LFM2-1.2B model cardEpoch AI — internal evaluations
413DeepSeek-Coder 6.7B Base · 8-bit DeepSeek31±2*local~9.1GB16kOllama › StarCoder 2 and The Stack v2: The Next Generation — authors' own runs
414Granite 3.2 2B Instruct · 8-bit IBM31±2†local~5.2GB131kOllama › ibm-granite/granite-3.3-8b-instruct model card
415Granite 3.1 2B Instruct · 8-bit IBM31±2†local~5.2GB128kOllama › ibm-granite/granite-3.3-8b-instruct model cardibm-granite/granite-3.1-3b-a800m-instruct model card
417Stable Code 3B · 8-bit Stability AI31±2*local~4.7GB16kOllama › StarCoder 2 and The Stack v2: The Next Generation — authors' own runs
418Mixtral 8x7B Instruct v0.1 · 8-bit Mistral30±1*local~61GB32kOllama › Epoch AI — internal evaluationsWildEval ZeroEval published results
419StarCoder2 7B · 8-bit BigCode30±2local~9.5GB16kOllama › StarCoder 2 and The Stack v2: The Next Generation — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
420Granite 3.1 3B-A800M Instruct · 8-bit IBM30±4*†local~5.2GB131kllama.cpp › ibm-granite/granite-3.1-3b-a800m-instruct model card
421Zephyr 7B beta · 8-bit Hugging Face30±5*local~11GBOllama › Tulu 2 — base and instruction-tuned evaluations
422Granite 3.0 3B-A800M Instruct · 8-bit IBM30±2*†local~5.3GB4kllama.cpp › IBM Granite 3.0 Language Models technical report (GitHub)
423OLMo 2 1B Instruct (0425) · 16-bit Allen Institute for AI29±2*†local~5.8GB4khow to run › 2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct models
425Code Llama 13B (base) · 8-bit Meta29±2*local~16GB16kOllama › StarCoder 2 and The Stack v2: The Next Generation — authors' own runsTulu 2 — base and instruction-tuned evaluations
426Llama 3 8B Instruct · 8-bit Meta29±1local~12GB8kOllama › Epoch AI — internal evaluationsWildEval ZeroEval published resultsInternLM GitHub repository model cards (Shanghai AI Laboratory)
427WizardLM 13B V1.2 · 4-bit Microsoft29±4*local~29GBhow to run › Orca 2: Teaching Small Language Models How to Reason (Mitra et al., Microsoft)
428DeepSeek LLM 67B Chat · 4-bit DeepSeek29±1*local~44GB4kOllama › Epoch AI — internal evaluations
429Apertus 8B Instruct (2509) · 16-bit Swiss AI29±3*local~18GB66khow to run › allenai/Olmo-3-7B-Instruct model card
430Code Llama 13B Instruct · 8-bit Meta28±5*local~16GB16kOllama › Tulu 2 — base and instruction-tuned evaluations
431SmolLM2 1.7B Instruct · 8-bit Hugging Face27±2local~4.2GB8kOllama › 2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsSmolLM2 paper (Hugging Face) — authors' own instruct-model evaluations
432Yi 34B Chat · 8-bit 01.AI27±1*local~45GB4kOllama › Epoch AI — internal evaluations
433LFM2 350M · 4-bit Liquid AI27±3*†local~1.7GB33kllama.cpp › LiquidAI/LFM2-1.2B model card
434Falcon 40B (base) · 8-bit TII27±3*local~48GB2kllama.cpp › MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies (Hu et al.)
435Gemma 2B (base) · 8-bit Google27±4*†local~4.3GB8kOllama › Gemma report — original evaluations
436Llama 2 70B Chat · 4-bit Meta26±1local~46GB4kOllama › Epoch AI — internal evaluationsOrca 2: Teaching Small Language Models How to Reason (Mitra et al., Microsoft)Tulu 2 — base and instruction-tuned evaluations
437Llama 2 13B (base) · 8-bit Meta26±2local~16GB4kllama.cpp › Mixtral of Experts — base-model evaluationsMistral 7B — authors' own runsMiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies (Hu et al.)Tulu 2 — base and instruction-tuned evaluations
438StarCoder2 3B · 8-bit BigCode26±2*†local~4.9GB16kOllama › StarCoder 2 and The Stack v2: The Next Generation — authors' own runs
439Llama 3.2 1B Instruct · 4-bit Meta25±1local~5.2GB131kOllama › IBM Granite 3.0 Language Models technical report (GitHub)LiquidAI/LFM2.5-1.2B-Thinking model card2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsSmolLM2 paper (Hugging Face) — authors' own instruct-model evaluationsLiquidAI/LFM2-1.2B model cardEpoch AI — internal evaluations
440Code Llama 7B Instruct · 8-bit Meta25±5*local~9.1GB16kOllama › Tulu 2 — base and instruction-tuned evaluations
441Llama-3-Instruct-8B-SimPO-v0.2 · 16-bit Princeton NLP25±2*local~18GBhow to run › WildEval ZeroEval published results
442Granite 3.1 1B-A400M Instruct · 8-bit IBM25±4*†local~3GB131kOllama › ibm-granite/granite-3.1-3b-a800m-instruct model card
443Mistral 7B Instruct v0.3 · 8-bit Mistral25±1local~11GB32kOllama › Epoch AI — internal evaluationsMistral AI vendor-reported benchmark scores for its own models (Hugging Face model cards)
444Qwen2 0.5B Instruct · 8-bit Alibaba24±5*†local~2.6GB32kOllama › Qwen2-0.5B-Instruct model card
445Molmo 7B-D (0924) · 4-bit Ai224±3local~35GBhow to run › Pixtral 12B (Mistral AI, arXiv 2410.07073v2)Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding (Ai2, arXiv 2601.10611v4)
446Gemma 2 2B IT · 8-bit Google24±1local~5.3GB8kOllama › WildEval ZeroEval published resultsIBM Granite 3.0 Language Models technical report (GitHub)
447Command R (03-2024) · 8-bit Cohere23±1*local~46GB128kOllama › WildEval ZeroEval published results
448Llama 2 7B Chat · 8-bit Meta23±5*local~11GB4kOllama › Tulu 2 — base and instruction-tuned evaluations
449Qwen2-VL 2B Instruct · 4-bit Alibaba23±3*†local~3.3GB33kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
450StarCoderBase 15.5B · 8-bit BigCode23±2*†local~19GBllama.cpp › StarCoder 2 and The Stack v2: The Next Generation — authors' own runs
451Qwen2 1.5B Instruct · 8-bit Alibaba23±1local~4GB32kOllama › WildEval ZeroEval published resultsQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Qwen2-0.5B-Instruct model card
452Granite 3.0 1B-A400M Instruct · 8-bit IBM23±3*†local~3GB4kllama.cpp › IBM Granite 3.0 Language Models technical report (GitHub)
453Code Llama 7B (base) · 8-bit Meta22±2local~9.1GB16kOllama › StarCoder 2 and The Stack v2: The Next Generation — authors' own runsMistral 7B — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsTulu 2 — base and instruction-tuned evaluations
455Granite 4.0 H 350M · 8-bit IBM20±2†local~1.9GB33kOllama › ibm-granite/granite-4.0-h-1b model card
456Granite 4.0 350M · 16-bit IBM19±2local~2.9GB32kOllama › ibm-granite/granite-4.0-h-1b model cardEpoch AI — internal evaluations
457Llama 2 13B Chat · 8-bit Meta19±3*local~18GB4kOllama › Orca 2: Teaching Small Language Models How to Reason (Mitra et al., Microsoft)Tulu 2 — base and instruction-tuned evaluations
458Llama 2 7B (base) · 8-bit Meta18±2local~9.1GB4kllama.cpp › Mixtral of Experts — base-model evaluationsMistral 7B — authors' own runsMiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies (Hu et al.)Tulu 2 — base and instruction-tuned evaluations
460DeepSeek-Coder 1.3B Base · 8-bit DeepSeek17±3*local~3GB16kOllama › StarCoder 2 and The Stack v2: The Next Generation — authors' own runs
461StarCoderBase 7B · 4-bit BigCode17±2local~33GBhow to run › StarCoder 2 and The Stack v2: The Next Generation — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
462StarCoderBase 3B · 4-bit BigCode13±3*†local~14GBhow to run › StarCoder 2 and The Stack v2: The Next Generation — authors' own runs
—DeepSeek LLM 7B Chat · q4_0 DeepSeeknot yet calibratedlocal~5.7GBOllama › DeepSeek vendor-reported benchmark scores for its own models (Hugging Face model cards)
—DeepSeek-V2 Lite Chat (16B-A2.4B) · q8_0 DeepSeeknot yet calibratedlocal~22GB32kOllama › DeepSeek vendor-reported benchmark scores for its own models (Hugging Face model cards)
—Eurus-2-7B-PRIME · fp32 PRIME-RLnot yet calibratedlocal~40GB4khow to run › PRIME-RL Eurus-2-7B-PRIME model card, Evaluation table (own models)
—Eurus-2-7B-SFT · Q8_0 PRIME-RLnot yet calibratedlocal~10GBllama.cpp › PRIME-RL Eurus-2-7B-PRIME model card, Evaluation table (own models)
—Flan-T5 Base · fp32 Googlenot yet calibratedlocal~2.5GBhow to run › Scaling Instruction-Finetuned Language Models — authors' own runs
—Flan-T5 Large · fp32 Googlenot yet calibratedlocal~4.8GBhow to run › Scaling Instruction-Finetuned Language Models — authors' own runs
—Flan-T5 Small · fp32 Googlenot yet calibratedlocal~1.8GBhow to run › Scaling Instruction-Finetuned Language Models — authors' own runs
—Flan-T5 XL · fp32 Googlenot yet calibratedlocal~14GBhow to run › Scaling Instruction-Finetuned Language Models — authors' own runs
—Flan-T5 XXL · fp32 Googlenot yet calibratedlocal~49GBhow to run › Scaling Instruction-Finetuned Language Models — authors' own runs
—Gemma 3n E2B IT · q8_0 Googlenot yet calibratedlocal~8.9GB32kOllama › Google DeepMind Gemma 3n E2B IT model card
—Gemma 3n E4B · q8_0 Googlenot yet calibratedlocal~12GB32kOllama › Google DeepMind Gemma 3n E2B IT model card
—GPT-2 XL (1.5B) · fp32 OpenAInot yet calibratedlocal~8.3GB1khow to run › EleutherAI GPT-Neo 2.7B model card — EleutherAI evaluation-harness runs
—GPT-Neo 1.3B · fp32 EleutherAInot yet calibratedlocal~7.1GB2khow to run › EleutherAI GPT-Neo 2.7B model card — EleutherAI evaluation-harness runs
—GPT-Neo 2.7B · fp32 EleutherAInot yet calibratedlocal~13GB2khow to run › EleutherAI GPT-Neo 2.7B model card — EleutherAI evaluation-harness runs
—Granite 4.1 30B · q4_k_m IBMnot yet calibratedlocal~19GBOllama › ibm-granite/granite-4.1-8b model card
—Granite 4.1 3B · q4_k_m IBMnot yet calibratedlocal~3.7GBOllama › ibm-granite/granite-4.1-8b model card
—Granite 4.1 8B · q8_0 IBMnot yet calibratedlocal~11GB131kllama.cpp › ibm-granite/granite-4.1-8b model card
—Hunyuan Hy3 (295B-A21B) Tencentnot yet calibratedapi $0.23/M~96GB256kdeepinfra.com ↗tencent/Hy3 model cardTencent Hy4 preview model card
—Hy4 preview (770B-A49B) Tencentnot yet calibratedapi $1.25/M~248GB1Mcloud.tencent.com ↗Tencent Hy4 preview model card
—K2 Horizon 7B · gguf-q8_0 Institute of Foundation Models (MBZUAI)not scored yetlocal~13GB524kllama.cpp ›
—Ling 3.0 Flash (124B-A5B) inclusionAI (Ant Group)not yet calibratedapi $0.090/M +local~80GB131kdeepinfra.com ↗inclusionAI/Ling-3.0-flash model card
—Llama 3.1 Nemotron Ultra 253B v1 · ud-q2_k_xl NVIDIAnot yet calibratedlocal (slow)~82GB128kllama.cpp › NVIDIA — Llama-Nemotron: Efficient Reasoning Models
—Llama 3.3 Nemotron Super 49B v1 · q4_k_m NVIDIAnot yet calibratedlocal~33GBllama.cpp › NVIDIA — Llama-Nemotron: Efficient Reasoning Models
—MiniMax-M1 (80k) MiniMaxnot yet calibratedapi $0.96/M~959GB1Mnovita.ai ↗MiniMaxAI/MiniMax-M1-80k model card
—Ministral 3 14B Reasoning 2512 · q4_k_m Mistralnot yet calibratedlocal~10GB262kllama.cpp › mistralai/Ministral-3-3B-Reasoning-2512 model cardmistralai/Ministral-3-8B-Reasoning-2512 model card
—Ministral 3 3B Reasoning 2512 · q4_k_m Mistralnot yet calibratedlocal~3.8GB262kllama.cpp › mistralai/Ministral-3-8B-Reasoning-2512 model cardmistralai/Ministral-3-3B-Reasoning-2512 model card
—Ministral 3 8B Reasoning 2512 · q4_k_m Mistralnot yet calibratedlocal~7GB262kllama.cpp › mistralai/Ministral-3-3B-Reasoning-2512 model cardmistralai/Ministral-3-8B-Reasoning-2512 model card
—Mistral Small 4 (119B-A6.5B) · ud-q2_k_xl Mistralnot scored yetlocal~40GB262kllama.cpp ›
—Muse Glimmer 30B · q8_0 Metanot scored yetlocal~40GB131kOllama ›
—Nova Premier Amazonnot yet calibratedapi $5.00/M1Maws.amazon.com ↗Amazon vendor-reported benchmark scores for its own Nova models (Amazon Science technical reports)
—Nova Pro Amazonnot yet calibratedapi $1.40/M300kdocs.aws.amazon.com ↗Amazon vendor-reported benchmark scores for its own Nova models (Amazon Science technical reports)
—OLMo 7B · fp32 Allen Institute for AInot yet calibratedlocal~30GB2khow to run › OLMo: Accelerating the Science of Language Models — authors' own runs
—OLMo 7B Instruct · bf16 Ai2not yet calibratedlocal~16GBhow to run › OLMo: Accelerating the Science of Language Models — authors' own runs
—OpenChat 3.5 · q8_0 OpenChatnot yet calibratedlocal~11GB8kOllama › OpenChat 3.5 model card (openchat/openchat_3.5)
—OpenHermes 2.5 Mistral 7B · q8_0 Nous Researchnot yet calibratedlocal~11GBOllama › OpenChat 3.5 model card (openchat/openchat_3.5)
—Qwen2.5 0.5B Instruct · q8_0 Alibabanot yet calibratedlocal~2.6GB33kOllama › HuggingFaceTB/SmolLM2-360M-Instruct model card
—SmolLM2 360M Instruct · fp16 Hugging Facenot yet calibratedlocal~2.3GB8kOllama › HuggingFaceTB/SmolLM2-360M-Instruct model card
—Trinity-Large-Thinking Arcee AInot yet calibratedapi $0.39/M~141GB512kdocs.arcee.ai ↗Arcee AI vendor-reported benchmark scores for its own Trinity models (Hugging Face model cards)

+ 94 more don't fit your machine or budget · show them

+ 2 models with fewer than 3 results left off, since one or two tests say little about overall ability · show them

509 of 511 catalogue models listed here · sources and licences

* new or thinly tested: ranked on too few benchmark results · † only the maker’s own numbers so far · ~RAM is estimated; full context may need more memory