whatmodel.sh · find the best AI models you can run

Best AI models for coding to run locally on a 16GB Mac

A leaderboard of the best AI models for coding you can run locally on a Mac with 16GB of memory. MiMo-V2.6-Distill-Qwen-9B is #1 right now, followed by Gemma 4 12B and Spark-X2.5 4B. Models are ranked on coding tests like HumanEval, SWE-bench and Aider. Each model shows the download that fits and the command to run it.

189 models · scores combine 59 benchmarks · updated how it works · find a leaderboard · benchmark your machine

Scores use reviewed coding evaluations only. Compare scores within this task. Models without task measurements are excluded.

Models for 16GB RAM · Apple Silicon → ~11GB fast · local only · reset
+ more
$ terminal

detecting your OS…

Score vs memory to run

#modeltask score↓where↓speed↓RAM↓context↓get itsources
135MiMo-V2.6-Distill-Qwen-9B · 4-bit Xiaomi61±3*†local~8.6GBllama.cpp › XiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B model card
142Gemma 4 12B · 4-bit Google60±3local~9.5GB262kOllama › Gemma Team — Gemma 4 Technical ReportXHToken/Spark-X2.5-4B model card
153Spark-X2.5 4B · 16-bit iFLYTEK (SparkLLM)59±2†local~10GB1MOllama › XHToken/Spark-X2.5-4B model card
163Phi-4-reasoning 14B · 4-bit Microsoft58±3*†local~10GB33kLM Studio › Microsoft — Phi-4-reasoning Technical Reportmicrosoft/Phi-4-reasoning model card
168Ministral 3 8B Reasoning 2512 · 4-bit Mistral58±6*†local~7GB262kllama.cpp › mistralai/Ministral-3-8B-Reasoning-2512 model cardmistralai/Ministral-3-3B-Reasoning-2512 model card
176MiniCPM5 2B · 4-bit OpenBMB57±2†local~4.3GB131kLM Studio › openbmb/MiniCPM5-2B model card
189Nemotron-Cascade-14B-Thinking · 4-bit NVIDIA56±1†local~10GBLM Studio › NVIDIA — Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Models
190Mellum2.1 12B-A2.5B Thinking · 4-bit JetBrains56±3†local~10GBllama.cpp › JetBrains/Mellum2.1-12B-A2.5B-Thinking model card
197Phi-4-reasoning-plus 14B · 4-bit Microsoft55±2local~10GBLM Studio › Microsoft — Phi-4-reasoning Technical Reportmicrosoft/Phi-4-reasoning model cardFalcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scaling
203Apriel 1.6 15B Thinker · 4-bit ServiceNow55±2*†local~10GBLM Studio › ServiceNow-AI/Apriel-1.6-15b-Thinker model card
208Qwen3.5 9B · 4-bit Alibaba54±1local~8.1GB262kOllama › JetBrains/Mellum2.1-12B-A2.5B-Thinking model cardXiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B model cardJetBrains/Mellum2-12B-A2.5B-Instruct model cardXHToken/Spark-X2.5-4B model cardRoblox LLM Leaderboard (Torpedo Software): RobloxQA v2.0 and Luau LeetcodeQwen/Qwen3.5-4B model card+3
219Granite 4.2 8B · 4-bit IBM53±2†local~7.6GB131kOllama › ibm-granite/granite-4.2-30b model card
222Nemotron-Cascade-8B · 8-bit NVIDIA53±2†local~11GBllama.cpp › NVIDIA — Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Models
223Granite 4.1 8B · 4-bit IBM53±1local~7.1GB131kllama.cpp › LMArena leaderboard datasetibm-granite/granite-4.1-8b model card
224Nemotron-Cascade-8B-Thinking · 8-bit NVIDIA53±2†local~11GBllama.cpp › NVIDIA — Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Models
225Ministral 3 3B Reasoning 2512 · 4-bit Mistral52±6*†local~5.3GB262kLM Studio › mistralai/Ministral-3-8B-Reasoning-2512 model cardmistralai/Ministral-3-3B-Reasoning-2512 model card
239Falcon-H1R 7B · 4-bit TII52±4*†local~10GB262kLM Studio › Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scaling
247Qwen3-VL 8B Thinking · 8-bit Alibaba51±2*†local~11GB256kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
250Qwen2.5 Coder 14B Instruct · 4-bit Alibaba51±1local~10GB131kLM Studio › Aider code editing benchmark runs (old edit leaderboard)Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
257Nemotron Nano 9B v2 · 4-bit NVIDIA50±1local~9.1GB131kLM Studio › NVIDIA — Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning ModelsOlmo 3NVIDIA vendor-reported benchmark scores for its own Nemotron models (Hugging Face model cards)
265Qwen3 4B Thinking 2507 · 8-bit Alibaba50±6*†local~7.1GB262kOllama › Qwen/Qwen3-4B-Thinking-2507 model card
267Ministral 3 14B Reasoning 2512 · 4-bit Mistral50±4local~10GB262kLM Studio › JetBrains/Mellum2-12B-A2.5B-Thinking model cardmistralai/Ministral-3-8B-Reasoning-2512 model cardmistralai/Ministral-3-3B-Reasoning-2512 model card
268Phi-4 14B · 4-bit Microsoft50±1local~10GB16kLM Studio › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)Microsoft Research — Phi-4 Technical ReportMicrosoft — Phi-4-reasoning Technical Reportmicrosoft/Phi-4-reasoning model cardmicrosoft/phi-4 model card
269Granite 4.2 3B · 8-bit IBM50±2local~5.6GB131kllama.cpp › openbmb/MiniCPM5-2B model cardibm-granite/granite-4.2-30b model card
270Mellum2 12B-A2.5B Thinking · 4-bit JetBrains50±2†local~10GB131kllama.cpp › JetBrains/Mellum2.1-12B-A2.5B-Thinking model cardJetBrains/Mellum2-12B-A2.5B-Thinking model card
273Olmo 3 7B Think · 8-bit Ai249±2local~9.7GB66kllama.cpp › Olmo 3JetBrains/Mellum2-12B-A2.5B-Thinking model card
277Qwen3.5 4B · 4-bit Alibaba49±1local~6.9GB262kLM Studio › openbmb/MiniCPM5-2B model cardXHToken/Spark-X2.5-4B model cardJetBrains/Mellum2-12B-A2.5B-Instruct model cardLiquidAI/LFM2.5-2.6B model cardQwen/Qwen3.5-4B model cardJetBrains/Mellum2-12B-A2.5B-Thinking model card+1
281DeepSeek R1 Distill Qwen 14B · 4-bit DeepSeek49±2local~10GB131kLM Studio › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)deepseek-ai/DeepSeek-R1 model card
282Qwen2.5 14B Instruct · 4-bit Alibaba49±1local~10GB131kLM Studio › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)Microsoft Research — Phi-4 Technical Reportmicrosoft/phi-4 model card
286CodeQwen1.5 7B Chat · 8-bit Alibaba48±1local~9.6GB64kllama.cpp › EvalPlus / EvalPerf published evaluation runsQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
287OpenCoder-8B-Instruct · 8-bit INF (infly)48±1local~10GBllama.cpp › EvalPlus / EvalPerf published evaluation runs
290Qwen3 8B · 8-bit Alibaba48±2local~11GB33kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scaling
292Qwen2.5 Coder 7B Instruct · 8-bit Alibaba48±1local~10GB131kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Aider code editing benchmark runs (old edit leaderboard)CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)LiveCodeBench official website results (2024-12-26)
295DeepSeek R1 0528 Qwen3 8B · 8-bit DeepSeek47±4local~11GB128kllama.cpp › Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scalingdeepseek-ai/DeepSeek-R1-0528-Qwen3-8B model card
296Qwen3-VL 4B Thinking · 8-bit Alibaba47±2*†local~6.9GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
300OpenThinker3 7B · 8-bit Open Thoughts47±2local~10GB33kllama.cpp › Olmo 3
304Phi-3 Medium 128K Instruct · 4-bit Microsoft47±2local~11GB128kllama.cpp › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
307Gemma 4 E4B · 8-bit Google47±1local~9.9GB131kllama.cpp › openbmb/MiniCPM5-2B model cardJetBrains/Mellum2.1-12B-A2.5B-Thinking model cardGemma Team — Gemma 4 Technical ReportLiquidAI/LFM2.5-2.6B model cardXHToken/Spark-X2.5-4B model card
311Gemma 2 9B IT · 4-bit Google46±2local~7.8GB8kOllama › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)WildEval ZeroEval published results
313Qwen2.5 7B Instruct · 8-bit Alibaba46±1local~10GB131kllama.cpp › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)LiveCodeBench official website results (2024-12-26)WildEval ZeroEval published results
314Mistral NeMo Instruct (2407) · 4-bit Mistral46±2local~9.7GB128kOllama › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
317OpenCodeInterpreter-DS-6.7B · 8-bit M-A-P46±1local~9.1GBllama.cpp › EvalPlus / EvalPerf published evaluation runs
321Magicoder-S-DS 6.7B · 8-bit UIUC (ise-uiuc)46±1local~9.1GBllama.cpp › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsCRUXEval published evaluation results (authors' generations and scores)
322Artigenz-Coder-DS-6.7B · 4-bit Artigenz46±1local~5.8GBllama.cpp › EvalPlus / EvalPerf published evaluation runs
325Yi 1.5 9B Chat · 4-bit 01.AI45±2local~7.6GB4kOllama › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)WildEval ZeroEval published results
326Nemotron 3 Nano 4B · 8-bit NVIDIA45±2local~7GB262kOllama › openbmb/MiniCPM5-2B model cardNVIDIA vendor-reported benchmark scores for its own Nemotron models (Hugging Face model cards)
327Pixtral 12B (2409) · 4-bit Mistral45±3*local~9.6GBllama.cpp › Pixtral 12B (Mistral AI, arXiv 2410.07073v2)VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback? (arXiv:2608.10408v1)
329Granite 4.1 3B · 4-bit IBM45±2†local~3.7GBOllama › ibm-granite/granite-4.1-8b model card
334DeepSeek-Coder 6.7B Instruct · 8-bit DeepSeek45±1local~9.1GB16kOllama › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsLiveCodeBench official website results (2024-12-26)CRUXEval published evaluation results (authors' generations and scores)
335AceReason-Nemotron-1.0-14B · 4-bit NVIDIA45±2†local~10GBLM Studio › NVIDIA — Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Models
336WaveCoder-Ultra-6.7B · 8-bit Microsoft45±1local~9.1GBllama.cpp › EvalPlus / EvalPerf published evaluation runs
338Yi-Coder 9B Chat · 4-bit 01.AI45±1local~7.6GB128kOllama › Aider code editing benchmark runs (old edit leaderboard)CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)LiveCodeBench official website results (2024-12-26)
339MiniCPM3-4B · 4-bit OpenBMB45±2*local~4.1GB32kllama.cpp › LiveCodeBench official website results (2024-12-26)
341Ministral 3 14B · 4-bit Mistral44±4*local~10GB262kllama.cpp › JetBrains/Mellum2-12B-A2.5B-Instruct model card
342OpenThinker2 7B · 4-bit Open Thoughts44±9*†local~6.4GB33kllama.cpp › open-thoughts/OpenThinker2-7B model card
343DeepSeek-Coder 7B Instruct v1.5 · 8-bit DeepSeek44±1local~9.2GBllama.cpp › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsCodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
345Qwen3 4B · 8-bit Alibaba44±2local~7.1GB33kOllama › Qwen/Qwen3-4B-Instruct-2507 model cardQwen/Qwen3-4B-Thinking-2507 model cardHuggingFaceTB/SmolLM3-3B model card (Evaluation section)
346Gemma 3 12B · 4-bit Google44±2local~9.7GB131kOllama › Google DeepMind Gemma 3 270M IT model cardVisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback? (arXiv:2608.10408v1)
350OpenChat 3.5 0106 · 8-bit OpenChat44±1local~9.6GB8kllama.cpp › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runs
355Magicoder-S-CL-7B · 8-bit UIUC (ise-uiuc)43±1local~9.1GBllama.cpp › EvalPlus / EvalPerf published evaluation runs
356Qwen2.5 Coder 3B Instruct · 4-bit Alibaba43±1local~5GB33kLM Studio › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Aider code editing benchmark runs (old edit leaderboard)
359speechless-coder-ds-6.7b · 8-bit uukuguy43±1local~9.1GBllama.cpp › EvalPlus / EvalPerf published evaluation runs
360Spark-X2.5 1.7B · 16-bit iFLYTEK (SparkLLM)43±3†local~5.1GB1MOllama › XHToken/Spark-X2.5-4B model card
363Phi-4-mini 3.8B · 8-bit Microsoft43±2†local~6.9GB128kOllama › Microsoft — Phi-4-Mini Technical Report
365AceReason-Nemotron-1.1-7B · 8-bit NVIDIA42±2†local~10GBllama.cpp › NVIDIA — Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Models
369Qwen3 4B Instruct 2507 · 8-bit Alibaba42±2local~7.1GB262kOllama › Qwen/Qwen3-4B-Instruct-2507 model cardQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Roblox LLM Leaderboard (Torpedo Software): RobloxQA v2.0 and Luau Leetcode
373Mellum2 12B-A2.5B Instruct · 4-bit JetBrains42±4*†local~10GB131kllama.cpp › JetBrains/Mellum2-12B-A2.5B-Instruct model card
374Llama 3.1 8B Instruct · 8-bit Meta42±1local~10GB128kllama.cpp › EvalPlus / EvalPerf published evaluation runsAider code editing benchmark runs (old edit leaderboard)CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)IBM Granite 3.0 Language Models technical report (GitHub)LiveCodeBench official website results (2024-12-26)WildEval ZeroEval published results+2
375Llama 3.2 11B Vision Instruct · 4-bit Meta42±3*local~8.8GB128kOllama › Pixtral 12B (Mistral AI, arXiv 2410.07073v2)
377Granite 3.0 8B Instruct · 8-bit IBM42±2local~11GB4kllama.cpp › IBM Granite 3.0 Language Models technical report (GitHub)CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
378Qwen2-VL 7B Instruct · 4-bit Alibaba42±3*local~7.2GBllama.cpp › Pixtral 12B (Mistral AI, arXiv 2410.07073v2)
379Phi-3-mini-128k-instruct (Apr 2024) · 16-bit Microsoft42±2local~9.5GBhow to run › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
380Qwen2.5 3B Instruct · 8-bit Alibaba42±2local~5.9GB33kOllama › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)WildEval ZeroEval published results
382Phi-3-mini-4k-instruct (June 2024 update) · 4-bit Microsoft41±3*local~5.8GBLM Studio › WildEval ZeroEval published results
383Qwen3-VL 8B Instruct · 8-bit Alibaba41±2*†local~11GB256kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
386Granite 8B Code Instruct (4K) · 4-bit IBM41±2†local~6.6GBllama.cpp › Granite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
388Phi-3.5-mini-instruct · 8-bit Microsoft41±2local~6.8GB128kOllama › Microsoft — Phi-4-Mini Technical ReportWildEval ZeroEval published results
389Falcon3 7B Instruct · 8-bit TII41±2local~9.8GB32kllama.cpp › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
390Qwen3-VL 4B Instruct · 8-bit Alibaba41±2*†local~6.9GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
395DeepSeek-Coder 1.3B Instruct · 8-bit DeepSeek40±1local~3GB16kOllama › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsCodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)LiveCodeBench official website results (2024-12-26)CRUXEval published evaluation results (authors' generations and scores)
398Olmo 3 7B Instruct · 8-bit Ai239±2local~9.7GB66kllama.cpp › Olmo 3JetBrains/Mellum2-12B-A2.5B-Instruct model card
399OpenChat 3.5 · 8-bit OpenChat39±3*†local~9.6GB8kllama.cpp › OpenChat 3.5 model card (openchat/openchat_3.5)
400Llama 3 8B Instruct · 8-bit Meta39±1local~10GB8kllama.cpp › EvalPlus / EvalPerf published evaluation runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsWildEval ZeroEval published resultsLiveCodeBench official website results (2024-12-26)WebApp1K models leaderboard (onekq-ai)
402Qwen2 7B Instruct · 8-bit Alibaba39±3*local~10GB131kllama.cpp › WildEval ZeroEval published results
403Falcon3 10B Instruct · 4-bit TII39±2local~8.5GB32kOllama › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
405WizardCoder Python 13B V1.0 · 4-bit WizardLM39±3local~9.8GB16kOllama › WizardLM team vendor-reported scores for its own WizardCoder models (Hugging Face card)CRUXEval published evaluation results (authors' generations and scores)
406Qwen2.5 Coder 1.5B Instruct · 8-bit Alibaba39±1local~3.5GB33kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Aider code editing benchmark runs (old edit leaderboard)
407Gemma 4 E2B · 4-bit Google39±2local~7.7GB131kLM Studio › openbmb/MiniCPM5-2B model cardGemma Team — Gemma 4 Technical ReportLiquidAI/LFM2.5-2.6B model cardXHToken/Spark-X2.5-4B model card
408CodeGemma 7B IT (v1.0) · 4-bit Google39±1local~7.7GBLM Studio › EvalPlus / EvalPerf published evaluation runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsCodeGemma: Open Code Models Based on Gemma — authors' own runs
409LFM2.5 2.6B · 4-bit Liquid AI38±2local~4.5GB131kLM Studio › openbmb/MiniCPM5-2B model cardLiquidAI/LFM2.5-2.6B model card
412speechless-starcoder2-7b · 8-bit uukuguy38±1local~9.5GBllama.cpp › EvalPlus / EvalPerf published evaluation runs
416Qwen2.5 1.5B Instruct · 8-bit Alibaba37±2local~4GB33kOllama › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)SmolLM2 paper (Hugging Face) — authors' own instruct-model evaluations
417Hermes 3 Llama 3.1 8B · 8-bit Nous Research37±2*local~10GB128kllama.cpp › Aider code editing benchmark runs (old edit leaderboard)
419Qwen3 1.7B · 8-bit Alibaba37±2*local~4.6GB33kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)HuggingFaceTB/SmolLM3-3B model card (Evaluation section)
420OpenHermes 2.5 Mistral 7B · 8-bit Nous Research37±3*local~9.6GBllama.cpp › OpenChat 3.5 model card (openchat/openchat_3.5)
421Gemma 3 4B · 8-bit Google37±2local~7.4GB131kOllama › Google DeepMind Gemma 3 270M IT model cardVisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback? (arXiv:2608.10408v1)
423Command R7B (12-2024) · 8-bit Cohere37±2†local~10GB128kllama.cpp › Cohere — Command A technical report
424OpenHermes-2.5-Code-290k-13B · 4-bit ajibawa-202337±1local~9.8GBllama.cpp › EvalPlus / EvalPerf published evaluation runs
425WizardLM 13B V1.2 · 4-bit Microsoft36±3local~9.8GBllama.cpp › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
427Granite 3.0 2B Instruct · 8-bit IBM36±2local~5.3GB4kOllama › IBM Granite 3.0 Language Models technical report (GitHub)CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
429Qwen3-VL 2B Thinking · 8-bit Alibaba36±3*†local~4.2GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
430CodeQwen1.5 7B (base) · 8-bit Alibaba36±1local~9.6GB66kllama.cpp › EvalPlus / EvalPerf published evaluation runs
432Llama 3.2 3B Instruct · 8-bit Meta36±1local~6.1GB131kOllama › Aider code editing benchmark runs (old edit leaderboard)IBM Granite 3.0 Language Models technical report (GitHub)CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
433Granite 3B Code Instruct (2K) · 4-bit IBM36±2†local~3.7GBllama.cpp › Granite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
434Phi-2 (2.7B) · 4-bit Microsoft35±1local~7.3GB2khow to run › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsMiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies (Hu et al.)CRUXEval published evaluation results (authors' generations and scores)
435Falcon3 3B Instruct · 8-bit TII35±3local~6.1GB32kOllama › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
436SmolLM3 3B · 8-bit Hugging Face35±6*†local~5.9GB66kllama.cpp › HuggingFaceTB/SmolLM3-3B model card (Evaluation section)
439Code Llama 13B Instruct · 4-bit Meta35±1local~9.8GB16kOllama › Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsCode Llama: Open Foundation Models for Code — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsTulu 2 — base and instruction-tuned evaluations
441LFM2.5 8B-A1B · 4-bit Liquid AI35±2local~7.4GB128kOllama › openbmb/MiniCPM5-2B model card
444Granite 8B Code Base (4K) · 4-bit IBM35±1†local~6.6GBllama.cpp › Granite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
445DeepSeek-Coder 6.7B Base · 8-bit DeepSeek35±1local~9.1GB16kOllama › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsStarCoder 2 and The Stack v2: The Next Generation — authors' own runsCRUXEval published evaluation results (authors' generations and scores)
447MistralHermes-CodePro-7B-v1 · 8-bit beowolx34±1local~9.6GBllama.cpp › EvalPlus / EvalPerf published evaluation runs
449Code Llama 13B Python · 4-bit Meta34±1local~9.8GB16kOllama › Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsCode Llama: Open Foundation Models for Code — authors' own runsCRUXEval published evaluation results (authors' generations and scores)
453CodeGemma 7B (v1.0) · 4-bit Google34±1local~7.7GBLM Studio › EvalPlus / EvalPerf published evaluation runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsCodeGemma: Open Code Models Based on Gemma — authors' own runs
454Qwen1.5 7B Chat · 8-bit Alibaba34±1*local~10GB32kllama.cpp › Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runs
455EXAONE 3.5 2.4B Instruct · 8-bit LG AI Research34±3local~5.1GB33kOllama › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
457Code Llama 7B Instruct · 8-bit Meta33±1local~9.1GB16kOllama › Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsCode Llama: Open Foundation Models for Code — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsTulu 2 — base and instruction-tuned evaluations
458Code Llama 7B Python · 8-bit Meta33±1local~9.1GB16kOllama › Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsCode Llama: Open Foundation Models for Code — authors' own runsCRUXEval published evaluation results (authors' generations and scores)
459Code Llama 13B (base) · 4-bit Meta33±1local~9.8GB16kOllama › EvalPlus / EvalPerf published evaluation runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsStarCoder 2 and The Stack v2: The Next Generation — authors' own runsCode Llama: Open Foundation Models for Code — authors' own runsTulu 2 — base and instruction-tuned evaluationsCRUXEval published evaluation results (authors' generations and scores)
460SOLAR 10.7B Instruct v1.0 · 4-bit Upstage33±1local~8.8GB4kOllama › EvalPlus / EvalPerf published evaluation runs
461Qwen2.5 Coder 0.5B Instruct · 4-bit Alibaba33±1local~2GB33kLM Studio › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Aider code editing benchmark runs (old edit leaderboard)
462Gemma 1.1 7B IT · 4-bit Google32±1local~7.7GB8kLM Studio › EvalPlus / EvalPerf published evaluation runs
463Gemma 2 2B IT · 8-bit Google32±2local~5.3GB8kOllama › IBM Granite 3.0 Language Models technical report (GitHub)WildEval ZeroEval published results
464DeepSeek LLM 7B Chat · 4-bit DeepSeek32±3*†local~5.7GBOllama › DeepSeek vendor-reported benchmark scores for its own models (Hugging Face model cards)
465SmolLM2 1.7B Instruct · 8-bit Hugging Face32±4*†local~4.2GB8kOllama › SmolLM2 paper (Hugging Face) — authors' own instruct-model evaluations
466Mistral 7B Instruct v0.2 · 8-bit Mistral32±1local~9.6GB32kllama.cpp › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
467Llama 3.2 1B Instruct · 4-bit Meta31±2local~5.2GB131kOllama › IBM Granite 3.0 Language Models technical report (GitHub)CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)SmolLM2 paper (Hugging Face) — authors' own instruct-model evaluations
468xDAN-L1-Chat-RL-v1 · 8-bit xDAN-AI31±1local~9.6GBllama.cpp › EvalPlus / EvalPerf published evaluation runs
469Granite 3.0 3B-A800M Instruct · 8-bit IBM31±2*†local~5.3GB4kllama.cpp › IBM Granite 3.0 Language Models technical report (GitHub)
470Code Llama 7B (base) · 8-bit Meta31±1local~9.1GB16kOllama › EvalPlus / EvalPerf published evaluation runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsStarCoder 2 and The Stack v2: The Next Generation — authors' own runsCode Llama: Open Foundation Models for Code — authors' own runsTulu 2 — base and instruction-tuned evaluationsMistral 7B — authors' own runs+1
472Granite 3B Code Base (2K) · 4-bit IBM30±2†local~3.7GBllama.cpp › Granite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
473StarCoder2 7B · 8-bit BigCode30±1local~9.5GB16kOllama › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsStarCoder 2 and The Stack v2: The Next Generation — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
474Qwen3-VL 2B Instruct · 8-bit Alibaba30±3*†local~4.2GB256kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
476Gemma 7B (base) · 4-bit Google30±1local~7.3GB8kOllama › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsCodeGemma: Open Code Models Based on Gemma — authors' own runsGemma report — original evaluations
477Llama 3 8B (base) · 8-bit Meta30±1local~10GBllama.cpp › EvalPlus / EvalPerf published evaluation runs
478StarCoder2 3B · 4-bit BigCode29±1local~5.1GB16kLM Studio › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsStarCoder 2 and The Stack v2: The Next Generation — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
480Mistral 7B Instruct v0.1 · 8-bit Mistral29±1*local~9.6GB8kllama.cpp › Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runs
483DeepSeek-Coder 1.3B Base · 8-bit DeepSeek28±1local~3GB16kOllama › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsStarCoder 2 and The Stack v2: The Next Generation — authors' own runsCRUXEval published evaluation results (authors' generations and scores)
484Stable Code 3B · 8-bit Stability AI28±1local~4.7GB16kOllama › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsStarCoder 2 and The Stack v2: The Next Generation — authors' own runs
485OpenThinker 7B · 8-bit Open Thoughts28±8*†local~10GB33kllama.cpp › open-thoughts/OpenThinker2-7B model cardopen-thoughts/OpenThinker-7B model card
486Mistral 7B v0.1 (base) · 8-bit Mistral AI28±1local~9.6GB8kllama.cpp › EvalPlus / EvalPerf published evaluation runsMixtral of Experts — base-model evaluationsMiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies (Hu et al.)Mistral 7B — authors' own runsGemma report — original evaluations
487Gemma 7B IT · 4-bit Google28±1local~7.4GB8kOllama › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
488Zephyr 7B beta · 8-bit Hugging Face28±1local~9.6GBllama.cpp › EvalPlus / EvalPerf published evaluation runsTulu 2 — base and instruction-tuned evaluationsOpenChat 3.5 model card (openchat/openchat_3.5)
489DeepSeek R1 Distill Qwen 7B · 8-bit DeepSeek27±3local~10GB131kllama.cpp › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)deepseek-ai/DeepSeek-R1 model cardopen-thoughts/OpenThinker2-7B model cardopen-thoughts/OpenThinker-7B model card
490DeepSeek R1 Distill Llama 8B · 8-bit DeepSeek27±4local~10GB131kllama.cpp › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)deepseek-ai/DeepSeek-R1 model card
491Tulu 2 13B · 4-bit Allen Institute for AI27±2*†local~9.8GBllama.cpp › Tulu 2 — base and instruction-tuned evaluations
492Tulu 2 DPO 13B · 4-bit Allen Institute for AI27±2*†local~9.8GBllama.cpp › Tulu 2 — base and instruction-tuned evaluations
493Granite 3.0 1B-A400M Instruct · 8-bit IBM27±2*†local~3GB4kllama.cpp › IBM Granite 3.0 Language Models technical report (GitHub)
494CodeGemma 2B (v1.0) · 8-bit Google27±1local~4.3GBOllama › EvalPlus / EvalPerf published evaluation runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsCodeGemma: Open Code Models Based on Gemma — authors' own runs
497StarCoderBase 7B · 4-bit BigCode26±1local~6GBOllama › EvalPlus / EvalPerf published evaluation runsStarCoder 2 and The Stack v2: The Next Generation — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsCRUXEval published evaluation results (authors' generations and scores)
498Falcon3 1B Instruct · 8-bit TII26±4local~4.1GB8kOllama › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
499Gemma 3 1B · 4-bit Google25±2†local~3GB32kLM Studio › Google DeepMind Gemma 3 270M IT model card
500Gemma 2B (base) · 8-bit Google25±1local~4.3GB8kOllama › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsCodeGemma: Open Code Models Based on Gemma — authors' own runsGemma report — original evaluations
501Qwen3.5 2B · 8-bit Alibaba24±3local~4.9GB262kOllama › openbmb/MiniCPM5-2B model cardXHToken/Spark-X2.5-4B model card
502Gemma 1.1 2B IT · 8-bit Google24±1local~5.2GB8kOllama › EvalPlus / EvalPerf published evaluation runs
503Tulu 2 DPO 7B · 8-bit Allen Institute for AI23±2*†local~9.1GBllama.cpp › Tulu 2 — base and instruction-tuned evaluations
504StarCoderBase 3B · 4-bit BigCode23±1local~3.4GBOllama › EvalPlus / EvalPerf published evaluation runsStarCoder 2 and The Stack v2: The Next Generation — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
506Llama 2 13B (base) · 4-bit Meta22±1local~9.8GB4kllama.cpp › Tulu 2 — base and instruction-tuned evaluationsMixtral of Experts — base-model evaluationsMiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies (Hu et al.)Mistral 7B — authors' own runs
507Tulu 2 7B · 8-bit Allen Institute for AI22±2*†local~9.1GBllama.cpp › Tulu 2 — base and instruction-tuned evaluations
508Gemma 2B IT · 8-bit Google22±1local~5.2GB8kOllama › EvalPlus / EvalPerf published evaluation runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runs
510Llama 2 13B Chat · 4-bit Meta21±2*local~10GB4kOllama › Tulu 2 — base and instruction-tuned evaluations
512OpenAssistant SFT-4 Pythia 12B · 4-bit LAION (OpenAssistant)20±2*local~9.5GBllama.cpp › InstructEval (DeCLaRe Lab) README results table
513Phi-1 (1.3B) · 4-bit Microsoft19±5*local~4.5GB2khow to run › CRUXEval published evaluation results (authors' generations and scores)
515Llama 2 7B (base) · 8-bit Meta19±1local~9.1GB4kllama.cpp › Tulu 2 — base and instruction-tuned evaluationsMixtral of Experts — base-model evaluationsMiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies (Hu et al.)Mistral 7B — authors' own runs
517Qwen3 0.6B · 8-bit Alibaba17±3*local~3GB33kOllama › Olmo 3
518Llama 2 7B Chat · 8-bit Meta16±2*local~11GB4kOllama › Tulu 2 — base and instruction-tuned evaluations
521DeepSeek R1 Distill Qwen 1.5B · 8-bit DeepSeek14±5local~4.3GB131kOllama › CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)deepseek-ai/DeepSeek-R1 model card
524Zyte-1B · 4-bit venkycs (aihub-app)3±2local~3.8GBhow to run › EvalPlus / EvalPerf published evaluation runs
—BLOOM 1.1B · fp16 BigSciencenot yet calibratedlocal~3.7GB2khow to run › BLOOM: A 176B-Parameter Open-Access Multilingual Language Model — authors' own runs
—BLOOM 1.7B · fp16 BigSciencenot yet calibratedlocal~5.1GB2khow to run › BLOOM: A 176B-Parameter Open-Access Multilingual Language Model — authors' own runs
—BLOOM 3B · fp16 BigSciencenot yet calibratedlocal~7.8GB2khow to run › BLOOM: A 176B-Parameter Open-Access Multilingual Language Model — authors' own runs
—BLOOM 560M · fp16 BigSciencenot yet calibratedlocal~2.7GB2khow to run › BLOOM: A 176B-Parameter Open-Access Multilingual Language Model — authors' own runs
—BLOOM 7.1B · Q8_0 BigSciencenot yet calibratedlocal~11GB2kllama.cpp › BLOOM: A 176B-Parameter Open-Access Multilingual Language Model — authors' own runs
—EXAONE Deep 2.4B · q4_k_m LG AI Researchnot yet calibratedlocal~3.2GB33kllama.cpp › LG AI Research vendor-reported benchmark scores for its own EXAONE models (Hugging Face model cards)
—EXAONE Deep 7.8B · mlx-8bit LG AI Researchnot yet calibratedlocal~10GB33kLM Studio › LG AI Research vendor-reported benchmark scores for its own EXAONE models (Hugging Face model cards)
—Gemma 3n E2B IT · q8_0 Googlenot yet calibratedlocal~8.9GB32kOllama › Google DeepMind Gemma 3n E2B IT model card
—Gemma 3n E4B · Q8_0 Googlenot yet calibratedlocal~9.3GB32kllama.cpp › Google DeepMind Gemma 3n E2B IT model card
—Granite 4.0 1B · bf16 IBMnot yet calibratedlocal~6.1GB128kOllama › ibm-granite/granite-4.0-h-1b model card
—Granite 4.0 350M · bf16 IBMnot yet calibratedlocal~2.9GB32kOllama › ibm-granite/granite-4.0-h-1b model card
—Granite 4.0 H 1B · q8_0 IBMnot yet calibratedlocal~3.2GB131kOllama › ibm-granite/granite-4.0-h-1b model card
—Granite 4.0 H 350M · mlx-8bit IBMnot yet calibratedlocal~1.9GB33kLM Studio › ibm-granite/granite-4.0-h-1b model card
—Granite 4.0 H Micro 3B · mlx-8bit IBMnot yet calibratedlocal~5.1GB131kLM Studio › ibm-granite/granite-4.0-h-small model card
—Granite 4.0 H Tiny (7B-A1B) · mlx-8bit IBMnot yet calibratedlocal~9.3GB131kLM Studio › ibm-granite/granite-4.0-h-small model card
—Granite 4.0 Micro 3B · Q8_0 IBMnot yet calibratedlocal~5.3GB131kllama.cpp › ibm-granite/granite-4.0-h-small model card
—K2 Horizon 7B · gguf-q4_k_m Institute of Foundation Models (MBZUAI)not scored yetlocal~7.7GB524kllama.cpp ›
—Ministral 8B (2410) · Q8_0 Mistralnot yet calibratedlocal~10GB128kllama.cpp › Mistral AI vendor-reported benchmark scores for its own models (Hugging Face model cards)
—Mistral 7B Instruct v0.3 · Q8_0 Mistralnot yet calibratedlocal~9.6GB32kllama.cpp › Mistral AI vendor-reported benchmark scores for its own models (Hugging Face model cards)
—Qwen2 0.5B Instruct · q8_0 Alibabanot yet calibratedlocal~2.6GB32kOllama › Qwen2-0.5B-Instruct model card
—Qwen2 1.5B Instruct · q8_0 Alibabanot yet calibratedlocal~4GB32kOllama › Qwen2-0.5B-Instruct model card

+ 383 more don't fit your machine or budget · show them

+ 6 models with fewer than 3 results left off, since one or two tests say little about overall ability · show them

572 of 598 catalogue models listed here · sources and licences

* new or thinly tested: ranked on too few benchmark results · † only the maker’s own numbers so far · ~RAM is estimated; full context may need more memory