whatmodel.sh · find the best AI models you can run

Best AI models to run locally on a 256GB PC without a graphics card

A leaderboard of the best AI models you can run locally on a computer with 256GB of RAM and no graphics card. MiMo-V2.6-Flash (309B-A15B) is #1 right now, followed by Muse Spark Open and DeepSeek V4 Flash Vision (Exp). Models are ranked by one score that combines 575 published benchmarks. Each model shows the download that fits and the command to run it.

Filter by your hardware and budget → ~202GB for models (CPU, slow) · local only · reset

ram[2][4][8][16][24][32][48][64][96][128][192][256]GB

gpu[apple silicon][graphics card][unified memory][none]

price[local][$0.02][$0.1][$0.5][$2][$10][$50][any]max per M

Filter by task

task[all tasks][agent tasks][coding][chat & writing][math][vision & documents][web search]

New #1s for your hardware:

orRSS

detecting your OS…

$ terminal

Score vs release date

     │                                        OpenCodeInterpreter-DS-33B DeepSeek V4 Flash (Previe… ●─●●●●∘
  50 ┤ · · · · · · · · · · · · · · · · · · Phind CodeLlama 34B v2·●∘●●∘∘●∘●●─●●∘∘∘∘∘●∘∘∘●∘●∘∘∘●─●●●∘∘∘∘∘∘∘ · ·
     │                                ●────────●──●────●────∘─∘∘●∘∘∘∘∘∘∘∘∘∘∘ ∘∘∘∘∘∘∘∘∘∘∘∘∘∘∘∘∘   ∘ ∘
   0 ┤ · · · · ●─●∘────────────────●──┘· · · ··· ·∘·∘· ∘ · ·∘·∘· · · · ∘ · · · · · · · · · ∘ · · · · · · · · ·
     │   ●──●──┘                                            ∘
     └───────────────┬────────────────────────┬────────────────────────┬─────────────────────────┬────────────
                  2020-01                  2022-01                  2024-01                   2026-01

#	model	score↓	where↓	RAM↓	speed↓	context↓	get it	sources

#	model	score↓	where↓	RAM↓	speed↓	context↓	get it	sources
28	MiMo-V2.6-Flash (309B-A15B) · MXFP4 Xiaomi	76±1	local (slow)	~180GB		1M	llama.cpp ›
40	Muse Spark Open · 1-bit Meta	74±1	local (slow)	~190GB		1M	llama.cpp ›
47	DeepSeek V4 Flash Vision (Exp) · 4-bit DeepSeek	74±2	local (slow)	~165GB		1M	llama.cpp ›
48	Qwen3.8-Flash-Next · 4-bit Alibaba	73±1	local (slow)	~115GB	~27 tok/s	262k	Ollama ›
58	DeepSeek V4 Flash (0731) · 4-bit DeepSeek	72±1	local (slow)	~181GB		1M	llama.cpp ›	+2
59	GLM-5.3-Flash · 2-bit Z.ai	72±1	local (slow)	~103GB		1M	llama.cpp ›	+2
62	GLM-5.2 · 1-bit Z.ai	72±1	local (slow)	~121GB		1M	llama.cpp ›	+6
65	Hunyuan Hy3 (295B-A21B) · 4-bit Tencent	72±1	local (slow)	~183GB		256k	llama.cpp ›
66	Qwen3.8 27B · 4-bit Alibaba	72±1	local (slow)	~18GB	~8.6 tok/s	262k	Ollama ›	+3
82	DeepSeek V4 Flash (Preview, Apr 2026) · 4-bit DeepSeek	70±1	local (slow)	~164GB			llama.cpp ›	+4
86	Ling 3.0 Flash (124B-A5B) · 4-bit inclusionAI (Ant Group)	70±2†	local (slow)	~76GB		131k	llama.cpp ›
88	GLM-5.1 · 1-bit Z.ai	70±0	local (slow)	~119GB		200k	llama.cpp ›	+11
90	Qwen3.5 397B-A17B · 2-bit Alibaba	69±0	local (slow)	~127GB		262k	llama.cpp ›	+15
92	KAT-Coder-V2.5-Dev (35B-A3B) · 4-bit Kuaishou (Kwaipilot)	69±2†	local (slow)	~22GB		262k	llama.cpp ›
93	Ornith 1.5 35B-A3B · 4-bit DeepReinforce	69±1†	local (slow)	~23GB	~80 tok/s	262k	llama.cpp ›
95	MiniMax-M3 · 2-bit MiniMax	69±1	local (slow)	~131GB		1M	llama.cpp ›	+2
97	Kimi K2.5 · 1-bit Moonshot AI	69±1	local (slow)	~160GB		262k	llama.cpp ›	+15
100	GLM-5 · 1-bit Z.ai	69±1	local (slow)	~119GB		205k	llama.cpp ›	+11
101	MiMo-V2.5-Pro (1T-A42B) · 1-bit Xiaomi	69±1	local (slow)	~163GB		1M	llama.cpp ›
102	Muse Glimmer 30B · 4-bit Meta	69±1	local (slow)	~18GB	~27 tok/s	131k	llama.cpp ›
104	Inkling Small (266B-A12B) · 4-bit Thinking Machines	68±1	local (slow)	~170GB		1M	llama.cpp ›
105	Nemotron 3 Ultra 550B-A55B · 2-bit NVIDIA	68±1	local (slow)	~175GB		1M	llama.cpp ›
106	Qwen3.6 27B · 4-bit Alibaba	68±1	local (slow)	~19GB	~29 tok/s	262k	Ollama ›	+4
109	MiMo-V2.5 (310B-A15B) · 4-bit Xiaomi	68±1	local (slow)	~197GB		1M	llama.cpp ›
113	Qwen3.5 122B-A10B · 4-bit Alibaba	68±1	local (slow)	~75GB		262k	llama.cpp ›	+5
114	Inkling (975B-A41B) · 1-bit Thinking Machines	68±1	local (slow)	~156GB		1M	llama.cpp ›
120	GLM-4.7 · 2-bit Z.ai	68±1	local (slow)	~115GB		205k	llama.cpp ›	+5
121	Qwen3.5 27B · 4-bit Alibaba	68±0	local (slow)	~18GB	~29 tok/s	262k	llama.cpp ›	+9
126	DeepSeek V3.2 · 1-bit DeepSeek	67±1	local (slow)	~110GB		128k	llama.cpp ›	+15
127	Step 3.5 Flash (196B-A11B) · 4-bit StepFun	67±1	local (slow)	~126GB	~18 tok/s	256k	llama.cpp ›
129	Qwen3.6 35B-A3B · 4-bit Alibaba	67±1	local (slow)	~21GB	~63 tok/s	262k	llama.cpp ›	+5
130	Qwen3-Coder-Next (80B-A3B) · 4-bit Alibaba	67±2	local (slow)	~49GB	~62 tok/s	262k	Ollama ›
132	MiniMax-M2.7 · 4-bit MiniMax	67±1	local (slow)	~147GB		205k	llama.cpp ›	+2
133	Ornith 1.0 35B (35B-A3B) · 4-bit DeepReinforce	67±1	local (slow)	~24GB	~103 tok/s	262k	Ollama ›
136	Gemma 4 31B · 4-bit Google	66±1	local (slow)	~24GB	~11 tok/s	262k	llama.cpp ›	+21
139	Kimi K2 Thinking · 1-bit Moonshot AI	66±1	local (slow)	~160GB		262k	llama.cpp ›
145	Laguna M.1 · 4-bit Poolside	66±2	local (slow)	~144GB		262k	llama.cpp ›
148	Kimi K2 Instruct (0711) · 1-bit Moonshot AI	66±1	local (slow)	~152GB		131k	llama.cpp ›	+3
152	Qwen3 235B-A22B Thinking 2507 · 4-bit Alibaba	66±1	local (slow)	~150GB		131k	Ollama ›	+6
153	Qwen3.5 35B-A3B · 4-bit Alibaba	66±0	local (slow)	~22GB	~15 tok/s	262k	llama.cpp ›	+13
154	Step 3.7 Flash (198B-A11B) · 4-bit StepFun	66±1	local (slow)	~123GB		256k	llama.cpp ›
158	Spark-X2.5 4B · 4-bit iFLYTEK (SparkLLM)	65±1†	local (slow)	~3.8GB	~279 tok/s	1M	llama.cpp ›
159	DeepSeek V3.1 · 1-bit DeepSeek	65±1	local (slow)	~110GB		131k	llama.cpp ›	+3
160	GLM-4.6 · 2-bit Z.ai	65±1	local (slow)	~115GB		205k	llama.cpp ›	+1
163	MiniMax-M2.5 · 4-bit MiniMax	65±1	local (slow)	~147GB		205k	llama.cpp ›	+3
165	MiMo-V2-Flash (309B-A15B) · 4-bit Xiaomi	65±1	local (slow)	~188GB			llama.cpp ›
166	DeepSeek R1 0528 · 1-bit DeepSeek	65±1	local (slow)	~104GB		164k	llama.cpp ›	+6
168	MiniMax-M2.1 · 4-bit MiniMax	65±1	local (slow)	~147GB			llama.cpp ›
170	Nemotron Cascade 2 30B-A3B · 4-bit NVIDIA	65±1	local (slow)	~22GB	~100 tok/s	256k	Ollama ›
171	MiMo-V2.6-Distill-Qwen-9B · 4-bit Xiaomi	64±2†	local (slow)	~8.6GB			llama.cpp ›
172	Laguna XS 2.1 (33B-A3B) · 4-bit Poolside	64±2†	local (slow)	~22GB		262k	Ollama ›
173	K-EXAONE (236B-A23B) · 4-bit LG AI Research	64±1	local (slow)	~152GB		262k	llama.cpp ›
174	Qwen3 235B-A22B Instruct 2507 · 4-bit Alibaba	64±1	local (slow)	~144GB	~15 tok/s	262k	Ollama ›	+3
175	Mistral Medium 3.5 (128B) · 4-bit Mistral	64±1	local (slow)	~81GB		262k	Ollama ›
176	INTELLECT-3 · 4-bit Prime Intellect	64±1	local (slow)	~76GB			llama.cpp ›
177	GLM-4.5 · 2-bit Z.ai	64±1	local (slow)	~114GB		131k	llama.cpp ›	+3
179	MiniMax-M2 · 4-bit MiniMax	64±1	local (slow)	~147GB		205k	llama.cpp ›
181	Command A+ (05-2026) · 4-bit Cohere	64±1	local (slow)	~139GB		128k	llama.cpp ›
183	Nemotron 3 Super 120B-A12B · 4-bit NVIDIA	64±1	local (slow)	~78GB	~20 tok/s	262k	Ollama ›
184	Laguna XS.2 · 4-bit Poolside	64±1	local (slow)	~23GB		262k	llama.cpp ›
185	Gemma 4 26B-A4B · 4-bit QAT Google	64±1	local (slow)	~18GB	~35 tok/s	262k	Ollama ›	+13
187	EXAONE 4.5 33B · 4-bit LG AI Research	64±2†	local (slow)	~24GB		262k	llama.cpp ›
189	Qwen3-Coder 480B-A35B Instruct · 2-bit Alibaba	63±1	local (slow)	~153GB		262k	llama.cpp ›
191	Qwen3-VL 235B-A22B Thinking · 4-bit Alibaba	63±1	local (slow)	~144GB		256k	Ollama ›
192	DeepSeek R1 (Jan '25) · 1-bit DeepSeek	63±1	local (slow)	~104GB		128k	llama.cpp ›	+15
195	Qwen3-VL 235B-A22B Instruct · 4-bit Alibaba	63±1	local (slow)	~144GB		256k	Ollama ›
196	MiniCPM5 2B · 4-bit OpenBMB	63±1†	local (slow)	~2.5GB		131k	llama.cpp ›
197	Nemotron-Labs-3 Puzzle 75B-A9B · 4-bit NVIDIA	63±1†	local (slow)	~56GB			llama.cpp ›
198	Qwen3-Next 80B-A3B Instruct · 4-bit Alibaba	63±1	local (slow)	~50GB	~4.7 tok/s	131k	Ollama ›
201	Qwen3-Next 80B-A3B Thinking · 4-bit Alibaba	63±1	local (slow)	~49GB		131k	Ollama ›	+3
202	Granite 4.2 30B · 4-bit IBM	63±1	local (slow)	~20GB		131k	llama.cpp ›
206	GLM-4.5-Air · 4-bit Z.ai	62±1	local (slow)	~66GB	~23 tok/s	131k	llama.cpp ›	+4
207	Trinity-Large-Thinking · 2-bit Arcee AI	62±2	local (slow)	~141GB		512k	llama.cpp ›
208	Qwen3.5 9B · 4-bit Alibaba	62±0	local (slow)	~6.7GB	~15 tok/s	262k	llama.cpp ›	+19
209	Nemotron 3.5 Lightning 30B-A3B · 4-bit NVIDIA	62±2	local (slow)	~22GB	~87 tok/s	262k	Ollama ›
210	Seed-OSS 36B Instruct · 4-bit ByteDance Seed	62±1	local (slow)	~25GB		524k	llama.cpp ›
211	Gemma 4 12B · 4-bit Google	62±1	local (slow)	~9.9GB	~6.5 tok/s	262k	llama.cpp ›
214	GLM-4.6V · 4-bit Z.ai	62±2	local (slow)	~69GB		128k	llama.cpp ›
219	Qwen3-VL 32B Thinking · 4-bit Alibaba	62±1	local (slow)	~22GB		256k	llama.cpp ›
220	gpt-oss-120b · 4-bit OpenAI	62±1	local (slow)	~64GB	~44 tok/s	131k	llama.cpp ›	+19
222	Mistral Large 3 (675B-A41B) · 1-bit Mistral	62±1	local (slow)	~108GB		262k	llama.cpp ›	+1
223	Apriel 1.6 15B Thinker · 4-bit ServiceNow	62±1†	local (slow)	~11GB			llama.cpp ›
224	Devstral 2 (2512) · 4-bit Mistral	62±2	local (slow)	~78GB		256k	Ollama ›
228	GLM-4.5V · 4-bit Z.ai	61±2	local (slow)	~69GB		64k	llama.cpp ›
229	Devstral Small 2 24B · 4-bit Mistral	61±2	local (slow)	~16GB		262k	llama.cpp ›
231	Llama 3.1 Nemotron Ultra 253B v1 · 4-bit NVIDIA	61±1	local (slow)	~161GB		128k	llama.cpp ›
234	DeepSeek V3 0324 · 1-bit DeepSeek	60±1	local (slow)	~102GB		164k	llama.cpp ›	+11
238	Qwen3 30B-A3B Instruct 2507 · 4-bit Alibaba	60±1	local (slow)	~20GB	~100 tok/s	262k	llama.cpp ›	+4
239	Qwen3 30B-A3B Thinking 2507 · 4-bit Alibaba	60±1	local (slow)	~20GB		262k	llama.cpp ›	+8
240	ERNIE 4.5 300B-A47B · 4-bit Baidu	60±1†	local (slow)	~191GB		131k	llama.cpp ›
241	Qwen3.5 4B · 4-bit Alibaba	60±1	local (slow)	~3.8GB		262k	llama.cpp ›	+11
243	Mellum2.1 12B-A2.5B Thinking · 4-bit JetBrains	60±1†	local (slow)	~10GB			llama.cpp ›
244	Gemma 2 9B IT SimPO · 4-bit Princeton NLP	60±1	local (slow)	~7.6GB			llama.cpp ›
245	Gemma 2 9B IT DPO (Princeton) · 4-bit Princeton NLP	60±1	local (slow)	~7.6GB			llama.cpp ›
246	Falcon-H1R 7B · 4-bit TII	60±1†	local (slow)	~6GB		262k	llama.cpp ›
247	Nemotron-Cascade-14B-Thinking · 4-bit NVIDIA	60±1†	local (slow)	~11GB			llama.cpp ›
248	Qwen3-VL 32B Instruct · 4-bit Alibaba	60±1	local (slow)	~23GB		256k	llama.cpp ›
250	Qwen3 235B-A22B (Apr 2025, hybrid) · 4-bit Alibaba	60±0	local (slow)	~144GB		131k	Ollama ›	+14
252	Mistral Small 4 (119B-A6.5B) · 4-bit Mistral	60±2	local (slow)	~73GB		262k	llama.cpp ›
253	Granite 4.2 8B · 4-bit IBM	59±1	local (slow)	~7.2GB		131k	llama.cpp ›
254	QwQ-32B · 4-bit Alibaba	59±1	local (slow)	~23GB		131k	llama.cpp ›	+7
255	Solar Open 100B (102B-A12B) · 4-bit Upstage	59±1†	local (slow)	~67GB		131k	llama.cpp ›
256	Qwen3-VL 30B-A3B Thinking · 4-bit Alibaba	59±1	local (slow)	~20GB		256k	llama.cpp ›
257	Trinity-Large-Preview · 2-bit Arcee AI	59±2	local (slow)	~155GB			llama.cpp ›
258	OpenReasoning-Nemotron-32B · 4-bit NVIDIA	59±2†	local (slow)	~22GB			llama.cpp ›
259	EXAONE 4.0 32B · 4-bit LG AI Research	59±1	local (slow)	~22GB		131k	llama.cpp ›
260	Phi-4-reasoning-plus 14B · 4-bit Microsoft	59±1	local (slow)	~11GB			llama.cpp ›
261	GLM-4.7-Flash · 4-bit Z.ai	58±1	local (slow)	~19GB	~44 tok/s	200k	llama.cpp ›	+1
263	gpt-oss-20b · 4-bit OpenAI	58±1	local (slow)	~13GB	~8.7 tok/s	131k	llama.cpp ›	+16
264	Olmo 3.1 32B Think · 4-bit Ai2	58±1	local (slow)	~22GB		66k	llama.cpp ›
266	Qwen3 14B · 4-bit Alibaba	58±1	local (slow)	~11GB		33k	llama.cpp ›	+7
267	Llama 3.3 Nemotron Super 49B v1 · 4-bit NVIDIA	58±2	local (slow)	~33GB			llama.cpp ›
268	DeepSeek R1 Distill Llama 70B · 4-bit DeepSeek	58±1	local (slow)	~46GB		131k	Ollama ›	+1
270	Nemotron-Cascade-8B · 4-bit NVIDIA	58±1†	local (slow)	~6.8GB			llama.cpp ›
271	Command A (03-2025) · 4-bit Cohere	58±1	local (slow)	~72GB		256k	Ollama ›
272	Olmo 3 32B Think · 4-bit Ai2	58±1	local (slow)	~22GB		66k	llama.cpp ›
274	Phi-4-reasoning 14B · 4-bit Microsoft	58±1	local (slow)	~11GB		33k	llama.cpp ›
277	Magistral Small 1.2 · 4-bit Mistral	58±1	local (slow)	~17GB		131k	llama.cpp ›
279	Qwen3-VL 8B Thinking · 4-bit Alibaba	58±1	local (slow)	~6.9GB		256k	llama.cpp ›
280	Qwen3 32B · 4-bit Alibaba	58±0	local (slow)	~23GB		131k	llama.cpp ›	+17
283	Qwen3-VL 30B-A3B Instruct · 4-bit Alibaba	58±1	local (slow)	~20GB		256k	llama.cpp ›
284	Qwen3 Coder 30B-A3B Instruct · 4-bit Alibaba	57±1	local (slow)	~20GB	~93 tok/s	160k	llama.cpp ›
285	Qwen2.5 Coder 32B Instruct · 4-bit Alibaba	57±1	local (slow)	~23GB		131k	llama.cpp ›	+5
287	Llama 4 Maverick (402B-A17B) · 2-bit Meta	57±1	local (slow)	~129GB		1M	llama.cpp ›	+14
288	DeepSeek R1 0528 Qwen3 8B · 4-bit DeepSeek	57±1	local (slow)	~6.9GB	~3.6 tok/s	128k	llama.cpp ›
290	Granite 4.2 3B · 4-bit IBM	57±1	local (slow)	~3.4GB		131k	llama.cpp ›
292	Llama 3.3 Nemotron Super 49B v1.5 · 4-bit NVIDIA	57±1	local (slow)	~33GB		131k	llama.cpp ›
293	Nemotron 3 Nano 30B-A3B · 4-bit NVIDIA	57±1	local (slow)	~22GB	~105 tok/s	262k	Ollama ›	+3
294	Athene-V2-Chat 72B · 4-bit Nexusflow	57±1	local (slow)	~48GB		33k	Ollama ›
296	Granite 4.1 30B · 4-bit IBM	57±1†	local (slow)	~19GB	~25 tok/s		Ollama ›
297	Nemotron-Cascade-8B-Thinking · 4-bit NVIDIA	57±2	local (slow)	~6.8GB			llama.cpp ›
299	Qwen2.5-Omni 7B · 4-bit Alibaba	57±2	local (slow)	~5.8GB			llama.cpp ›
300	Sky-T1 32B Preview · 4-bit NovaSky (UC Berkeley)	57±4	local (slow)	~22GB			llama.cpp ›
301	Ministral 3 14B Reasoning 2512 · 4-bit Mistral	57±1	local (slow)	~10GB		262k	llama.cpp ›
303	Mistral Small 3.2 24B · 4-bit Mistral	56±1	local (slow)	~16GB		128k	llama.cpp ›	+4
304	DeepSeek-V2.5 (1210) · 4-bit DeepSeek	56±1	local (slow)	~151GB			llama.cpp ›
305	QED-Nano · 4-bit LM Provers	56±2	local (slow)	~4.1GB		262k	llama.cpp ›
306	Qwen3 4B Thinking 2507 · 4-bit Alibaba	56±1	local (slow)	~4.4GB	~36 tok/s	262k	llama.cpp ›	+3
310	Qwen3-VL 4B Thinking · 4-bit Alibaba	56±1	local (slow)	~4.4GB		256k	llama.cpp ›
311	Qwen2.5 72B Instruct · 4-bit Alibaba	56±1	local (slow)	~47GB		33k	Ollama ›	+24
312	Qwen2.5-VL 72B Instruct · 4-bit Alibaba	56±1	local (slow)	~48GB		33k	Ollama ›	+3
313	Llama 3.1 405B Instruct · 2-bit Meta	56±1	local (slow)	~160GB		128k	llama.cpp ›	+13
314	Mistral Large 2 (2411) · 4-bit Mistral	56±1	local (slow)	~77GB		128k	llama.cpp ›	+8
315	Qwen2.5 Coder 14B Instruct · 4-bit Alibaba	56±1	local (slow)	~11GB	~18 tok/s	131k	llama.cpp ›
316	DeepSeek R1 Distill Qwen 32B · 4-bit DeepSeek	56±1	local (slow)	~23GB	~7.3 tok/s	131k	llama.cpp ›	+5
317	Qwen2.5 32B Instruct · 4-bit Alibaba	56±1	local (slow)	~23GB		131k	llama.cpp ›	+11
318	Qwen3 8B · 4-bit Alibaba	56±1	local (slow)	~6.9GB	~25 tok/s	33k	llama.cpp ›	+15
319	DeepSeek R1 Distill Qwen 14B · 4-bit DeepSeek	56±1	local (slow)	~11GB	~15 tok/s	131k	llama.cpp ›	+2
321	Molmo 2 8B · 4-bit Ai2	56±2	local (slow)	~6.8GB			llama.cpp ›
322	Ministral 3 14B · 4-bit Mistral	55±1	local (slow)	~10GB	~46 tok/s	262k	llama.cpp ›	+2
323	Nemotron Nano 9B v2 · 4-bit NVIDIA	55±1	local (slow)	~7.6GB		131k	llama.cpp ›
324	EXAONE Deep 32B · 4-bit LG AI Research	55±2†	local (slow)	~22GB		33k	Ollama ›
325	Qwen3 4B Instruct 2507 · 4-bit Alibaba	55±1	local (slow)	~4.4GB	~60 tok/s	262k	llama.cpp ›	+4
326	Qwen3 30B-A3B (Apr 2025, hybrid) · 4-bit Alibaba	55±0	local (slow)	~20GB		33k	llama.cpp ›	+10
327	Bielik 11B v3.0 Instruct · 4-bit SpeakLeash	55±2	local (slow)	~8.5GB			llama.cpp ›
329	Granite 4.1 8B · 4-bit IBM	55±1	local (slow)	~7.2GB	~70 tok/s	131k	Ollama ›
330	Magistral Small 1.0 (2506) · 4-bit Mistral	55±1	local (slow)	~17GB		128k	llama.cpp ›
331	Spark-X2.5 1.7B · 4-bit iFLYTEK (SparkLLM)	55±1†	local (slow)	~1.9GB	~314 tok/s	1M	llama.cpp ›
332	Qwen2.5-Math 72B Instruct · 4-bit Alibaba	55±2†	local (slow)	~51GB		4k	llama.cpp ›
333	Llama 3.3 70B Instruct · 4-bit Meta	55±1	local (slow)	~46GB	~2.3 tok/s	128k	Ollama ›	+21
335	Qwen3-VL 8B Instruct · 4-bit Alibaba	55±1	local (slow)	~6.9GB		256k	llama.cpp ›
336	Mistral Large 2 (2407) · 4-bit Mistral	55±1	local (slow)	~78GB		128k	llama.cpp ›	+10
337	Falcon-H1 34B Instruct · 4-bit TII	55±3	local (slow)	~23GB		262k	llama.cpp ›
338	Llama 4 Scout (109B-A17B) · 4-bit Meta	55±1	local (slow)	~68GB	~19 tok/s	328k	Ollama ›	+8
340	Bielik 11B v2.6 Instruct · 4-bit SpeakLeash	55±3	local (slow)	~8.5GB			llama.cpp ›
341	Mistral Small 3.1 24B (2503) · 4-bit Mistral	55±1	local (slow)	~16GB		128k	llama.cpp ›	+7
342	Llama 3.1 Tulu 3 70B · 4-bit Ai2	55±1	local (slow)	~46GB		131k	llama.cpp ›
343	Pixtral Large (2411) · 2-bit Mistral	55±3	local (slow)	~51GB			llama.cpp ›
344	Olmo 3.1 32B Instruct · 4-bit Ai2	55±2	local (slow)	~22GB		66k	llama.cpp ›
347	DeepSeek-V2.5 · 4-bit DeepSeek	55±1	local (slow)	~151GB		164k	Ollama ›	+1
348	OpenThinker2 32B · 4-bit Open Thoughts	55±1	local (slow)	~22GB		33k	llama.cpp ›
349	DeepSeek-V2 Chat (0628) · 4-bit DeepSeek	55±1	local (slow)	~151GB			llama.cpp ›
351	OpenThinker 32B · 4-bit Open Thoughts	55±1†	local (slow)	~22GB		33k	llama.cpp ›
352	Command A Reasoning (08-2025) · 4-bit Cohere	54±2	local (slow)	~72GB			llama.cpp ›
353	Magistral Small 1.1 (2507) · 4-bit Mistral	54±1†	local (slow)	~17GB		40k	llama.cpp ›
354	Mellum2 12B-A2.5B Thinking · 4-bit JetBrains	54±1†	local (slow)	~10GB		131k	llama.cpp ›
355	Ministral 3 8B Reasoning 2512 · 4-bit Mistral	54±1	local (slow)	~6.9GB		262k	llama.cpp ›
356	Llama 3.1 Tulu 3 70B DPO · 4-bit Ai2	54±1	local (slow)	~46GB		131k	llama.cpp ›
358	Nemotron 3 Nano 4B · 4-bit NVIDIA	54±1	local (slow)	~3.5GB	~104 tok/s	262k	llama.cpp ›
360	DeepSeek-Coder-V2 Instruct (0614) · 4-bit DeepSeek	54±1	local (slow)	~151GB			llama.cpp ›	+2
362	DeepSeek-Coder-V2 Instruct (0724) · 4-bit DeepSeek	54±1	local (slow)	~151GB			llama.cpp ›
363	Mistral Small 3 24B (2501) · 4-bit Mistral	54±1	local (slow)	~16GB		32k	llama.cpp ›	+6
367	GLM-4 9B Chat 1M · 4-bit Zhipu AI (THUDM)	54±4	local (slow)	~8.1GB		1M	llama.cpp ›
368	EXAONE Deep 7.8B · 4-bit LG AI Research	54±2†	local (slow)	~6.5GB		33k	llama.cpp ›
371	Qwen2-VL 72B Instruct · 4-bit Alibaba	54±1	local (slow)	~53GB			llama.cpp ›
372	Hermes 3 Llama 3.1 405B · 2-bit Nous Research	54±1	local (slow)	~114GB		131k	llama.cpp ›
373	Llama 3.1 70B Instruct · 4-bit Meta	53±0	local (slow)	~46GB		128k	llama.cpp ›	+22
374	Gemma 3 27B · 4-bit Google	53±1	local (slow)	~20GB		131k	llama.cpp ›	+23
375	Qwen2.5-VL 32B Instruct · 4-bit Alibaba	53±2	local (slow)	~23GB		33k	llama.cpp ›	+1
378	Phi-4 14B · 4-bit Microsoft	53±1	local (slow)	~11GB		16k	llama.cpp ›	+11
379	Bielik 11B v2.1 Instruct · 4-bit SpeakLeash	53±3	local (slow)	~8.5GB			llama.cpp ›
380	Qwen2.5-Math 7B Instruct · 4-bit Alibaba	53±2†	local (slow)	~5.8GB		4k	llama.cpp ›
381	Olmo 3 7B Think · 4-bit Ai2	53±1	local (slow)	~6.2GB		66k	llama.cpp ›
382	s1.1 32B · 4-bit Simple Scaling	53±1	local (slow)	~22GB		33k	llama.cpp ›
383	Ministral 3 8B · 4-bit Mistral	53±1	local (slow)	~6.9GB	~68 tok/s	262k	llama.cpp ›	+3
384	Gemma 4 E4B · 4-bit Google	53±1	local (slow)	~6.6GB	~59 tok/s	131k	llama.cpp ›	+8
385	Llama 3.1 Nemotron 70B Instruct · 4-bit NVIDIA	53±1	local (slow)	~46GB		128k	llama.cpp ›	+4
386	Qwen3-VL 4B Instruct · 4-bit Alibaba	53±1	local (slow)	~4.4GB		256k	llama.cpp ›
390	LFM2.5 2.6B · 4-bit Liquid AI	53±1	local (slow)	~2.4GB		131k	llama.cpp ›
391	Bielik 11B v2.2 Instruct · 4-bit SpeakLeash	53±3	local (slow)	~8.5GB			llama.cpp ›
392	Llama 3.1 Nemotron 51B Instruct · 4-bit NVIDIA	53±2	local (slow)	~34GB			llama.cpp ›
393	Aya Expanse 32B · 4-bit Cohere	53±2	local (slow)	~22GB		128k	llama.cpp ›	+1
395	Granite 4.0 H Small (32B-A9B) · 4-bit IBM	53±1	local (slow)	~22GB		131k	llama.cpp ›	+1
396	Qwen2.5 Coder 7B Instruct · 4-bit Alibaba	53±1	local (slow)	~5.8GB	~48 tok/s	131k	llama.cpp ›
397	OpenCoder-8B-Instruct · 4-bit INF (infly)	53±1	local (slow)	~6.4GB			llama.cpp ›
398	LFM2.5 8B-A1B · 4-bit Liquid AI	52±1	local (slow)	~5.9GB	~250 tok/s	128k	llama.cpp ›
399	Gemma 3 12B · 4-bit Google	52±1	local (slow)	~10GB	~13 tok/s	131k	llama.cpp ›	+10
400	Qwen2.5 14B Instruct · 4-bit Alibaba	52±1	local (slow)	~11GB		131k	llama.cpp ›	+7
402	Cogito v1 Preview Llama 8B · 4-bit Deep Cogito	52±4	local (slow)	~6.6GB		128k	llama.cpp ›
403	Llama-3-Instruct-8B-SimPO-ExPO · 4-bit Chujie Zheng (ExPO)	52±1	local (slow)	~6.6GB			llama.cpp ›
404	Llama-3-Instruct-8B-SimPO · 4-bit Princeton NLP	52±1	local (slow)	~6.6GB			llama.cpp ›
405	Athene-70B · 4-bit Nexusflow	52±1	local (slow)	~46GB			llama.cpp ›
406	Qwen2 72B Instruct · 4-bit Alibaba	52±1	local (slow)	~48GB		131k	Ollama ›	+14
409	CodeQwen1.5 7B Chat · 4-bit Alibaba	52±1	local (slow)	~6.4GB		64k	llama.cpp ›
410	OpenCodeInterpreter-DS-33B · 4-bit M-A-P	51±1	local (slow)	~22GB			llama.cpp ›
411	Bielik 11B v2.0 Instruct · 4-bit SpeakLeash	51±3	local (slow)	~8.5GB			llama.cpp ›
414	LFM2 24B-A2B · 4-bit Liquid AI	51±1	local (slow)	~15GB		33k	llama.cpp ›
415	Qwen3 4B · 4-bit Alibaba	51±1	local (slow)	~4.4GB		33k	llama.cpp ›	+8
416	DeepSeek-Coder 33B Instruct · 4-bit DeepSeek	51±1	local (slow)	~22GB		16k	llama.cpp ›	+1
418	Codestral 22B v0.1 · 4-bit Mistral AI	51±1	local (slow)	~16GB		32k	llama.cpp ›
419	Gemma 2 27B IT · 4-bit Google	51±1	local (slow)	~21GB		8k	llama.cpp ›	+10
420	Llama 3 70B Instruct · 4-bit Meta	51±0	local (slow)	~46GB		8k	llama.cpp ›	+17
421	Llama 3.2 90B Vision Instruct · 4-bit Meta	51±1	local (slow)	~58GB		128k	Ollama ›	+1
422	WizardCoder 33B V1.1 · 4-bit WizardLM	51±1	local (slow)	~22GB		16k	llama.cpp ›
423	Bielik 11B v2.3 Instruct · 4-bit SpeakLeash	51±2	local (slow)	~8.6GB			llama.cpp ›
425	Llama-3-8B-ProLong-512k-Instruct · 4-bit Princeton NLP	51±4	local (slow)	~35GB			how to run ›
427	OpenCodeInterpreter-DS-6.7B · 4-bit M-A-P	51±1	local (slow)	~5.8GB			llama.cpp ›
428	Qwen2-Math 72B Instruct · 4-bit Alibaba	51±1	local (slow)	~45GB		4k	Ollama ›
429	WizardLM-2 8x22B · 4-bit Microsoft	51±1	local (slow)	~91GB			Ollama ›
430	Mistral Small Instruct 22B (2409) · 4-bit Mistral AI	51±2	local (slow)	~16GB		32k	llama.cpp ›
431	OpenThinker3 7B · 4-bit Open Thoughts	51±1	local (slow)	~6.4GB		33k	llama.cpp ›
432	Granite 4.1 3B · 4-bit IBM	51±1†	local (slow)	~3.7GB	~131 tok/s		Ollama ›
433	Artigenz-Coder-DS-6.7B · 4-bit Artigenz	51±1	local (slow)	~5.8GB			llama.cpp ›
434	Yi 34B 200K (base) · 4-bit 01.AI	51±4	local (slow)	~23GB		200k	llama.cpp ›
435	Mellum2 12B-A2.5B Instruct · 4-bit JetBrains	51±2†	local (slow)	~9GB		131k	llama.cpp ›
437	Hermes 3 Llama 3.1 70B · 4-bit Nous Research	50±1	local (slow)	~43GB		131k	Ollama ›
438	speechless-codellama-34b-v2.0 · 4-bit uukuguy	50±1	local (slow)	~23GB			llama.cpp ›
439	OLMo 2 32B Instruct (0325) · 4-bit Ai2	50±1	local (slow)	~21GB			llama.cpp ›
440	Ministral 3 3B Reasoning 2512 · 4-bit Mistral	50±1	local (slow)	~3.6GB		262k	llama.cpp ›
441	Aya 23 35B · 4-bit Cohere For AI	50±2	local (slow)	~24GB		8k	Ollama ›
442	AceReason-Nemotron-1.0-14B · 4-bit NVIDIA	50±2†	local (slow)	~11GB			llama.cpp ›
444	Qwen2.5-VL 7B Instruct · 4-bit Alibaba	50±1	local (slow)	~5.8GB			llama.cpp ›
445	Mixtral 8x22B Instruct v0.1 · 4-bit Mistral	50±1	local (slow)	~91GB		64k	Ollama ›	+9
446	Magicoder-S-DS 6.7B · 4-bit UIUC (ise-uiuc)	50±1	local (slow)	~5.8GB			llama.cpp ›
447	EXAONE Deep 2.4B · 4-bit LG AI Research	50±2†	local (slow)	~3.2GB		33k	Ollama ›
448	Pixtral 12B (2409) · 4-bit Mistral	50±2	local (slow)	~9.6GB			llama.cpp ›
450	XwinCoder-34B · 4-bit Xwin-LM	50±1	local (slow)	~23GB			llama.cpp ›
451	Qwen2.5 7B Instruct · 4-bit Alibaba	50±1	local (slow)	~5.8GB	~49 tok/s	131k	llama.cpp ›	+12
452	LFM2.5 1.2B Thinking · 4-bit Liquid AI	50±2	local (slow)	~1.3GB		33k	llama.cpp ›
453	Yi-Coder 9B Chat · 4-bit 01.AI	50±1	local (slow)	~6.6GB		128k	llama.cpp ›
454	InternLM2.5 7B Chat · 4-bit Shanghai AI Laboratory (InternLM)	50±2	local (slow)	~6.4GB			llama.cpp ›
455	StarChat2 15B v0.1 · 4-bit Hugging Face	50±1	local (slow)	~12GB		16k	llama.cpp ›
456	Code Millenials 34B · 4-bit Bud Ecosystem	50±1	local (slow)	~23GB			llama.cpp ›
457	Qwen2-Math 7B Instruct · 4-bit Alibaba	50±2†	local (slow)	~6.1GB		4k	Ollama ›
458	WaveCoder-Ultra-6.7B · 4-bit Microsoft	50±1	local (slow)	~5.8GB			llama.cpp ›
461	MegaBeam-Mistral-7B-512k · 4-bit AWS (aws-prototyping)	49±4	local (slow)	~5.9GB			llama.cpp ›
463	Phi-3.5-MoE-instruct · 4-bit Microsoft	49±1	local (slow)	~27GB		128k	llama.cpp ›
464	Qwen3-VL 2B Thinking · 4-bit Alibaba	49±1	local (slow)	~2.7GB		256k	llama.cpp ›
465	Gemma 3n E4B · 4-bit Google	49±1	local (slow)	~5.6GB		32k	llama.cpp ›
467	DeepSeek-Coder 7B Instruct v1.5 · 4-bit DeepSeek	49±1	local (slow)	~5.9GB			llama.cpp ›
468	OpenThinker2 7B · 4-bit Open Thoughts	49±2†	local (slow)	~6.4GB		33k	llama.cpp ›
469	DeepSeek-Coder 6.7B Instruct · 4-bit DeepSeek	49±1	local (slow)	~8.8GB		16k	llama.cpp ›
470	Qwen2 57B-A14B Instruct · 4-bit Alibaba	49±2	local (slow)	~38GB		33k	llama.cpp ›
471	Hermes 2 Theta Llama-3 70B · 4-bit Nous Research	49±2	local (slow)	~47GB		8k	llama.cpp ›
472	MiniCPM3-4B · 4-bit OpenBMB	49±2	local (slow)	~4.1GB		32k	llama.cpp ›
473	Granite 4.0 H Tiny (7B-A1B) · 4-bit IBM	49±1	local (slow)	~4.8GB	~12 tok/s	131k	Ollama ›
474	Qwen2.5 Coder 3B Instruct · 4-bit Alibaba	49±1	local (slow)	~2.8GB	~9.5 tok/s	33k	Ollama ›
476	Gemma 2 9B IT · 4-bit Google	49±1	local (slow)	~9.5GB		8k	llama.cpp ›	+14
477	Yi-1.5 34B (base) · 4-bit 01.AI	49±2	local (slow)	~23GB		4k	llama.cpp ›
478	Bielik 4.5B v3.0 Instruct · 4-bit SpeakLeash	49±2	local (slow)	~4.5GB			llama.cpp ›
480	WhiteRabbitNeo-33B-v1 · 4-bit WhiteRabbitNeo	49±1	local (slow)	~22GB			llama.cpp ›
481	Qwen1.5 110B Chat · 4-bit Alibaba	48±1	local (slow)	~72GB		32k	Ollama ›	+1
482	Command R Plus (08-2024) · 4-bit Cohere	48±1	local (slow)	~67GB		128k	llama.cpp ›	+1
483	GLM-4 9B Chat · 4-bit Zhipu AI (Z.ai)	48±2	local (slow)	~7.1GB		128k	Ollama ›	+1
484	speechless-coder-ds-6.7b · 4-bit uukuguy	48±1	local (slow)	~5.8GB			llama.cpp ›
485	Magicoder-S-CL-7B · 4-bit UIUC (ise-uiuc)	48±1	local (slow)	~5.8GB			llama.cpp ›
486	Phind CodeLlama 34B v2 · 4-bit Phind	48±1	local (slow)	~23GB		16k	Ollama ›
487	AceReason-Nemotron-1.1-7B · 4-bit NVIDIA	48±2†	local (slow)	~6.4GB			llama.cpp ›
488	Jamba 1.5 Mini · 4-bit AI21 Labs	48±1	local (slow)	~34GB			llama.cpp ›
489	DeepSeek R1 Distill Qwen 7B · 4-bit DeepSeek	48±1	local (slow)	~5.8GB	~64 tok/s	131k	llama.cpp ›	+7
494	Aya Expanse 8B · 4-bit Cohere	48±2	local (slow)	~7GB		8k	llama.cpp ›
495	EuroLLM 9B Instruct · 4-bit UTTER (EuroLLM)	48±2	local (slow)	~7.4GB		4k	llama.cpp ›
498	Granite 4.0 H Micro 3B · 4-bit IBM	48±1	local (slow)	~3.5GB		131k	Ollama ›
500	Code Llama 70B Instruct · 4-bit Meta	48±1	local (slow)	~45GB		16k	llama.cpp ›	+1
501	Command R (08-2024) · 4-bit Cohere	48±1	local (slow)	~22GB		128k	llama.cpp ›	+3
502	OLMo 2 13B Instruct (1124) · 4-bit Allen Institute for AI	48±1	local (slow)	~10GB		4k	llama.cpp ›
503	InternLM2.5 7B Chat 1M · 4-bit Shanghai AI Laboratory (InternLM)	48±4	local (slow)	~6.4GB			llama.cpp ›
504	Falcon-H1 7B Instruct · 4-bit TII	48±3	local (slow)	~6.3GB		262k	llama.cpp ›
506	Llama 3 70B (base) · 16-bit Meta	47±2	local (slow)	~150GB			how to run ›
508	Qwen3.5 2B · 4-bit Alibaba	47±1	local (slow)	~2.2GB	~174 tok/s	262k	llama.cpp ›	+7
509	Tulu 2 70B · 4-bit Allen Institute for AI	47±2†	local (slow)	~45GB			llama.cpp ›
511	Hermes 2 Pro Llama 3 8B · 4-bit Nous Research	47±3	local (slow)	~6.6GB		8k	llama.cpp ›
512	MedGemma 4B IT · 4-bit Google	47±2	local (slow)	~4.1GB			llama.cpp ›
514	Yi 1.5 34B Chat · 4-bit 01.AI	47±1	local (slow)	~23GB		4k	llama.cpp ›	+5
515	OpenChat 3.5 0106 · 4-bit OpenChat	47±1	local (slow)	~6.1GB		8k	llama.cpp ›	+1
517	WizardCoder Python 34B V1.0 · 4-bit WizardLM	47±1	local (slow)	~22GB		16k	Ollama ›
519	Granite 4.0 Micro 3B · 4-bit IBM	47±1	local (slow)	~3.7GB	~6.2 tok/s	131k	llama.cpp ›
520	Gemma 4 E2B · 4-bit Google	47±1	local (slow)	~4.5GB		131k	llama.cpp ›	+6
522	DBRX Instruct · 4-bit Databricks	47±1	local (slow)	~85GB		32k	Ollama ›	+3
524	Granite 34B Code Instruct (8K) · 4-bit IBM	47±1	local (slow)	~22GB			Ollama ›
525	Cogito v1 Preview Llama 3B · 4-bit Deep Cogito	47±4	local (slow)	~3.8GB		128k	llama.cpp ›
526	Qwen2.5-Math 1.5B Instruct · 4-bit Alibaba	47±2†	local (slow)	~1.9GB		4k	llama.cpp ›
527	EXAONE 4.0 1.2B · 4-bit LG AI Research	47±1†	local (slow)	~2.8GB		66k	llama.cpp ›
528	InternLM2.5 20B Chat · 4-bit Shanghai AI Laboratory (InternLM)	47±2	local (slow)	~14GB		33k	llama.cpp ›
529	StarCoder2-15B-Instruct-v0.1 · 4-bit BigCode	47±1	local (slow)	~11GB		16k	Ollama ›
531	Qwen1.5 72B Chat · 4-bit Alibaba	47±1	local (slow)	~48GB		32k	Ollama ›	+9
532	Granite 3.3 8B Instruct · 4-bit IBM	47±1	local (slow)	~6.6GB		128k	llama.cpp ›
533	speechless-starcoder2-15b · 4-bit uukuguy	47±1	local (slow)	~12GB			llama.cpp ›
534	OpenChat 3.5 0106 Gemma · 4-bit OpenChat	47±2	local (slow)	~6.9GB		8k	llama.cpp ›
535	Phi-3 Medium 128K Instruct · 4-bit Microsoft	47±1	local (slow)	~11GB		128k	llama.cpp ›
536	Zephyr ORPO 141B-A35B v0.1 · 4-bit Hugging Face	47±2	local (slow)	~91GB		66k	Ollama ›
537	Qwen2-VL 7B Instruct · 4-bit Alibaba	47±1	local (slow)	~6.5GB			llama.cpp ›
541	DeepSeek R1 Distill Llama 8B · 4-bit DeepSeek	46±1	local (slow)	~6.6GB		131k	llama.cpp ›	+2
542	Phi-3-medium-4k-instruct · 4-bit Microsoft	46±1	local (slow)	~11GB		4k	llama.cpp ›	+1
543	QwQ-32B-Preview · 4-bit Alibaba	46±2	local (slow)	~22GB		33k	llama.cpp ›	+2
544	DeepSeek-Coder-V2 Lite Instruct (16B-A2.4B) · 4-bit DeepSeek	46±1	local (slow)	~11GB		128k	Ollama ›	+1
546	Qwen2-Math 1.5B Instruct · 4-bit Alibaba	46±2†	local (slow)	~2.5GB		4k	Ollama ›
548	Llama 3.1 8B Instruct · 4-bit Meta	46±0	local (slow)	~6.6GB	~89 tok/s	128k	llama.cpp ›	+25
549	Phi-4-mini-reasoning 3.8B · 4-bit Microsoft	46±2	local (slow)	~4.3GB		128k	llama.cpp ›
550	Ministral 3 3B · 4-bit Mistral	46±1	local (slow)	~3.6GB	~128 tok/s	262k	llama.cpp ›	+2
551	Olmo 3 7B Instruct · 4-bit Ai2	46±1	local (slow)	~6.2GB		66k	llama.cpp ›
553	Command R Plus (04-2024) · 4-bit Cohere	46±1	local (slow)	~67GB		128k	llama.cpp ›	+6
554	Mistral NeMo Instruct (2407) · 4-bit Mistral	46±1	local (slow)	~9.4GB		128k	llama.cpp ›	+9
556	Llama 3.1 Tulu 3 8B · 4-bit Ai2	46±1	local (slow)	~6.6GB		131k	llama.cpp ›
557	Phi-3-mini-4k-instruct (June 2024 update) · 4-bit Microsoft	46±1	local (slow)	~6GB			llama.cpp ›
558	Yi 1.5 9B Chat · 4-bit 01.AI	46±1	local (slow)	~7.1GB		4k	llama.cpp ›	+1
559	Qwen1.5 32B Chat · 4-bit Alibaba	46±1	local (slow)	~22GB		32k	llama.cpp ›
560	Xwin-LM 70B v0.1 · 4-bit Xwin-LM	46±1	local (slow)	~42GB			Ollama ›
561	Eurus-2-7B-PRIME · 4-bit PRIME-RL	46±2	local (slow)	~6.4GB		4k	llama.cpp ›
562	Qwen2 7B Instruct · 4-bit Alibaba	46±1	local (slow)	~5.8GB		131k	llama.cpp ›	+4
563	Command R7B (12-2024) · 4-bit Cohere	46±1	local (slow)	~6.9GB		128k	llama.cpp ›
564	Granite 20B Code Instruct (8K) · 4-bit IBM	45±1	local (slow)	~14GB			Ollama ›
565	Dolphin 2.6 Mixtral 8x7B · 4-bit Cognitive Computations	45±1	local (slow)	~29GB			llama.cpp ›
566	Gemma 3 4B · 4-bit Google	45±1	local (slow)	~4.1GB	~74 tok/s	131k	llama.cpp ›	+11
567	Granite 3.0 8B Instruct · 4-bit IBM	45±1	local (slow)	~6.6GB		4k	llama.cpp ›
569	Granite 8B Code Instruct (4K) · 4-bit IBM	45±1	local (slow)	~6.6GB			llama.cpp ›
570	Falcon3 7B Instruct · 4-bit TII	45±2	local (slow)	~6.3GB		32k	llama.cpp ›
571	Phi-4-mini 3.8B · 4-bit Microsoft	45±1	local (slow)	~4.3GB		128k	llama.cpp ›	+4
572	Ministral 8B (2410) · 4-bit Mistral	45±1	local (slow)	~6.6GB		128k	llama.cpp ›	+6
573	Code Llama 70B Python · 4-bit Meta	45±1	local (slow)	~45GB		16k	Ollama ›
574	Code Tulu 2 34B · 16-bit Allen Institute for AI	45±2†	local (slow)	~72GB			how to run ›
575	Falcon3 10B Instruct · 4-bit TII	45±2	local (slow)	~8.1GB	~13 tok/s	32k	llama.cpp ›
576	Granite 3.2 8B Instruct · 4-bit IBM	45±1	local (slow)	~6.6GB		131k	llama.cpp ›
577	OpenThinker 7B · 4-bit Open Thoughts	45±2†	local (slow)	~6.4GB		33k	llama.cpp ›
578	Yi 34B Chat · 4-bit 01.AI	45±1	local (slow)	~23GB		4k	llama.cpp ›	+1
579	Hermes 2 Theta Llama 3 8B · 4-bit Nous Research	45±2	local (slow)	~6.6GB		8k	llama.cpp ›
580	Llama 3.1 8B (base) · 4-bit Meta	45±3	local (slow)	~6.6GB			llama.cpp ›
581	Gemma 3n E2B IT · 4-bit Google	45±2	local (slow)	~4.1GB		32k	llama.cpp ›
582	Code Llama 70B (base) · 4-bit Meta	45±1	local (slow)	~45GB		16k	Ollama ›
583	Phi-3.5-mini-instruct · 4-bit Microsoft	45±1	local (slow)	~6GB		128k	llama.cpp ›	+4
584	Qwen2.5-VL 3B Instruct · 4-bit Alibaba	45±1	local (slow)	~2.8GB			llama.cpp ›
585	Qwen3-VL 2B Instruct · 4-bit Alibaba	45±1	local (slow)	~2.7GB		256k	llama.cpp ›
586	LFM2.5 1.2B Instruct · 4-bit Liquid AI	45±2	local (slow)	~1.3GB		33k	llama.cpp ›
587	Qwen3 1.7B · 4-bit Alibaba	45±1	local (slow)	~2.9GB	~96 tok/s	33k	llama.cpp ›	+11
590	Granite 3.1 8B Instruct · 4-bit IBM	44±1	local (slow)	~6.7GB		128k	llama.cpp ›
593	Llama 3.2 11B Vision Instruct · 4-bit Meta	44±2	local (slow)	~8.9GB		128k	Ollama ›
594	Qwen2.5 3B Instruct · 4-bit Alibaba	44±1	local (slow)	~3GB	~61 tok/s	33k	llama.cpp ›	+5
595	LFM2 2.6B · 4-bit Liquid AI	44±1	local (slow)	~2.2GB		33k	llama.cpp ›
597	Tulu 2 DPO 70B · 4-bit Ai2	44±1	local (slow)	~45GB			llama.cpp ›	+1
599	MiniCPM-V 2.6 · 4-bit OpenBMB	44±2	local (slow)	~5.8GB			llama.cpp ›
600	CodeGemma 7B IT (v1.0) · 4-bit Google	44±1	local (slow)	~7.1GB			llama.cpp ›
601	Yi-1.5 9B (base) · 4-bit 01.AI	44±2	local (slow)	~7.1GB		4k	llama.cpp ›
603	Qwen2-Audio 7B Instruct · 4-bit Alibaba	44±3	local (slow)	~6.5GB			llama.cpp ›
604	DeepSeek-Coder 1.3B Instruct · 4-bit DeepSeek	44±1	local (slow)	~2.9GB		16k	Ollama ›
605	Mathstral 7B v0.1 · 4-bit Mistral AI	44±1	local (slow)	~5.9GB		32k	llama.cpp ›
606	Aya 23 8B · 4-bit Cohere For AI	44±3	local (slow)	~6.9GB		8k	llama.cpp ›
607	Qwen2.5 Coder 1.5B Instruct · 4-bit Alibaba	44±1	local (slow)	~1.9GB		33k	Ollama ›
608	WizardLM 70B V1.0 · 4-bit Microsoft	44±1	local (slow)	~42GB			Ollama ›
609	SmolLM3 3B · 4-bit Hugging Face	44±1	local (slow)	~3.5GB		66k	llama.cpp ›
610	Hermes 3 Llama 3.1 8B · 4-bit Nous Research	44±1	local (slow)	~6.6GB		128k	llama.cpp ›
611	Llama 3 8B Instruct · 4-bit Meta	44±0	local (slow)	~6.6GB		8k	llama.cpp ›	+19
612	Command R (03-2024) · 4-bit Cohere	44±1	local (slow)	~33GB		128k	llama.cpp ›	+6
613	Aya Vision 32B · 4-bit Cohere	44±3	local (slow)	~71GB		16k	how to run ›
614	WizardCoder Python 13B V1.0 · 4-bit WizardLM	43±2	local (slow)	~15GB		16k	llama.cpp ›
615	OpenChat 3.5 · 4-bit OpenChat	43±1	local (slow)	~6.1GB		8k	llama.cpp ›
616	Granite 34B Code Base (8K) · 4-bit IBM	43±1	local (slow)	~24GB			llama.cpp ›
617	speechless-starcoder2-7b · 4-bit uukuguy	43±1	local (slow)	~6.1GB			llama.cpp ›
618	OLMo 2 7B Instruct (1124) · 4-bit Allen Institute for AI	43±1	local (slow)	~6.2GB		4k	llama.cpp ›
619	Falcon2 11B (base) · 4-bit TII	43±3	local (slow)	~8.2GB		8k	Ollama ›
622	WizardCoder-15B-V1.0 · 4-bit WizardLM	43±1	local (slow)	~12GB			llama.cpp ›
625	DeepSeek LLM 67B Chat · 4-bit DeepSeek	43±1	local (slow)	~44GB		4k	llama.cpp ›
626	Qwen1.5 14B Chat · 4-bit Alibaba	43±1	local (slow)	~11GB		32k	Ollama ›	+3
627	Llama 2 70B (base) · 4-bit Meta	43±1	local (slow)	~43GB		4k	Ollama ›
628	Mixtral 8x7B v0.1 (base) · 4-bit Mistral AI	43±1	local (slow)	~29GB		32k	llama.cpp ›
629	Code Llama 34B Python · 4-bit Meta	43±1	local (slow)	~23GB		16k	Ollama ›
630	DeepSeek-Coder 33B Base · 4-bit DeepSeek	43±1	local (slow)	~22GB		16k	llama.cpp ›
631	speechless-coding-7b-16k-tora · 16-bit uukuguy	43±1	local (slow)	~16GB			how to run ›
633	InternLM2 Chat 20B · 4-bit Shanghai AI Laboratory (InternLM)	43±1	local (slow)	~14GB			llama.cpp ›
634	CodeQwen1.5 7B (base) · 4-bit Alibaba	42±1	local (slow)	~6.4GB		66k	llama.cpp ›
635	Nous Hermes 2 Mistral 7B DPO · 4-bit Nous Research	42±3	local (slow)	~6.1GB		33k	llama.cpp ›
636	Mixtral 8x7B Instruct v0.1 · 4-bit Mistral	42±0	local (slow)	~28GB		32k	llama.cpp ›	+15
638	Granite 4.0 1B · 4-bit IBM	42±1	local (slow)	~2.6GB		128k	llama.cpp ›
639	OpenHermes-2.5-Code-290k-13B · 4-bit ajibawa-2023	42±1	local (slow)	~9.8GB			llama.cpp ›
640	Granite 4.0 H 1B · 4-bit IBM	42±1	local (slow)	~2.4GB		131k	llama.cpp ›
641	Nous Hermes 2 Mixtral 8x7B DPO · 4-bit Nous Research	42±2	local (slow)	~30GB		33k	llama.cpp ›
643	Deita 7B v1.0 · 4-bit HKUST NLP	42±2	local (slow)	~32GB			how to run ›
646	OpenHermes 2.5 Mistral 7B · 4-bit Nous Research	42±1	local (slow)	~5.9GB			llama.cpp ›	+2
647	Code Llama 34B Instruct · 4-bit Meta	42±1	local (slow)	~23GB		16k	llama.cpp ›	+1
648	Code Llama 34B (base) · 4-bit Meta	42±1	local (slow)	~23GB		16k	Ollama ›	+1
649	Starling-LM 7B beta · 4-bit Nexusflow	42±1	local (slow)	~6.1GB		8k	llama.cpp ›	+3
650	Vicuna 33B v1.3 · 4-bit LMSYS	41±1	local (slow)	~23GB		2k	Ollama ›	+2
651	Phi-3-mini-128k-instruct (Apr 2024) · 16-bit Microsoft	41±2	local (slow)	~9.5GB			how to run ›	+1
652	Code Tulu 2 13B · 16-bit Allen Institute for AI	41±2†	local (slow)	~29GB			how to run ›
653	Bielik 1.5B v3.0 Instruct · 4-bit SpeakLeash	41±3	local (slow)	~2.6GB			llama.cpp ›
654	Starling-LM 7B alpha · 4-bit UC Berkeley (NEST)	41±1	local (slow)	~6.1GB		8k	llama.cpp ›	+2
655	Granite 3.3 2B Instruct · 4-bit IBM	41±1†	local (slow)	~3.1GB		128k	llama.cpp ›
656	Llama3-OpenBioLLM-8B · 4-bit Saama AI Labs	41±2	local (slow)	~6.6GB			llama.cpp ›
657	Mistral 7B Instruct v0.3 · 4-bit Mistral	41±1	local (slow)	~5.9GB		32k	llama.cpp ›	+4
658	LLaVA-v1.6-34B · 4-bit LLaVA	41±2	local (slow)	~24GB		4k	Ollama ›
659	LFM2 1.2B · 4-bit Liquid AI	41±1	local (slow)	~1.3GB		33k	llama.cpp ›
660	DeepSeek-Coder 6.7B Base · 4-bit DeepSeek	41±1	local (slow)	~8.8GB		16k	llama.cpp ›
661	Granite 3.0 2B Instruct · 4-bit IBM	41±1	local (slow)	~3.2GB		4k	llama.cpp ›
662	Llama 2 70B Chat · 4-bit Meta	41±1	local (slow)	~45GB		4k	llama.cpp ›	+13
663	Llama 3.2 3B Instruct · 4-bit Meta	41±1	local (slow)	~3.5GB	~162 tok/s	131k	llama.cpp ›	+11
664	Granite 8B Code Base (4K) · 4-bit IBM	41±1	local (slow)	~6.6GB			llama.cpp ›
665	StarCoder2 15B · 4-bit BigCode	41±1	local (slow)	~12GB		16k	llama.cpp ›
666	Llama-3-Instruct-8B-SimPO-v0.2 · 4-bit Princeton NLP	40±1	local (slow)	~6.6GB			llama.cpp ›
667	Falcon-H1 3B Instruct · 4-bit TII	40±3	local (slow)	~3.5GB		131k	llama.cpp ›
668	Phi-2 (2.7B) · 4-bit Microsoft	40±1	local (slow)	~4.7GB		2k	Ollama ›	+2
669	speechless-code-mistral-7b-v1.0 · 4-bit uukuguy	40±1	local (slow)	~17GB			how to run ›
670	Qwen-14B-Chat · 4-bit Alibaba	40±1	local (slow)	~11GB			llama.cpp ›
671	Code Llama 13B Instruct · 4-bit Meta	40±1	local (slow)	~15GB		16k	llama.cpp ›
672	Tulu 2 13B · 4-bit Allen Institute for AI	40±2	local (slow)	~9.8GB			llama.cpp ›
673	Falcon-180B-Chat · 4-bit TII	40±2	local (slow)	~115GB		2k	Ollama ›
674	MistralHermes-CodePro-7B-v1 · 4-bit beowolx	40±1	local (slow)	~6.1GB			llama.cpp ›
676	Phi-3-mini-4k-instruct (Apr 2024) · 4-bit Microsoft	40±2	local (slow)	~6GB			llama.cpp ›
677	CodeGemma 7B (v1.0) · 4-bit Google	40±1	local (slow)	~7.1GB			llama.cpp ›
678	Code Llama 13B Python · 4-bit Meta	40±1	local (slow)	~9.8GB		16k	llama.cpp ›
679	Apertus 8B Instruct (2509) · 4-bit Swiss AI	40±3	local (slow)	~6.9GB		66k	llama.cpp ›
680	DeepSeek-V2 Lite Chat (16B-A2.4B) · 4-bit DeepSeek	40±1	local (slow)	~12GB		32k	Ollama ›
681	Granite 3B Code Instruct (2K) · 4-bit IBM	40±1	local (slow)	~3.7GB			llama.cpp ›
682	Tulu 2 DPO 13B · 4-bit Allen Institute for AI	39±1	local (slow)	~9.8GB			llama.cpp ›
684	BioMistral-7B · 4-bit BioMistral	39±3	local (slow)	~6.1GB			llama.cpp ›
685	SOLAR 10.7B Instruct v1.0 · 4-bit Upstage	39±1	local (slow)	~8.3GB		4k	llama.cpp ›	+2
686	Gemma 2 2B IT · 4-bit Google	39±1	local (slow)	~3.4GB		8k	llama.cpp ›	+4
687	Code Tulu 2 7B · 16-bit Allen Institute for AI	39±2†	local (slow)	~16GB			how to run ›
688	Flan-T5 XXL · 4-bit Google	39±1	local (slow)	~49GB			how to run ›	+12
689	Yi-1.5 6B (base) · 4-bit 01.AI	39±3	local (slow)	~5.4GB		4k	llama.cpp ›
690	Dolphin 2.2.1 Mistral 7B · 4-bit Cognitive Computations	39±2	local (slow)	~5.9GB			llama.cpp ›
691	Gemma 1.1 7B IT · 4-bit Google	39±1	local (slow)	~7.1GB		8k	llama.cpp ›	+2
692	Granite 3.1 2B Instruct · 4-bit IBM	39±1	local (slow)	~3.1GB		128k	llama.cpp ›
694	Granite 20B Code Base (8K) · 4-bit IBM	39±1	local (slow)	~15GB			llama.cpp ›
695	Code Llama 7B Python · 4-bit Meta	39±1	local (slow)	~5.8GB		16k	llama.cpp ›
696	Granite 3.2 2B Instruct · 4-bit IBM	39±1	local (slow)	~3.1GB		131k	llama.cpp ›
697	Qwen1.5 7B Chat · 4-bit Alibaba	39±1	local (slow)	~9.7GB		32k	llama.cpp ›	+4
698	Zephyr 7B alpha · 4-bit Hugging Face	38±1	local (slow)	~6.1GB			llama.cpp ›
699	Code Llama 13B (base) · 4-bit Meta	38±1	local (slow)	~9.8GB		16k	llama.cpp ›	+1
700	Falcon3 3B Instruct · 4-bit TII	38±3	local (slow)	~3.6GB		32k	llama.cpp ›
701	Qwen2.5 Coder 0.5B Instruct · 4-bit Alibaba	38±1	local (slow)	~1.1GB		33k	Ollama ›
702	Vicuna 13B v1.5 · 4-bit LMSYS	38±1	local (slow)	~9.8GB		4k	llama.cpp ›
703	Yi 1.5 6B Chat · 4-bit 01.AI	38±2	local (slow)	~4.7GB		4k	llama.cpp ›
704	WizardLM 13B V1.2 · 4-bit Microsoft	38±1	local (slow)	~9.8GB			llama.cpp ›
705	Qwen2-VL 2B Instruct · 4-bit Alibaba	38±1	local (slow)	~2.6GB		33k	llama.cpp ›
706	Qwen2.5 1.5B Instruct · 4-bit Alibaba	38±1	local (slow)	~2GB	~98 tok/s	33k	llama.cpp ›	+6
707	Tulu 2 7B · 4-bit Allen Institute for AI	38±2	local (slow)	~5.8GB			llama.cpp ›
709	Mistral 7B Instruct v0.2 · 4-bit Mistral	38±1	local (slow)	~5.9GB		32k	llama.cpp ›	+9
710	Code Llama 7B Instruct · 4-bit Meta	38±1	local (slow)	~5.8GB		16k	llama.cpp ›
711	LFM2 700M · 4-bit Liquid AI	38±1	local (slow)	~1GB		33k	llama.cpp ›
712	Qwen3.5 0.8B · 4-bit Alibaba	38±1	local (slow)	~1.4GB	~319 tok/s	262k	llama.cpp ›	+2
714	EXAONE 3.5 2.4B Instruct · 4-bit LG AI Research	38±2	local (slow)	~3.2GB		33k	llama.cpp ›
715	xDAN-L1-Chat-RL-v1 · 4-bit xDAN-AI	37±1	local (slow)	~6.1GB			llama.cpp ›
717	Mistral 7B v0.1 (base) · 4-bit Mistral AI	37±1	local (slow)	~6.1GB		8k	llama.cpp ›	+4
718	Llama 3 8B (base) · 4-bit Meta	37±1	local (slow)	~6.6GB			llama.cpp ›
719	Flan-T5 XL · 4-bit Google	37±1	local (slow)	~14GB			how to run ›	+8
720	Gemma 7B (base) · 4-bit Google	37±1	local (slow)	~7.1GB		8k	llama.cpp ›	+3
721	Tulu 2 DPO 7B · 4-bit Allen Institute for AI	37±1	local (slow)	~5.8GB			llama.cpp ›
722	Vicuna 13B v1.3 · 4-bit LMSYS	37±2	local (slow)	~29GB		2k	how to run ›
723	Granite 3.1 3B-A800M Instruct · 4-bit IBM	37±2†	local (slow)	~3.6GB	~23 tok/s	131k	llama.cpp ›
724	Granite 3.0 3B-A800M Instruct · 4-bit IBM	37±1	local (slow)	~3.7GB		4k	llama.cpp ›
725	DeepSeek R1 Distill Qwen 1.5B · 4-bit DeepSeek	37±2	local (slow)	~2GB		131k	llama.cpp ›	+1
726	StarCoder2 7B · 4-bit BigCode	37±1	local (slow)	~5.4GB		16k	llama.cpp ›
728	DeepSeek LLM 7B Chat · 4-bit DeepSeek	37±2†	local (slow)	~5.7GB			Ollama ›
729	Falcon 40B (base) · 4-bit TII	36±1	local (slow)	~27GB		2k	Ollama ›	+2
730	StarCoder 15.5B · 4-bit BigCode	36±1	local (slow)	~11GB			Ollama ›
731	Nous-Hermes-13b · 4-bit Nous Research	36±2	local (slow)	~9.8GB		2k	llama.cpp ›
732	Eurus-2-7B-SFT · 4-bit PRIME-RL	36±3†	local (slow)	~6.4GB			llama.cpp ›
733	Qwen3 0.6B · 4-bit Alibaba	36±1	local (slow)	~2.1GB	~61 tok/s	33k	llama.cpp ›	+5
735	Code Llama 7B (base) · 4-bit Meta	36±1	local (slow)	~5.8GB		16k	llama.cpp ›	+2
736	Llama 2 13B (base) · 4-bit Meta	36±1	local (slow)	~9.3GB		4k	Ollama ›	+4
737	Llama 2 13B Chat · 4-bit Meta	36±1	local (slow)	~15GB		4k	llama.cpp ›	+10
738	Zephyr 7B beta · 4-bit Hugging Face	35±1	local (slow)	~6.1GB			llama.cpp ›	+3
739	Guanaco 33B · 16-bit University of Washington	35±1	local (slow)	~70GB			how to run ›
740	StarCoder2 3B · 4-bit BigCode	35±1	local (slow)	~3.4GB		16k	llama.cpp ›
741	Granite 3B Code Base (2K) · 4-bit IBM	35±1	local (slow)	~3.7GB			llama.cpp ›
742	StarCoderBase 15.5B · 4-bit BigCode	35±1	local (slow)	~12GB			llama.cpp ›
743	Vicuna 7B v1.5 · 4-bit LMSYS	35±1	local (slow)	~5.8GB		4k	llama.cpp ›	+1
744	ChatGLM3 6B 128K · 4-bit Zhipu AI (THUDM)	35±4	local (slow)	~5.8GB		131k	llama.cpp ›
746	OLMo 2 1B Instruct (0425) · 4-bit Allen Institute for AI	35±1	local (slow)	~2.4GB		4k	llama.cpp ›
747	Vicuna 7B v1.3 · 4-bit LMSYS	35±2	local (slow)	~5.8GB		2k	llama.cpp ›
748	Stable Code 3B · 4-bit Stability AI	35±1	local (slow)	~4.8GB		16k	llama.cpp ›
749	Orca 2 13B · 4-bit Microsoft	35±3	local (slow)	~9.8GB		4k	llama.cpp ›
751	DeepSeek-Coder 1.3B Base · 4-bit DeepSeek	34±1	local (slow)	~2.4GB		16k	Ollama ›
752	Qwen1.5 4B Chat · 4-bit Alibaba	34±2	local (slow)	~4.1GB		32k	llama.cpp ›
753	Mistral 7B Instruct v0.1 · 4-bit Mistral	34±1	local (slow)	~5.9GB		8k	llama.cpp ›	+3
754	Gemma 7B IT · 4-bit Google	34±1	local (slow)	~7.1GB		8k	llama.cpp ›	+5
757	CodeGemma 2B (v1.0) · 4-bit Google	34±1	local (slow)	~3.2GB			llama.cpp ›
758	Qwen2 1.5B Instruct · 4-bit Alibaba	34±1	local (slow)	~1.9GB		32k	llama.cpp ›	+1
759	Falcon-H1 1.5B Instruct · 4-bit TII	33±4	local (slow)	~2.4GB		131k	llama.cpp ›
760	Ghost 7B Alpha · 4-bit Ghost X	33±2	local (slow)	~6.1GB			llama.cpp ›
761	Gemma 3 1B · 4-bit Google	33±1	local (slow)	~1.8GB	~180 tok/s	32k	llama.cpp ›	+7
762	SmolLM2 1.7B Instruct · 4-bit Hugging Face	33±1	local (slow)	~3.1GB		8k	llama.cpp ›
763	LFM2 350M · 4-bit Liquid AI	33±1	local (slow)	~1.7GB		33k	llama.cpp ›
764	Qwen-7B (base) · 4-bit Alibaba	33±1	local (slow)	~6.6GB		33k	llama.cpp ›
767	StarCoderBase 7B · 4-bit BigCode	33±1	local (slow)	~6GB			Ollama ›
769	Llama 3.2 1B Instruct · 4-bit Meta	33±1	local (slow)	~1.7GB	~251 tok/s	131k	llama.cpp ›	+13
770	Phi-1.5 (1.3B) · 4-bit Microsoft	33±1	local (slow)	~2.4GB		2k	llama.cpp ›
772	Qwen-7B-Chat · 4-bit Alibaba	32±1	local (slow)	~6.6GB		33k	llama.cpp ›
773	Llama 2 7B Chat · 4-bit Meta	32±1	local (slow)	~8.8GB		4k	llama.cpp ›	+13
775	OLMo 7B Instruct · 16-bit Ai2	32±2	local (slow)	~16GB			how to run ›
776	Llama 2 7B (base) · 4-bit Meta	32±1	local (slow)	~8.5GB		4k	Ollama ›	+6
778	Flan-T5 Large · 4-bit Google	32±1	local (slow)	~4.8GB			how to run ›	+5
779	Granite 3.1 1B-A400M Instruct · 4-bit IBM	31±2†	local (slow)	~2.3GB	~20 tok/s	131k	llama.cpp ›
780	Falcon 40B Instruct · 4-bit TII	31±2	local (slow)	~27GB			Ollama ›
781	Gemma 2B (base) · 4-bit Google	31±1	local (slow)	~3.2GB		8k	llama.cpp ›	+3
782	Gemma 1.1 2B IT · 4-bit Google	31±1	local (slow)	~3.2GB		8k	llama.cpp ›	+1
783	Falcon 7B (base) · 4-bit TII	31±1	local (slow)	~5.9GB		2k	Ollama ›	+4
785	Baichuan2-7B-Base · 16-bit Baichuan	30±1	local (slow)	~17GB			how to run ›
787	NexusRaven V2 13B · 4-bit Nexusflow	30±3	local (slow)	~9.3GB		16k	Ollama ›
789	ChatGLM3-6B · 4-bit Zhipu AI (THUDM)	30±2	local (slow)	~5.8GB			llama.cpp ›
790	Qwen2.5 0.5B Instruct · 4-bit Alibaba	30±2	local (slow)	~1.2GB		33k	llama.cpp ›	+1
791	OLMo 7B · 4-bit Allen Institute for AI	30±1†	local (slow)	~30GB		2k	how to run ›
792	OpenLLaMA 7B v2 · 8-bit OpenLM Research	30±1	local (slow)	~9.1GB			llama.cpp ›
793	StableLM-3B-4E1T · 4-bit Stability AI	30±1	local (slow)	~3.3GB		4k	llama.cpp ›
794	StarCoderBase 3B · 4-bit BigCode	30±1	local (slow)	~3.4GB			Ollama ›
796	StableLM-Base-Alpha 7B v2 · 4-bit Stability AI	30±1	local (slow)	~30GB		4k	how to run ›
797	Granite 3.0 1B-A400M Instruct · 4-bit IBM	30±1	local (slow)	~2.3GB		4k	llama.cpp ›
798	OPT-66B · 4-bit Meta	29±1	local (slow)	~141GB		2k	how to run ›	+2
799	GPT4All-13B-Snoozy · 4-bit Nomic AI	29±2	local (slow)	~56GB			how to run ›
801	EuroLLM 1.7B Instruct · 4-bit UTTER (EuroLLM)	29±3	local (slow)	~2.6GB		4k	llama.cpp ›
802	Granite 4.0 H 350M · 4-bit IBM	29±1†	local (slow)	~1.7GB		33k	llama.cpp ›
804	Gemma 2B IT · 4-bit Google	29±1	local (slow)	~3.1GB		8k	llama.cpp ›	+3
806	Granite 4.0 350M · 4-bit IBM	28±1	local (slow)	~1.7GB		32k	llama.cpp ›
807	OPT-30B · 4-bit Meta	28±1	local (slow)	~64GB		2k	how to run ›	+5
809	GPT-NeoX-20B · 4-bit EleutherAI	28±1	local (slow)	~15GB		2k	llama.cpp ›	+1
810	Qwen2 0.5B Instruct · 4-bit Alibaba	28±2	local (slow)	~1.1GB		32k	llama.cpp ›
811	RedPajama-INCITE 7B Base · 4-bit Together	28±1	local (slow)	~16GB		2k	how to run ›
816	Falcon3 1B Instruct · 4-bit TII	26±4	local (slow)	~2.7GB		8k	llama.cpp ›
817	Qwen1.5 1.8B Chat · 4-bit Alibaba	26±2	local (slow)	~2.7GB		33k	Ollama ›
819	OPT-13B (13 billion parameters) · 4-bit Meta	26±1	local (slow)	~29GB		2k	how to run ›	+4
820	Falcon 7B Instruct · 4-bit TII	26±2	local (slow)	~5.9GB			Ollama ›	+1
822	OpenAssistant SFT-4 Pythia 12B · 4-bit LAION (OpenAssistant)	25±1	local (slow)	~9.5GB			llama.cpp ›	+1
823	Flan-T5 Base · 4-bit Google	25±1	local (slow)	~2.5GB			how to run ›	+3
824	RedPajama-INCITE Base 3B v1 · 4-bit Together	25±3	local (slow)	~3.4GB		2k	llama.cpp ›
826	Pythia 12B · 4-bit EleutherAI	25±1	local (slow)	~9.5GB		2k	llama.cpp ›	+1
827	OpenLLaMA 3B v2 · 4-bit OpenLM Research	25±1	local (slow)	~4.2GB			llama.cpp ›
828	GPT-J 6B · 4-bit EleutherAI	25±1	local (slow)	~14GB		2k	how to run ›	+6
830	StableLM-Base-Alpha 3B v2 · 4-bit Stability AI	24±1	local (slow)	~13GB		4k	how to run ›
831	OPT-6.7B · 4-bit Meta	24±1	local (slow)	~16GB		2k	how to run ›	+5
834	Qwen1.5 0.5B Chat · 4-bit Alibaba	23±3	local (slow)	~1.8GB		33k	Ollama ›
835	Pythia 6.9B · 4-bit EleutherAI	23±1	local (slow)	~6.1GB		2k	llama.cpp ›	+2
837	Phi-1 (1.3B) · 4-bit Microsoft	22±4	local (slow)	~2.4GB		2k	llama.cpp ›
839	SmolLM2 360M Instruct · 8-bit Hugging Face	22±3	local (slow)	~1.2GB		8k	llama.cpp ›
841	OLMo 1B · 4-bit Allen Institute for AI	21±2†	local (slow)	~2.2GB		2k	llama.cpp ›
842	BLOOM 7.1B · 4-bit BigScience	21±1	local (slow)	~7.1GB		2k	llama.cpp ›	+7
843	Pythia 2.8B · 4-bit EleutherAI	20±1	local (slow)	~3.4GB		2k	llama.cpp ›
844	Pythia 2.8B (deduped) · 4-bit EleutherAI	20±1	local (slow)	~3.4GB		2k	llama.cpp ›
845	Falcon-RW 1B · 16-bit TII	20±2	local (slow)	~4.3GB		2k	how to run ›
846	OPT-2.7B · 4-bit Meta	19±1	local (slow)	~7.1GB		2k	how to run ›	+3
847	StableLM-Tuned-Alpha 7B · 4-bit Stability AI	18±2	local (slow)	~6.9GB			llama.cpp ›
848	GPT-Neo 2.7B · 4-bit EleutherAI	18±1	local (slow)	~13GB		2k	how to run ›	+8
850	T5 Large · 4-bit Google	17±2	local (slow)	~4.6GB		1k	how to run ›
851	Gemma 3 270M IT · 8-bit Google	17±4	local (slow)	~1.2GB		32k	llama.cpp ›
852	Flan-T5 Small · 4-bit Google	16±3	local (slow)	~1.8GB			how to run ›
853	BLOOM 3B · 4-bit BigScience	16±1	local (slow)	~4GB		2k	llama.cpp ›	+2
856	OPT-1.3B · 4-bit Meta	14±1	local (slow)	~4.3GB		2k	how to run ›	+5
857	T5 Base · 4-bit Google	14±3	local (slow)	~2.4GB		1k	how to run ›
858	Pythia 1.4B · 4-bit EleutherAI	14±1	local (slow)	~2.4GB		2k	llama.cpp ›
859	Pythia 1B · 4-bit EleutherAI	12±1	local (slow)	~2.2GB		2k	llama.cpp ›
862	GPT-Neo 1.3B · 4-bit EleutherAI	12±2	local (slow)	~7.1GB		2k	how to run ›	+3
863	T5 Small · 4-bit Google	12±3	local (slow)	~1.8GB		1k	how to run ›
864	BLOOM 1.7B · 4-bit BigScience	11±1	local (slow)	~3.1GB		2k	llama.cpp ›	+1
865	Zyte-1B · 4-bit venkycs (aihub-app)	11±2	local (slow)	~2.2GB			llama.cpp ›
867	StableLM-Base-Alpha 7B · 4-bit Stability AI	8±1	local (slow)	~35GB		4k	how to run ›
868	Pythia 410M · 4-bit EleutherAI	8±2	local (slow)	~1.8GB		2k	llama.cpp ›
870	BLOOM 1.1B · 4-bit BigScience	7±1	local (slow)	~2.6GB		2k	llama.cpp ›
871	GPT-2 XL (1.5B) · 4-bit OpenAI	7±1	local (slow)	~2.8GB	~75 tok/s	1k	llama.cpp ›	+9
874	OPT-350M · 4-bit Meta	1±1	local (slow)	~2.2GB		2k	how to run ›	+1
876	StableLM-Base-Alpha 3B · 4-bit Stability AI	1±2	local (slow)	~17GB		4k	how to run ›
877	BLOOM 560M · 4-bit BigScience	0±1	local (slow)	~2.1GB		2k	llama.cpp ›	+1
878	Pythia 160M · 4-bit EleutherAI	-2±2	local (slow)	~1.6GB		2k	llama.cpp ›
879	GPT-2 Large (774M) · 4-bit OpenAI	-3±1	local (slow)	~2GB	~137 tok/s	1k	llama.cpp ›	+3
880	OPT-125M · 4-bit Meta	-3±1	local (slow)	~1.8GB		2k	how to run ›	+1
881	GPT-Neo 125M · 4-bit EleutherAI	-3±2	local (slow)	~2.1GB		2k	how to run ›
882	GPT-2 Medium (355M) · 4-bit OpenAI	-5±1	local (slow)	~1.8GB		1k	llama.cpp ›	+3
883	Pythia 70M · 4-bit EleutherAI	-13±2	local (slow)	~1.6GB		2k	llama.cpp ›
884	GPT-2 Small (124M) · 4-bit OpenAI	-13±2	local (slow)	~1.6GB		1k	llama.cpp ›	+3
—	K2 Horizon 7B · gguf-q4_k_m Institute of Foundation Models (MBZUAI)	not scored yet	local (slow)	~8GB		524k	llama.cpp ›
—	LFM2.5 24B-A2B · Q4_K_M Liquid AI	not yet calibrated	local (slow)	~17GB		131k	llama.cpp ›
—	LFM3 1.7B · q4_k_m Liquid AI	not yet calibrated	local (slow)	~2.6GB		262k	llama.cpp ›

+ 330 more don't fit your machine or budget · show them

+ 213 models with fewer than 3 results left off, since one or two tests say little about overall ability · show them

919 of 1227 catalogue models listed here · sources and licences

* new or thinly tested: ranked on too few benchmark results · † only the maker’s own numbers so far · ~RAM is estimated; full context may need more memory