whatmodel.sh · find the best AI models you can run

Best AI models to run locally on a 192GB PC without a graphics card

A leaderboard of the best AI models you can run locally on a computer with 192GB of RAM and no graphics card. MiMo-V2.6-Flash (309B-A15B) is #1 right now, followed by DeepSeek V4 Flash Vision (Exp) and Qwen3.8-Flash-Next. Models are ranked by one score that combines 575 published benchmarks. Each model shows the download that fits and the command to run it.

Filter by your hardware and budget → ~150GB for models (CPU, slow) · local only · reset

ram[2][4][8][16][24][32][48][64][96][128][192][256]GB

gpu[apple silicon][graphics card][unified memory][none]

price[local][$0.02][$0.1][$0.5][$2][$10][$50][any]max per M

Filter by task

task[all tasks][agent tasks][coding][chat & writing][math][vision & documents][web search]

New #1s for your hardware:

orRSS

detecting your OS…

$ terminal

Score vs release date

     │                                         OpenCodeInterpreter-DS-33B DeepSeek V4 Flash (Previe… ●─●●●●
  50 ┤ · · · · · · · · · · · · · · · · · · ·Phind CodeLlama 34B v2 ●∘●●∘∘●∘●●●●∘∘─∘∘∘●∘∘∘●∘●∘∘∘∘●─∘●∘∘∘∘∘∘∘· ·
     │                                 ●───────●───●────●───∘─∘∘●─∘∘∘∘∘∘∘∘∘∘∘∘∘∘∘ ∘∘∘∘∘∘∘∘∘∘∘∘∘   ∘ ∘
   0 ┤ · · · · ●─●─∘────────────────●──┘ · · ··· · ∘ ∘ ·∘· ·∘·∘· · · · ·∘· · · · · · · · · ·∘· · ··· · · · · ·
     │   ●──●──┘                                            ∘
     └───────────────┬────────────────────────┬─────────────────────────┬─────────────────────────┬───────────
                  2020-01                  2022-01                   2024-01                   2026-01

#	model	score↓	where↓	RAM↓	speed↓	context↓	get it	sources

#	model	score↓	where↓	RAM↓	speed↓	context↓	get it	sources
28	MiMo-V2.6-Flash (309B-A15B) · 2-bit Xiaomi	76±1	local (slow)	~136GB		1M	llama.cpp ›
47	DeepSeek V4 Flash Vision (Exp) · 2-bit DeepSeek	74±2	local (slow)	~104GB		1M	llama.cpp ›
48	Qwen3.8-Flash-Next · 4-bit Alibaba	73±1	local (slow)	~115GB	~27 tok/s	262k	Ollama ›
58	DeepSeek V4 Flash (0731) · 2-bit DeepSeek	72±1	local (slow)	~92GB		1M	llama.cpp ›	+2
59	GLM-5.3-Flash · 2-bit Z.ai	72±1	local (slow)	~103GB		1M	llama.cpp ›	+2
62	GLM-5.2 · 1-bit Z.ai	72±1	local (slow)	~121GB		1M	llama.cpp ›	+6
65	Hunyuan Hy3 (295B-A21B) · 2-bit Tencent	72±1	local (slow)	~94GB		256k	llama.cpp ›
66	Qwen3.8 27B · 4-bit Alibaba	72±1	local (slow)	~18GB	~8.6 tok/s	262k	Ollama ›	+3
82	DeepSeek V4 Flash (Preview, Apr 2026) · 2-bit DeepSeek	70±1	local (slow)	~103GB			llama.cpp ›	+4
86	Ling 3.0 Flash (124B-A5B) · 4-bit inclusionAI (Ant Group)	70±2†	local (slow)	~76GB		131k	llama.cpp ›
88	GLM-5.1 · 1-bit Z.ai	70±0	local (slow)	~119GB		200k	llama.cpp ›	+11
90	Qwen3.5 397B-A17B · 2-bit Alibaba	69±0	local (slow)	~127GB		262k	llama.cpp ›	+15
92	KAT-Coder-V2.5-Dev (35B-A3B) · 4-bit Kuaishou (Kwaipilot)	69±2†	local (slow)	~22GB		262k	llama.cpp ›
93	Ornith 1.5 35B-A3B · 4-bit DeepReinforce	69±1†	local (slow)	~23GB	~80 tok/s	262k	llama.cpp ›
95	MiniMax-M3 · 2-bit MiniMax	69±1	local (slow)	~131GB		1M	llama.cpp ›	+2
100	GLM-5 · 1-bit Z.ai	69±1	local (slow)	~119GB		205k	llama.cpp ›	+11
102	Muse Glimmer 30B · 4-bit Meta	69±1	local (slow)	~18GB	~27 tok/s	131k	llama.cpp ›
104	Inkling Small (266B-A12B) · 2-bit Thinking Machines	68±1	local (slow)	~86GB		1M	llama.cpp ›
105	Nemotron 3 Ultra 550B-A55B · 1-bit NVIDIA	68±1	local (slow)	~89GB		1M	llama.cpp ›
106	Qwen3.6 27B · 4-bit Alibaba	68±1	local (slow)	~19GB	~29 tok/s	262k	Ollama ›	+4
109	MiMo-V2.5 (310B-A15B) · 2-bit Xiaomi	68±1	local (slow)	~100GB		1M	llama.cpp ›
113	Qwen3.5 122B-A10B · 4-bit Alibaba	68±1	local (slow)	~75GB		262k	llama.cpp ›	+5
120	GLM-4.7 · 2-bit Z.ai	68±1	local (slow)	~115GB		205k	llama.cpp ›	+5
121	Qwen3.5 27B · 4-bit Alibaba	68±0	local (slow)	~18GB	~29 tok/s	262k	llama.cpp ›	+9
126	DeepSeek V3.2 · 1-bit DeepSeek	67±1	local (slow)	~110GB		128k	llama.cpp ›	+15
127	Step 3.5 Flash (196B-A11B) · 4-bit StepFun	67±1	local (slow)	~126GB	~18 tok/s	256k	llama.cpp ›
129	Qwen3.6 35B-A3B · 4-bit Alibaba	67±1	local (slow)	~21GB	~63 tok/s	262k	llama.cpp ›	+5
130	Qwen3-Coder-Next (80B-A3B) · 4-bit Alibaba	67±2	local (slow)	~49GB	~62 tok/s	262k	Ollama ›
132	MiniMax-M2.7 · 4-bit MiniMax	67±1	local (slow)	~147GB		205k	llama.cpp ›	+2
133	Ornith 1.0 35B (35B-A3B) · 4-bit DeepReinforce	67±1	local (slow)	~24GB	~103 tok/s	262k	Ollama ›
136	Gemma 4 31B · 4-bit Google	66±1	local (slow)	~24GB	~11 tok/s	262k	llama.cpp ›	+21
145	Laguna M.1 · 4-bit Poolside	66±2	local (slow)	~144GB		262k	llama.cpp ›
152	Qwen3 235B-A22B Thinking 2507 · 4-bit Alibaba	66±1	local (slow)	~150GB		131k	Ollama ›	+6
153	Qwen3.5 35B-A3B · 4-bit Alibaba	66±0	local (slow)	~22GB	~15 tok/s	262k	llama.cpp ›	+13
154	Step 3.7 Flash (198B-A11B) · 4-bit StepFun	66±1	local (slow)	~123GB		256k	llama.cpp ›
158	Spark-X2.5 4B · 4-bit iFLYTEK (SparkLLM)	65±1†	local (slow)	~3.8GB	~279 tok/s	1M	llama.cpp ›
159	DeepSeek V3.1 · 1-bit DeepSeek	65±1	local (slow)	~110GB		131k	llama.cpp ›	+3
160	GLM-4.6 · 2-bit Z.ai	65±1	local (slow)	~115GB		205k	llama.cpp ›	+1
163	MiniMax-M2.5 · 4-bit MiniMax	65±1	local (slow)	~147GB		205k	llama.cpp ›	+3
165	MiMo-V2-Flash (309B-A15B) · 2-bit Xiaomi	65±1	local (slow)	~103GB			llama.cpp ›
166	DeepSeek R1 0528 · 1-bit DeepSeek	65±1	local (slow)	~104GB		164k	llama.cpp ›	+6
168	MiniMax-M2.1 · 4-bit MiniMax	65±1	local (slow)	~147GB			llama.cpp ›
170	Nemotron Cascade 2 30B-A3B · 4-bit NVIDIA	65±1	local (slow)	~22GB	~100 tok/s	256k	Ollama ›
171	MiMo-V2.6-Distill-Qwen-9B · 4-bit Xiaomi	64±2†	local (slow)	~8.6GB			llama.cpp ›
172	Laguna XS 2.1 (33B-A3B) · 4-bit Poolside	64±2†	local (slow)	~22GB		262k	Ollama ›
174	Qwen3 235B-A22B Instruct 2507 · 4-bit Alibaba	64±1	local (slow)	~144GB	~15 tok/s	262k	Ollama ›	+3
175	Mistral Medium 3.5 (128B) · 4-bit Mistral	64±1	local (slow)	~81GB		262k	Ollama ›
176	INTELLECT-3 · 4-bit Prime Intellect	64±1	local (slow)	~76GB			llama.cpp ›
177	GLM-4.5 · 2-bit Z.ai	64±1	local (slow)	~114GB		131k	llama.cpp ›	+3
179	MiniMax-M2 · 4-bit MiniMax	64±1	local (slow)	~147GB		205k	llama.cpp ›
181	Command A+ (05-2026) · 4-bit Cohere	64±1	local (slow)	~139GB		128k	llama.cpp ›
183	Nemotron 3 Super 120B-A12B · 4-bit NVIDIA	64±1	local (slow)	~78GB	~20 tok/s	262k	Ollama ›
184	Laguna XS.2 · 4-bit Poolside	64±1	local (slow)	~23GB		262k	llama.cpp ›
185	Gemma 4 26B-A4B · 4-bit QAT Google	64±1	local (slow)	~18GB	~35 tok/s	262k	Ollama ›	+13
187	EXAONE 4.5 33B · 4-bit LG AI Research	64±2†	local (slow)	~24GB		262k	llama.cpp ›
189	Qwen3-Coder 480B-A35B Instruct · 1-bit Alibaba	63±1	local (slow)	~78GB		262k	llama.cpp ›
191	Qwen3-VL 235B-A22B Thinking · 4-bit Alibaba	63±1	local (slow)	~144GB		256k	Ollama ›
192	DeepSeek R1 (Jan '25) · 1-bit DeepSeek	63±1	local (slow)	~104GB		128k	llama.cpp ›	+15
195	Qwen3-VL 235B-A22B Instruct · 4-bit Alibaba	63±1	local (slow)	~144GB		256k	Ollama ›
196	MiniCPM5 2B · 4-bit OpenBMB	63±1†	local (slow)	~2.5GB		131k	llama.cpp ›
197	Nemotron-Labs-3 Puzzle 75B-A9B · 4-bit NVIDIA	63±1†	local (slow)	~56GB			llama.cpp ›
198	Qwen3-Next 80B-A3B Instruct · 4-bit Alibaba	63±1	local (slow)	~50GB	~4.7 tok/s	131k	Ollama ›
201	Qwen3-Next 80B-A3B Thinking · 4-bit Alibaba	63±1	local (slow)	~49GB		131k	Ollama ›	+3
202	Granite 4.2 30B · 4-bit IBM	63±1	local (slow)	~20GB		131k	llama.cpp ›
206	GLM-4.5-Air · 4-bit Z.ai	62±1	local (slow)	~66GB	~23 tok/s	131k	llama.cpp ›	+4
207	Trinity-Large-Thinking · 2-bit Arcee AI	62±2	local (slow)	~141GB		512k	llama.cpp ›
208	Qwen3.5 9B · 4-bit Alibaba	62±0	local (slow)	~6.7GB	~15 tok/s	262k	llama.cpp ›	+19
209	Nemotron 3.5 Lightning 30B-A3B · 4-bit NVIDIA	62±2	local (slow)	~22GB	~87 tok/s	262k	Ollama ›
210	Seed-OSS 36B Instruct · 4-bit ByteDance Seed	62±1	local (slow)	~25GB		524k	llama.cpp ›
211	Gemma 4 12B · 4-bit Google	62±1	local (slow)	~9.9GB	~6.5 tok/s	262k	llama.cpp ›
214	GLM-4.6V · 4-bit Z.ai	62±2	local (slow)	~69GB		128k	llama.cpp ›
219	Qwen3-VL 32B Thinking · 4-bit Alibaba	62±1	local (slow)	~22GB		256k	llama.cpp ›
220	gpt-oss-120b · 4-bit OpenAI	62±1	local (slow)	~64GB	~44 tok/s	131k	llama.cpp ›	+19
222	Mistral Large 3 (675B-A41B) · 1-bit Mistral	62±1	local (slow)	~108GB		262k	llama.cpp ›	+1
223	Apriel 1.6 15B Thinker · 4-bit ServiceNow	62±1†	local (slow)	~11GB			llama.cpp ›
224	Devstral 2 (2512) · 4-bit Mistral	62±2	local (slow)	~78GB		256k	Ollama ›
228	GLM-4.5V · 4-bit Z.ai	61±2	local (slow)	~69GB		64k	llama.cpp ›
229	Devstral Small 2 24B · 4-bit Mistral	61±2	local (slow)	~16GB		262k	llama.cpp ›
231	Llama 3.1 Nemotron Ultra 253B v1 · 2-bit NVIDIA	61±1	local (slow)	~82GB		128k	llama.cpp ›
234	DeepSeek V3 0324 · 1-bit DeepSeek	60±1	local (slow)	~102GB		164k	llama.cpp ›	+11
238	Qwen3 30B-A3B Instruct 2507 · 4-bit Alibaba	60±1	local (slow)	~20GB	~100 tok/s	262k	llama.cpp ›	+4
239	Qwen3 30B-A3B Thinking 2507 · 4-bit Alibaba	60±1	local (slow)	~20GB		262k	llama.cpp ›	+8
240	ERNIE 4.5 300B-A47B · 2-bit Baidu	60±1†	local (slow)	~97GB		131k	llama.cpp ›
241	Qwen3.5 4B · 4-bit Alibaba	60±1	local (slow)	~3.8GB		262k	llama.cpp ›	+11
243	Mellum2.1 12B-A2.5B Thinking · 4-bit JetBrains	60±1†	local (slow)	~10GB			llama.cpp ›
244	Gemma 2 9B IT SimPO · 4-bit Princeton NLP	60±1	local (slow)	~7.6GB			llama.cpp ›
245	Gemma 2 9B IT DPO (Princeton) · 4-bit Princeton NLP	60±1	local (slow)	~7.6GB			llama.cpp ›
246	Falcon-H1R 7B · 4-bit TII	60±1†	local (slow)	~6GB		262k	llama.cpp ›
247	Nemotron-Cascade-14B-Thinking · 4-bit NVIDIA	60±1†	local (slow)	~11GB			llama.cpp ›
248	Qwen3-VL 32B Instruct · 4-bit Alibaba	60±1	local (slow)	~23GB		256k	llama.cpp ›
250	Qwen3 235B-A22B (Apr 2025, hybrid) · 4-bit Alibaba	60±0	local (slow)	~144GB		131k	Ollama ›	+14
252	Mistral Small 4 (119B-A6.5B) · 4-bit Mistral	60±2	local (slow)	~73GB		262k	llama.cpp ›
253	Granite 4.2 8B · 4-bit IBM	59±1	local (slow)	~7.2GB		131k	llama.cpp ›
254	QwQ-32B · 4-bit Alibaba	59±1	local (slow)	~23GB		131k	llama.cpp ›	+7
255	Solar Open 100B (102B-A12B) · 4-bit Upstage	59±1†	local (slow)	~67GB		131k	llama.cpp ›
256	Qwen3-VL 30B-A3B Thinking · 4-bit Alibaba	59±1	local (slow)	~20GB		256k	llama.cpp ›
258	OpenReasoning-Nemotron-32B · 4-bit NVIDIA	59±2†	local (slow)	~22GB			llama.cpp ›
259	EXAONE 4.0 32B · 4-bit LG AI Research	59±1	local (slow)	~22GB		131k	llama.cpp ›
260	Phi-4-reasoning-plus 14B · 4-bit Microsoft	59±1	local (slow)	~11GB			llama.cpp ›
261	GLM-4.7-Flash · 4-bit Z.ai	58±1	local (slow)	~19GB	~44 tok/s	200k	llama.cpp ›	+1
263	gpt-oss-20b · 4-bit OpenAI	58±1	local (slow)	~13GB	~8.7 tok/s	131k	llama.cpp ›	+16
264	Olmo 3.1 32B Think · 4-bit Ai2	58±1	local (slow)	~22GB		66k	llama.cpp ›
266	Qwen3 14B · 4-bit Alibaba	58±1	local (slow)	~11GB		33k	llama.cpp ›	+7
267	Llama 3.3 Nemotron Super 49B v1 · 4-bit NVIDIA	58±2	local (slow)	~33GB			llama.cpp ›
268	DeepSeek R1 Distill Llama 70B · 4-bit DeepSeek	58±1	local (slow)	~46GB		131k	Ollama ›	+1
270	Nemotron-Cascade-8B · 4-bit NVIDIA	58±1†	local (slow)	~6.8GB			llama.cpp ›
271	Command A (03-2025) · 4-bit Cohere	58±1	local (slow)	~72GB		256k	Ollama ›
272	Olmo 3 32B Think · 4-bit Ai2	58±1	local (slow)	~22GB		66k	llama.cpp ›
274	Phi-4-reasoning 14B · 4-bit Microsoft	58±1	local (slow)	~11GB		33k	llama.cpp ›
277	Magistral Small 1.2 · 4-bit Mistral	58±1	local (slow)	~17GB		131k	llama.cpp ›
279	Qwen3-VL 8B Thinking · 4-bit Alibaba	58±1	local (slow)	~6.9GB		256k	llama.cpp ›
280	Qwen3 32B · 4-bit Alibaba	58±0	local (slow)	~23GB		131k	llama.cpp ›	+17
283	Qwen3-VL 30B-A3B Instruct · 4-bit Alibaba	58±1	local (slow)	~20GB		256k	llama.cpp ›
284	Qwen3 Coder 30B-A3B Instruct · 4-bit Alibaba	57±1	local (slow)	~20GB	~93 tok/s	160k	llama.cpp ›
285	Qwen2.5 Coder 32B Instruct · 4-bit Alibaba	57±1	local (slow)	~23GB		131k	llama.cpp ›	+5
287	Llama 4 Maverick (402B-A17B) · 2-bit Meta	57±1	local (slow)	~129GB		1M	llama.cpp ›	+14
288	DeepSeek R1 0528 Qwen3 8B · 4-bit DeepSeek	57±1	local (slow)	~6.9GB	~3.6 tok/s	128k	llama.cpp ›
290	Granite 4.2 3B · 4-bit IBM	57±1	local (slow)	~3.4GB		131k	llama.cpp ›
292	Llama 3.3 Nemotron Super 49B v1.5 · 4-bit NVIDIA	57±1	local (slow)	~33GB		131k	llama.cpp ›
293	Nemotron 3 Nano 30B-A3B · 4-bit NVIDIA	57±1	local (slow)	~22GB	~105 tok/s	262k	Ollama ›	+3
294	Athene-V2-Chat 72B · 4-bit Nexusflow	57±1	local (slow)	~48GB		33k	Ollama ›
296	Granite 4.1 30B · 4-bit IBM	57±1†	local (slow)	~19GB	~25 tok/s		Ollama ›
297	Nemotron-Cascade-8B-Thinking · 4-bit NVIDIA	57±2	local (slow)	~6.8GB			llama.cpp ›
299	Qwen2.5-Omni 7B · 4-bit Alibaba	57±2	local (slow)	~5.8GB			llama.cpp ›
300	Sky-T1 32B Preview · 4-bit NovaSky (UC Berkeley)	57±4	local (slow)	~22GB			llama.cpp ›
301	Ministral 3 14B Reasoning 2512 · 4-bit Mistral	57±1	local (slow)	~10GB		262k	llama.cpp ›
303	Mistral Small 3.2 24B · 4-bit Mistral	56±1	local (slow)	~16GB		128k	llama.cpp ›	+4
304	DeepSeek-V2.5 (1210) · 2-bit DeepSeek	56±1	local (slow)	~82GB			llama.cpp ›
305	QED-Nano · 4-bit LM Provers	56±2	local (slow)	~4.1GB		262k	llama.cpp ›
306	Qwen3 4B Thinking 2507 · 4-bit Alibaba	56±1	local (slow)	~4.4GB	~36 tok/s	262k	llama.cpp ›	+3
310	Qwen3-VL 4B Thinking · 4-bit Alibaba	56±1	local (slow)	~4.4GB		256k	llama.cpp ›
311	Qwen2.5 72B Instruct · 4-bit Alibaba	56±1	local (slow)	~47GB		33k	Ollama ›	+24
312	Qwen2.5-VL 72B Instruct · 4-bit Alibaba	56±1	local (slow)	~48GB		33k	Ollama ›	+3
314	Mistral Large 2 (2411) · 4-bit Mistral	56±1	local (slow)	~77GB		128k	llama.cpp ›	+8
315	Qwen2.5 Coder 14B Instruct · 4-bit Alibaba	56±1	local (slow)	~11GB	~18 tok/s	131k	llama.cpp ›
316	DeepSeek R1 Distill Qwen 32B · 4-bit DeepSeek	56±1	local (slow)	~23GB	~7.3 tok/s	131k	llama.cpp ›	+5
317	Qwen2.5 32B Instruct · 4-bit Alibaba	56±1	local (slow)	~23GB		131k	llama.cpp ›	+11
318	Qwen3 8B · 4-bit Alibaba	56±1	local (slow)	~6.9GB	~25 tok/s	33k	llama.cpp ›	+15
319	DeepSeek R1 Distill Qwen 14B · 4-bit DeepSeek	56±1	local (slow)	~11GB	~15 tok/s	131k	llama.cpp ›	+2
321	Molmo 2 8B · 4-bit Ai2	56±2	local (slow)	~6.8GB			llama.cpp ›
322	Ministral 3 14B · 4-bit Mistral	55±1	local (slow)	~10GB	~46 tok/s	262k	llama.cpp ›	+2
323	Nemotron Nano 9B v2 · 4-bit NVIDIA	55±1	local (slow)	~7.6GB		131k	llama.cpp ›
324	EXAONE Deep 32B · 4-bit LG AI Research	55±2†	local (slow)	~22GB		33k	Ollama ›
325	Qwen3 4B Instruct 2507 · 4-bit Alibaba	55±1	local (slow)	~4.4GB	~60 tok/s	262k	llama.cpp ›	+4
326	Qwen3 30B-A3B (Apr 2025, hybrid) · 4-bit Alibaba	55±0	local (slow)	~20GB		33k	llama.cpp ›	+10
327	Bielik 11B v3.0 Instruct · 4-bit SpeakLeash	55±2	local (slow)	~8.5GB			llama.cpp ›
329	Granite 4.1 8B · 4-bit IBM	55±1	local (slow)	~7.2GB	~70 tok/s	131k	Ollama ›
330	Magistral Small 1.0 (2506) · 4-bit Mistral	55±1	local (slow)	~17GB		128k	llama.cpp ›
331	Spark-X2.5 1.7B · 4-bit iFLYTEK (SparkLLM)	55±1†	local (slow)	~1.9GB	~314 tok/s	1M	llama.cpp ›
332	Qwen2.5-Math 72B Instruct · 4-bit Alibaba	55±2†	local (slow)	~51GB		4k	llama.cpp ›
333	Llama 3.3 70B Instruct · 4-bit Meta	55±1	local (slow)	~46GB	~2.3 tok/s	128k	Ollama ›	+21
335	Qwen3-VL 8B Instruct · 4-bit Alibaba	55±1	local (slow)	~6.9GB		256k	llama.cpp ›
336	Mistral Large 2 (2407) · 4-bit Mistral	55±1	local (slow)	~78GB		128k	llama.cpp ›	+10
337	Falcon-H1 34B Instruct · 4-bit TII	55±3	local (slow)	~23GB		262k	llama.cpp ›
338	Llama 4 Scout (109B-A17B) · 4-bit Meta	55±1	local (slow)	~68GB	~19 tok/s	328k	Ollama ›	+8
340	Bielik 11B v2.6 Instruct · 4-bit SpeakLeash	55±3	local (slow)	~8.5GB			llama.cpp ›
341	Mistral Small 3.1 24B (2503) · 4-bit Mistral	55±1	local (slow)	~16GB		128k	llama.cpp ›	+7
342	Llama 3.1 Tulu 3 70B · 4-bit Ai2	55±1	local (slow)	~46GB		131k	llama.cpp ›
343	Pixtral Large (2411) · 2-bit Mistral	55±3	local (slow)	~51GB			llama.cpp ›
344	Olmo 3.1 32B Instruct · 4-bit Ai2	55±2	local (slow)	~22GB		66k	llama.cpp ›
348	OpenThinker2 32B · 4-bit Open Thoughts	55±1	local (slow)	~22GB		33k	llama.cpp ›
349	DeepSeek-V2 Chat (0628) · 2-bit DeepSeek	55±1	local (slow)	~66GB			llama.cpp ›
351	OpenThinker 32B · 4-bit Open Thoughts	55±1†	local (slow)	~22GB		33k	llama.cpp ›
352	Command A Reasoning (08-2025) · 4-bit Cohere	54±2	local (slow)	~72GB			llama.cpp ›
353	Magistral Small 1.1 (2507) · 4-bit Mistral	54±1†	local (slow)	~17GB		40k	llama.cpp ›
354	Mellum2 12B-A2.5B Thinking · 4-bit JetBrains	54±1†	local (slow)	~10GB		131k	llama.cpp ›
355	Ministral 3 8B Reasoning 2512 · 4-bit Mistral	54±1	local (slow)	~6.9GB		262k	llama.cpp ›
356	Llama 3.1 Tulu 3 70B DPO · 4-bit Ai2	54±1	local (slow)	~46GB		131k	llama.cpp ›
358	Nemotron 3 Nano 4B · 4-bit NVIDIA	54±1	local (slow)	~3.5GB	~104 tok/s	262k	llama.cpp ›
360	DeepSeek-Coder-V2 Instruct (0614) · 2-bit DeepSeek	54±1	local (slow)	~92GB			llama.cpp ›	+2
363	Mistral Small 3 24B (2501) · 4-bit Mistral	54±1	local (slow)	~16GB		32k	llama.cpp ›	+6
367	GLM-4 9B Chat 1M · 4-bit Zhipu AI (THUDM)	54±4	local (slow)	~8.1GB		1M	llama.cpp ›
368	EXAONE Deep 7.8B · 4-bit LG AI Research	54±2†	local (slow)	~6.5GB		33k	llama.cpp ›
371	Qwen2-VL 72B Instruct · 4-bit Alibaba	54±1	local (slow)	~53GB			llama.cpp ›
372	Hermes 3 Llama 3.1 405B · 2-bit Nous Research	54±1	local (slow)	~114GB		131k	llama.cpp ›
373	Llama 3.1 70B Instruct · 4-bit Meta	53±0	local (slow)	~46GB		128k	llama.cpp ›	+22
374	Gemma 3 27B · 4-bit Google	53±1	local (slow)	~20GB		131k	llama.cpp ›	+23
375	Qwen2.5-VL 32B Instruct · 4-bit Alibaba	53±2	local (slow)	~23GB		33k	llama.cpp ›	+1
378	Phi-4 14B · 4-bit Microsoft	53±1	local (slow)	~11GB		16k	llama.cpp ›	+11
379	Bielik 11B v2.1 Instruct · 4-bit SpeakLeash	53±3	local (slow)	~8.5GB			llama.cpp ›
380	Qwen2.5-Math 7B Instruct · 4-bit Alibaba	53±2†	local (slow)	~5.8GB		4k	llama.cpp ›
381	Olmo 3 7B Think · 4-bit Ai2	53±1	local (slow)	~6.2GB		66k	llama.cpp ›
382	s1.1 32B · 4-bit Simple Scaling	53±1	local (slow)	~22GB		33k	llama.cpp ›
383	Ministral 3 8B · 4-bit Mistral	53±1	local (slow)	~6.9GB	~68 tok/s	262k	llama.cpp ›	+3
384	Gemma 4 E4B · 4-bit Google	53±1	local (slow)	~6.6GB	~59 tok/s	131k	llama.cpp ›	+8
385	Llama 3.1 Nemotron 70B Instruct · 4-bit NVIDIA	53±1	local (slow)	~46GB		128k	llama.cpp ›	+4
386	Qwen3-VL 4B Instruct · 4-bit Alibaba	53±1	local (slow)	~4.4GB		256k	llama.cpp ›
390	LFM2.5 2.6B · 4-bit Liquid AI	53±1	local (slow)	~2.4GB		131k	llama.cpp ›
391	Bielik 11B v2.2 Instruct · 4-bit SpeakLeash	53±3	local (slow)	~8.5GB			llama.cpp ›
392	Llama 3.1 Nemotron 51B Instruct · 4-bit NVIDIA	53±2	local (slow)	~34GB			llama.cpp ›
393	Aya Expanse 32B · 4-bit Cohere	53±2	local (slow)	~22GB		128k	llama.cpp ›	+1
395	Granite 4.0 H Small (32B-A9B) · 4-bit IBM	53±1	local (slow)	~22GB		131k	llama.cpp ›	+1
396	Qwen2.5 Coder 7B Instruct · 4-bit Alibaba	53±1	local (slow)	~5.8GB	~48 tok/s	131k	llama.cpp ›
397	OpenCoder-8B-Instruct · 4-bit INF (infly)	53±1	local (slow)	~6.4GB			llama.cpp ›
398	LFM2.5 8B-A1B · 4-bit Liquid AI	52±1	local (slow)	~5.9GB	~250 tok/s	128k	llama.cpp ›
399	Gemma 3 12B · 4-bit Google	52±1	local (slow)	~10GB	~13 tok/s	131k	llama.cpp ›	+10
400	Qwen2.5 14B Instruct · 4-bit Alibaba	52±1	local (slow)	~11GB		131k	llama.cpp ›	+7
402	Cogito v1 Preview Llama 8B · 4-bit Deep Cogito	52±4	local (slow)	~6.6GB		128k	llama.cpp ›
403	Llama-3-Instruct-8B-SimPO-ExPO · 4-bit Chujie Zheng (ExPO)	52±1	local (slow)	~6.6GB			llama.cpp ›
404	Llama-3-Instruct-8B-SimPO · 4-bit Princeton NLP	52±1	local (slow)	~6.6GB			llama.cpp ›
405	Athene-70B · 4-bit Nexusflow	52±1	local (slow)	~46GB			llama.cpp ›
406	Qwen2 72B Instruct · 4-bit Alibaba	52±1	local (slow)	~48GB		131k	Ollama ›	+14
409	CodeQwen1.5 7B Chat · 4-bit Alibaba	52±1	local (slow)	~6.4GB		64k	llama.cpp ›
410	OpenCodeInterpreter-DS-33B · 4-bit M-A-P	51±1	local (slow)	~22GB			llama.cpp ›
411	Bielik 11B v2.0 Instruct · 4-bit SpeakLeash	51±3	local (slow)	~8.5GB			llama.cpp ›
414	LFM2 24B-A2B · 4-bit Liquid AI	51±1	local (slow)	~15GB		33k	llama.cpp ›
415	Qwen3 4B · 4-bit Alibaba	51±1	local (slow)	~4.4GB		33k	llama.cpp ›	+8
416	DeepSeek-Coder 33B Instruct · 4-bit DeepSeek	51±1	local (slow)	~22GB		16k	llama.cpp ›	+1
418	Codestral 22B v0.1 · 4-bit Mistral AI	51±1	local (slow)	~16GB		32k	llama.cpp ›
419	Gemma 2 27B IT · 4-bit Google	51±1	local (slow)	~21GB		8k	llama.cpp ›	+10
420	Llama 3 70B Instruct · 4-bit Meta	51±0	local (slow)	~46GB		8k	llama.cpp ›	+17
421	Llama 3.2 90B Vision Instruct · 4-bit Meta	51±1	local (slow)	~58GB		128k	Ollama ›	+1
422	WizardCoder 33B V1.1 · 4-bit WizardLM	51±1	local (slow)	~22GB		16k	llama.cpp ›
423	Bielik 11B v2.3 Instruct · 4-bit SpeakLeash	51±2	local (slow)	~8.6GB			llama.cpp ›
425	Llama-3-8B-ProLong-512k-Instruct · 4-bit Princeton NLP	51±4	local (slow)	~35GB			how to run ›
427	OpenCodeInterpreter-DS-6.7B · 4-bit M-A-P	51±1	local (slow)	~5.8GB			llama.cpp ›
428	Qwen2-Math 72B Instruct · 4-bit Alibaba	51±1	local (slow)	~45GB		4k	Ollama ›
429	WizardLM-2 8x22B · 4-bit Microsoft	51±1	local (slow)	~91GB			Ollama ›
430	Mistral Small Instruct 22B (2409) · 4-bit Mistral AI	51±2	local (slow)	~16GB		32k	llama.cpp ›
431	OpenThinker3 7B · 4-bit Open Thoughts	51±1	local (slow)	~6.4GB		33k	llama.cpp ›
432	Granite 4.1 3B · 4-bit IBM	51±1†	local (slow)	~3.7GB	~131 tok/s		Ollama ›
433	Artigenz-Coder-DS-6.7B · 4-bit Artigenz	51±1	local (slow)	~5.8GB			llama.cpp ›
434	Yi 34B 200K (base) · 4-bit 01.AI	51±4	local (slow)	~23GB		200k	llama.cpp ›
435	Mellum2 12B-A2.5B Instruct · 4-bit JetBrains	51±2†	local (slow)	~9GB		131k	llama.cpp ›
437	Hermes 3 Llama 3.1 70B · 4-bit Nous Research	50±1	local (slow)	~43GB		131k	Ollama ›
438	speechless-codellama-34b-v2.0 · 4-bit uukuguy	50±1	local (slow)	~23GB			llama.cpp ›
439	OLMo 2 32B Instruct (0325) · 4-bit Ai2	50±1	local (slow)	~21GB			llama.cpp ›
440	Ministral 3 3B Reasoning 2512 · 4-bit Mistral	50±1	local (slow)	~3.6GB		262k	llama.cpp ›
441	Aya 23 35B · 4-bit Cohere For AI	50±2	local (slow)	~24GB		8k	Ollama ›
442	AceReason-Nemotron-1.0-14B · 4-bit NVIDIA	50±2†	local (slow)	~11GB			llama.cpp ›
444	Qwen2.5-VL 7B Instruct · 4-bit Alibaba	50±1	local (slow)	~5.8GB			llama.cpp ›
445	Mixtral 8x22B Instruct v0.1 · 4-bit Mistral	50±1	local (slow)	~91GB		64k	Ollama ›	+9
446	Magicoder-S-DS 6.7B · 4-bit UIUC (ise-uiuc)	50±1	local (slow)	~5.8GB			llama.cpp ›
447	EXAONE Deep 2.4B · 4-bit LG AI Research	50±2†	local (slow)	~3.2GB		33k	Ollama ›
448	Pixtral 12B (2409) · 4-bit Mistral	50±2	local (slow)	~9.6GB			llama.cpp ›
450	XwinCoder-34B · 4-bit Xwin-LM	50±1	local (slow)	~23GB			llama.cpp ›
451	Qwen2.5 7B Instruct · 4-bit Alibaba	50±1	local (slow)	~5.8GB	~49 tok/s	131k	llama.cpp ›	+12
452	LFM2.5 1.2B Thinking · 4-bit Liquid AI	50±2	local (slow)	~1.3GB		33k	llama.cpp ›
453	Yi-Coder 9B Chat · 4-bit 01.AI	50±1	local (slow)	~6.6GB		128k	llama.cpp ›
454	InternLM2.5 7B Chat · 4-bit Shanghai AI Laboratory (InternLM)	50±2	local (slow)	~6.4GB			llama.cpp ›
455	StarChat2 15B v0.1 · 4-bit Hugging Face	50±1	local (slow)	~12GB		16k	llama.cpp ›
456	Code Millenials 34B · 4-bit Bud Ecosystem	50±1	local (slow)	~23GB			llama.cpp ›
457	Qwen2-Math 7B Instruct · 4-bit Alibaba	50±2†	local (slow)	~6.1GB		4k	Ollama ›
458	WaveCoder-Ultra-6.7B · 4-bit Microsoft	50±1	local (slow)	~5.8GB			llama.cpp ›
461	MegaBeam-Mistral-7B-512k · 4-bit AWS (aws-prototyping)	49±4	local (slow)	~5.9GB			llama.cpp ›
463	Phi-3.5-MoE-instruct · 4-bit Microsoft	49±1	local (slow)	~27GB		128k	llama.cpp ›
464	Qwen3-VL 2B Thinking · 4-bit Alibaba	49±1	local (slow)	~2.7GB		256k	llama.cpp ›
465	Gemma 3n E4B · 4-bit Google	49±1	local (slow)	~5.6GB		32k	llama.cpp ›
467	DeepSeek-Coder 7B Instruct v1.5 · 4-bit DeepSeek	49±1	local (slow)	~5.9GB			llama.cpp ›
468	OpenThinker2 7B · 4-bit Open Thoughts	49±2†	local (slow)	~6.4GB		33k	llama.cpp ›
469	DeepSeek-Coder 6.7B Instruct · 4-bit DeepSeek	49±1	local (slow)	~8.8GB		16k	llama.cpp ›
470	Qwen2 57B-A14B Instruct · 4-bit Alibaba	49±2	local (slow)	~38GB		33k	llama.cpp ›
471	Hermes 2 Theta Llama-3 70B · 4-bit Nous Research	49±2	local (slow)	~47GB		8k	llama.cpp ›
472	MiniCPM3-4B · 4-bit OpenBMB	49±2	local (slow)	~4.1GB		32k	llama.cpp ›
473	Granite 4.0 H Tiny (7B-A1B) · 4-bit IBM	49±1	local (slow)	~4.8GB	~12 tok/s	131k	Ollama ›
474	Qwen2.5 Coder 3B Instruct · 4-bit Alibaba	49±1	local (slow)	~2.8GB	~9.5 tok/s	33k	Ollama ›
476	Gemma 2 9B IT · 4-bit Google	49±1	local (slow)	~9.5GB		8k	llama.cpp ›	+14
477	Yi-1.5 34B (base) · 4-bit 01.AI	49±2	local (slow)	~23GB		4k	llama.cpp ›
478	Bielik 4.5B v3.0 Instruct · 4-bit SpeakLeash	49±2	local (slow)	~4.5GB			llama.cpp ›
480	WhiteRabbitNeo-33B-v1 · 4-bit WhiteRabbitNeo	49±1	local (slow)	~22GB			llama.cpp ›
481	Qwen1.5 110B Chat · 4-bit Alibaba	48±1	local (slow)	~72GB		32k	Ollama ›	+1
482	Command R Plus (08-2024) · 4-bit Cohere	48±1	local (slow)	~67GB		128k	llama.cpp ›	+1
483	GLM-4 9B Chat · 4-bit Zhipu AI (Z.ai)	48±2	local (slow)	~7.1GB		128k	Ollama ›	+1
484	speechless-coder-ds-6.7b · 4-bit uukuguy	48±1	local (slow)	~5.8GB			llama.cpp ›
485	Magicoder-S-CL-7B · 4-bit UIUC (ise-uiuc)	48±1	local (slow)	~5.8GB			llama.cpp ›
486	Phind CodeLlama 34B v2 · 4-bit Phind	48±1	local (slow)	~23GB		16k	Ollama ›
487	AceReason-Nemotron-1.1-7B · 4-bit NVIDIA	48±2†	local (slow)	~6.4GB			llama.cpp ›
488	Jamba 1.5 Mini · 4-bit AI21 Labs	48±1	local (slow)	~34GB			llama.cpp ›
489	DeepSeek R1 Distill Qwen 7B · 4-bit DeepSeek	48±1	local (slow)	~5.8GB	~64 tok/s	131k	llama.cpp ›	+7
494	Aya Expanse 8B · 4-bit Cohere	48±2	local (slow)	~7GB		8k	llama.cpp ›
495	EuroLLM 9B Instruct · 4-bit UTTER (EuroLLM)	48±2	local (slow)	~7.4GB		4k	llama.cpp ›
498	Granite 4.0 H Micro 3B · 4-bit IBM	48±1	local (slow)	~3.5GB		131k	Ollama ›
500	Code Llama 70B Instruct · 4-bit Meta	48±1	local (slow)	~45GB		16k	llama.cpp ›	+1
501	Command R (08-2024) · 4-bit Cohere	48±1	local (slow)	~22GB		128k	llama.cpp ›	+3
502	OLMo 2 13B Instruct (1124) · 4-bit Allen Institute for AI	48±1	local (slow)	~10GB		4k	llama.cpp ›
503	InternLM2.5 7B Chat 1M · 4-bit Shanghai AI Laboratory (InternLM)	48±4	local (slow)	~6.4GB			llama.cpp ›
504	Falcon-H1 7B Instruct · 4-bit TII	48±3	local (slow)	~6.3GB		262k	llama.cpp ›
506	Llama 3 70B (base) · 16-bit Meta	47±2	local (slow)	~150GB			how to run ›
508	Qwen3.5 2B · 4-bit Alibaba	47±1	local (slow)	~2.2GB	~174 tok/s	262k	llama.cpp ›	+7
509	Tulu 2 70B · 4-bit Allen Institute for AI	47±2†	local (slow)	~45GB			llama.cpp ›
511	Hermes 2 Pro Llama 3 8B · 4-bit Nous Research	47±3	local (slow)	~6.6GB		8k	llama.cpp ›
512	MedGemma 4B IT · 4-bit Google	47±2	local (slow)	~4.1GB			llama.cpp ›
514	Yi 1.5 34B Chat · 4-bit 01.AI	47±1	local (slow)	~23GB		4k	llama.cpp ›	+5
515	OpenChat 3.5 0106 · 4-bit OpenChat	47±1	local (slow)	~6.1GB		8k	llama.cpp ›	+1
517	WizardCoder Python 34B V1.0 · 4-bit WizardLM	47±1	local (slow)	~22GB		16k	Ollama ›
519	Granite 4.0 Micro 3B · 4-bit IBM	47±1	local (slow)	~3.7GB	~6.2 tok/s	131k	llama.cpp ›
520	Gemma 4 E2B · 4-bit Google	47±1	local (slow)	~4.5GB		131k	llama.cpp ›	+6
522	DBRX Instruct · 4-bit Databricks	47±1	local (slow)	~85GB		32k	Ollama ›	+3
524	Granite 34B Code Instruct (8K) · 4-bit IBM	47±1	local (slow)	~22GB			Ollama ›
525	Cogito v1 Preview Llama 3B · 4-bit Deep Cogito	47±4	local (slow)	~3.8GB		128k	llama.cpp ›
526	Qwen2.5-Math 1.5B Instruct · 4-bit Alibaba	47±2†	local (slow)	~1.9GB		4k	llama.cpp ›
527	EXAONE 4.0 1.2B · 4-bit LG AI Research	47±1†	local (slow)	~2.8GB		66k	llama.cpp ›
528	InternLM2.5 20B Chat · 4-bit Shanghai AI Laboratory (InternLM)	47±2	local (slow)	~14GB		33k	llama.cpp ›
529	StarCoder2-15B-Instruct-v0.1 · 4-bit BigCode	47±1	local (slow)	~11GB		16k	Ollama ›
531	Qwen1.5 72B Chat · 4-bit Alibaba	47±1	local (slow)	~48GB		32k	Ollama ›	+9
532	Granite 3.3 8B Instruct · 4-bit IBM	47±1	local (slow)	~6.6GB		128k	llama.cpp ›
533	speechless-starcoder2-15b · 4-bit uukuguy	47±1	local (slow)	~12GB			llama.cpp ›
534	OpenChat 3.5 0106 Gemma · 4-bit OpenChat	47±2	local (slow)	~6.9GB		8k	llama.cpp ›
535	Phi-3 Medium 128K Instruct · 4-bit Microsoft	47±1	local (slow)	~11GB		128k	llama.cpp ›
536	Zephyr ORPO 141B-A35B v0.1 · 4-bit Hugging Face	47±2	local (slow)	~91GB		66k	Ollama ›
537	Qwen2-VL 7B Instruct · 4-bit Alibaba	47±1	local (slow)	~6.5GB			llama.cpp ›
541	DeepSeek R1 Distill Llama 8B · 4-bit DeepSeek	46±1	local (slow)	~6.6GB		131k	llama.cpp ›	+2
542	Phi-3-medium-4k-instruct · 4-bit Microsoft	46±1	local (slow)	~11GB		4k	llama.cpp ›	+1
543	QwQ-32B-Preview · 4-bit Alibaba	46±2	local (slow)	~22GB		33k	llama.cpp ›	+2
544	DeepSeek-Coder-V2 Lite Instruct (16B-A2.4B) · 4-bit DeepSeek	46±1	local (slow)	~11GB		128k	Ollama ›	+1
546	Qwen2-Math 1.5B Instruct · 4-bit Alibaba	46±2†	local (slow)	~2.5GB		4k	Ollama ›
548	Llama 3.1 8B Instruct · 4-bit Meta	46±0	local (slow)	~6.6GB	~89 tok/s	128k	llama.cpp ›	+25
549	Phi-4-mini-reasoning 3.8B · 4-bit Microsoft	46±2	local (slow)	~4.3GB		128k	llama.cpp ›
550	Ministral 3 3B · 4-bit Mistral	46±1	local (slow)	~3.6GB	~128 tok/s	262k	llama.cpp ›	+2
551	Olmo 3 7B Instruct · 4-bit Ai2	46±1	local (slow)	~6.2GB		66k	llama.cpp ›
553	Command R Plus (04-2024) · 4-bit Cohere	46±1	local (slow)	~67GB		128k	llama.cpp ›	+6
554	Mistral NeMo Instruct (2407) · 4-bit Mistral	46±1	local (slow)	~9.4GB		128k	llama.cpp ›	+9
556	Llama 3.1 Tulu 3 8B · 4-bit Ai2	46±1	local (slow)	~6.6GB		131k	llama.cpp ›
557	Phi-3-mini-4k-instruct (June 2024 update) · 4-bit Microsoft	46±1	local (slow)	~6GB			llama.cpp ›
558	Yi 1.5 9B Chat · 4-bit 01.AI	46±1	local (slow)	~7.1GB		4k	llama.cpp ›	+1
559	Qwen1.5 32B Chat · 4-bit Alibaba	46±1	local (slow)	~22GB		32k	llama.cpp ›
560	Xwin-LM 70B v0.1 · 4-bit Xwin-LM	46±1	local (slow)	~42GB			Ollama ›
561	Eurus-2-7B-PRIME · 4-bit PRIME-RL	46±2	local (slow)	~6.4GB		4k	llama.cpp ›
562	Qwen2 7B Instruct · 4-bit Alibaba	46±1	local (slow)	~5.8GB		131k	llama.cpp ›	+4
563	Command R7B (12-2024) · 4-bit Cohere	46±1	local (slow)	~6.9GB		128k	llama.cpp ›
564	Granite 20B Code Instruct (8K) · 4-bit IBM	45±1	local (slow)	~14GB			Ollama ›
565	Dolphin 2.6 Mixtral 8x7B · 4-bit Cognitive Computations	45±1	local (slow)	~29GB			llama.cpp ›
566	Gemma 3 4B · 4-bit Google	45±1	local (slow)	~4.1GB	~74 tok/s	131k	llama.cpp ›	+11
567	Granite 3.0 8B Instruct · 4-bit IBM	45±1	local (slow)	~6.6GB		4k	llama.cpp ›
569	Granite 8B Code Instruct (4K) · 4-bit IBM	45±1	local (slow)	~6.6GB			llama.cpp ›
570	Falcon3 7B Instruct · 4-bit TII	45±2	local (slow)	~6.3GB		32k	llama.cpp ›
571	Phi-4-mini 3.8B · 4-bit Microsoft	45±1	local (slow)	~4.3GB		128k	llama.cpp ›	+4
572	Ministral 8B (2410) · 4-bit Mistral	45±1	local (slow)	~6.6GB		128k	llama.cpp ›	+6
573	Code Llama 70B Python · 4-bit Meta	45±1	local (slow)	~45GB		16k	Ollama ›
574	Code Tulu 2 34B · 16-bit Allen Institute for AI	45±2†	local (slow)	~72GB			how to run ›
575	Falcon3 10B Instruct · 4-bit TII	45±2	local (slow)	~8.1GB	~13 tok/s	32k	llama.cpp ›
576	Granite 3.2 8B Instruct · 4-bit IBM	45±1	local (slow)	~6.6GB		131k	llama.cpp ›
577	OpenThinker 7B · 4-bit Open Thoughts	45±2†	local (slow)	~6.4GB		33k	llama.cpp ›
578	Yi 34B Chat · 4-bit 01.AI	45±1	local (slow)	~23GB		4k	llama.cpp ›	+1
579	Hermes 2 Theta Llama 3 8B · 4-bit Nous Research	45±2	local (slow)	~6.6GB		8k	llama.cpp ›
580	Llama 3.1 8B (base) · 4-bit Meta	45±3	local (slow)	~6.6GB			llama.cpp ›
581	Gemma 3n E2B IT · 4-bit Google	45±2	local (slow)	~4.1GB		32k	llama.cpp ›
582	Code Llama 70B (base) · 4-bit Meta	45±1	local (slow)	~45GB		16k	Ollama ›
583	Phi-3.5-mini-instruct · 4-bit Microsoft	45±1	local (slow)	~6GB		128k	llama.cpp ›	+4
584	Qwen2.5-VL 3B Instruct · 4-bit Alibaba	45±1	local (slow)	~2.8GB			llama.cpp ›
585	Qwen3-VL 2B Instruct · 4-bit Alibaba	45±1	local (slow)	~2.7GB		256k	llama.cpp ›
586	LFM2.5 1.2B Instruct · 4-bit Liquid AI	45±2	local (slow)	~1.3GB		33k	llama.cpp ›
587	Qwen3 1.7B · 4-bit Alibaba	45±1	local (slow)	~2.9GB	~96 tok/s	33k	llama.cpp ›	+11
590	Granite 3.1 8B Instruct · 4-bit IBM	44±1	local (slow)	~6.7GB		128k	llama.cpp ›
593	Llama 3.2 11B Vision Instruct · 4-bit Meta	44±2	local (slow)	~8.9GB		128k	Ollama ›
594	Qwen2.5 3B Instruct · 4-bit Alibaba	44±1	local (slow)	~3GB	~61 tok/s	33k	llama.cpp ›	+5
595	LFM2 2.6B · 4-bit Liquid AI	44±1	local (slow)	~2.2GB		33k	llama.cpp ›
597	Tulu 2 DPO 70B · 4-bit Ai2	44±1	local (slow)	~45GB			llama.cpp ›	+1
599	MiniCPM-V 2.6 · 4-bit OpenBMB	44±2	local (slow)	~5.8GB			llama.cpp ›
600	CodeGemma 7B IT (v1.0) · 4-bit Google	44±1	local (slow)	~7.1GB			llama.cpp ›
601	Yi-1.5 9B (base) · 4-bit 01.AI	44±2	local (slow)	~7.1GB		4k	llama.cpp ›
603	Qwen2-Audio 7B Instruct · 4-bit Alibaba	44±3	local (slow)	~6.5GB			llama.cpp ›
604	DeepSeek-Coder 1.3B Instruct · 4-bit DeepSeek	44±1	local (slow)	~2.9GB		16k	Ollama ›
605	Mathstral 7B v0.1 · 4-bit Mistral AI	44±1	local (slow)	~5.9GB		32k	llama.cpp ›
606	Aya 23 8B · 4-bit Cohere For AI	44±3	local (slow)	~6.9GB		8k	llama.cpp ›
607	Qwen2.5 Coder 1.5B Instruct · 4-bit Alibaba	44±1	local (slow)	~1.9GB		33k	Ollama ›
608	WizardLM 70B V1.0 · 4-bit Microsoft	44±1	local (slow)	~42GB			Ollama ›
609	SmolLM3 3B · 4-bit Hugging Face	44±1	local (slow)	~3.5GB		66k	llama.cpp ›
610	Hermes 3 Llama 3.1 8B · 4-bit Nous Research	44±1	local (slow)	~6.6GB		128k	llama.cpp ›
611	Llama 3 8B Instruct · 4-bit Meta	44±0	local (slow)	~6.6GB		8k	llama.cpp ›	+19
612	Command R (03-2024) · 4-bit Cohere	44±1	local (slow)	~33GB		128k	llama.cpp ›	+6
613	Aya Vision 32B · 4-bit Cohere	44±3	local (slow)	~71GB		16k	how to run ›
614	WizardCoder Python 13B V1.0 · 4-bit WizardLM	43±2	local (slow)	~15GB		16k	llama.cpp ›
615	OpenChat 3.5 · 4-bit OpenChat	43±1	local (slow)	~6.1GB		8k	llama.cpp ›
616	Granite 34B Code Base (8K) · 4-bit IBM	43±1	local (slow)	~24GB			llama.cpp ›
617	speechless-starcoder2-7b · 4-bit uukuguy	43±1	local (slow)	~6.1GB			llama.cpp ›
618	OLMo 2 7B Instruct (1124) · 4-bit Allen Institute for AI	43±1	local (slow)	~6.2GB		4k	llama.cpp ›
619	Falcon2 11B (base) · 4-bit TII	43±3	local (slow)	~8.2GB		8k	Ollama ›
622	WizardCoder-15B-V1.0 · 4-bit WizardLM	43±1	local (slow)	~12GB			llama.cpp ›
625	DeepSeek LLM 67B Chat · 4-bit DeepSeek	43±1	local (slow)	~44GB		4k	llama.cpp ›
626	Qwen1.5 14B Chat · 4-bit Alibaba	43±1	local (slow)	~11GB		32k	Ollama ›	+3
627	Llama 2 70B (base) · 4-bit Meta	43±1	local (slow)	~43GB		4k	Ollama ›
628	Mixtral 8x7B v0.1 (base) · 4-bit Mistral AI	43±1	local (slow)	~29GB		32k	llama.cpp ›
629	Code Llama 34B Python · 4-bit Meta	43±1	local (slow)	~23GB		16k	Ollama ›
630	DeepSeek-Coder 33B Base · 4-bit DeepSeek	43±1	local (slow)	~22GB		16k	llama.cpp ›
631	speechless-coding-7b-16k-tora · 16-bit uukuguy	43±1	local (slow)	~16GB			how to run ›
633	InternLM2 Chat 20B · 4-bit Shanghai AI Laboratory (InternLM)	43±1	local (slow)	~14GB			llama.cpp ›
634	CodeQwen1.5 7B (base) · 4-bit Alibaba	42±1	local (slow)	~6.4GB		66k	llama.cpp ›
635	Nous Hermes 2 Mistral 7B DPO · 4-bit Nous Research	42±3	local (slow)	~6.1GB		33k	llama.cpp ›
636	Mixtral 8x7B Instruct v0.1 · 4-bit Mistral	42±0	local (slow)	~28GB		32k	llama.cpp ›	+15
638	Granite 4.0 1B · 4-bit IBM	42±1	local (slow)	~2.6GB		128k	llama.cpp ›
639	OpenHermes-2.5-Code-290k-13B · 4-bit ajibawa-2023	42±1	local (slow)	~9.8GB			llama.cpp ›
640	Granite 4.0 H 1B · 4-bit IBM	42±1	local (slow)	~2.4GB		131k	llama.cpp ›
641	Nous Hermes 2 Mixtral 8x7B DPO · 4-bit Nous Research	42±2	local (slow)	~30GB		33k	llama.cpp ›
643	Deita 7B v1.0 · 4-bit HKUST NLP	42±2	local (slow)	~32GB			how to run ›
646	OpenHermes 2.5 Mistral 7B · 4-bit Nous Research	42±1	local (slow)	~5.9GB			llama.cpp ›	+2
647	Code Llama 34B Instruct · 4-bit Meta	42±1	local (slow)	~23GB		16k	llama.cpp ›	+1
648	Code Llama 34B (base) · 4-bit Meta	42±1	local (slow)	~23GB		16k	Ollama ›	+1
649	Starling-LM 7B beta · 4-bit Nexusflow	42±1	local (slow)	~6.1GB		8k	llama.cpp ›	+3
650	Vicuna 33B v1.3 · 4-bit LMSYS	41±1	local (slow)	~23GB		2k	Ollama ›	+2
651	Phi-3-mini-128k-instruct (Apr 2024) · 16-bit Microsoft	41±2	local (slow)	~9.5GB			how to run ›	+1
652	Code Tulu 2 13B · 16-bit Allen Institute for AI	41±2†	local (slow)	~29GB			how to run ›
653	Bielik 1.5B v3.0 Instruct · 4-bit SpeakLeash	41±3	local (slow)	~2.6GB			llama.cpp ›
654	Starling-LM 7B alpha · 4-bit UC Berkeley (NEST)	41±1	local (slow)	~6.1GB		8k	llama.cpp ›	+2
655	Granite 3.3 2B Instruct · 4-bit IBM	41±1†	local (slow)	~3.1GB		128k	llama.cpp ›
656	Llama3-OpenBioLLM-8B · 4-bit Saama AI Labs	41±2	local (slow)	~6.6GB			llama.cpp ›
657	Mistral 7B Instruct v0.3 · 4-bit Mistral	41±1	local (slow)	~5.9GB		32k	llama.cpp ›	+4
658	LLaVA-v1.6-34B · 4-bit LLaVA	41±2	local (slow)	~24GB		4k	Ollama ›
659	LFM2 1.2B · 4-bit Liquid AI	41±1	local (slow)	~1.3GB		33k	llama.cpp ›
660	DeepSeek-Coder 6.7B Base · 4-bit DeepSeek	41±1	local (slow)	~8.8GB		16k	llama.cpp ›
661	Granite 3.0 2B Instruct · 4-bit IBM	41±1	local (slow)	~3.2GB		4k	llama.cpp ›
662	Llama 2 70B Chat · 4-bit Meta	41±1	local (slow)	~45GB		4k	llama.cpp ›	+13
663	Llama 3.2 3B Instruct · 4-bit Meta	41±1	local (slow)	~3.5GB	~162 tok/s	131k	llama.cpp ›	+11
664	Granite 8B Code Base (4K) · 4-bit IBM	41±1	local (slow)	~6.6GB			llama.cpp ›
665	StarCoder2 15B · 4-bit BigCode	41±1	local (slow)	~12GB		16k	llama.cpp ›
666	Llama-3-Instruct-8B-SimPO-v0.2 · 4-bit Princeton NLP	40±1	local (slow)	~6.6GB			llama.cpp ›
667	Falcon-H1 3B Instruct · 4-bit TII	40±3	local (slow)	~3.5GB		131k	llama.cpp ›
668	Phi-2 (2.7B) · 4-bit Microsoft	40±1	local (slow)	~4.7GB		2k	Ollama ›	+2
669	speechless-code-mistral-7b-v1.0 · 4-bit uukuguy	40±1	local (slow)	~17GB			how to run ›
670	Qwen-14B-Chat · 4-bit Alibaba	40±1	local (slow)	~11GB			llama.cpp ›
671	Code Llama 13B Instruct · 4-bit Meta	40±1	local (slow)	~15GB		16k	llama.cpp ›
672	Tulu 2 13B · 4-bit Allen Institute for AI	40±2	local (slow)	~9.8GB			llama.cpp ›
673	Falcon-180B-Chat · 4-bit TII	40±2	local (slow)	~115GB		2k	Ollama ›
674	MistralHermes-CodePro-7B-v1 · 4-bit beowolx	40±1	local (slow)	~6.1GB			llama.cpp ›
676	Phi-3-mini-4k-instruct (Apr 2024) · 4-bit Microsoft	40±2	local (slow)	~6GB			llama.cpp ›
677	CodeGemma 7B (v1.0) · 4-bit Google	40±1	local (slow)	~7.1GB			llama.cpp ›
678	Code Llama 13B Python · 4-bit Meta	40±1	local (slow)	~9.8GB		16k	llama.cpp ›
679	Apertus 8B Instruct (2509) · 4-bit Swiss AI	40±3	local (slow)	~6.9GB		66k	llama.cpp ›
680	DeepSeek-V2 Lite Chat (16B-A2.4B) · 4-bit DeepSeek	40±1	local (slow)	~12GB		32k	Ollama ›
681	Granite 3B Code Instruct (2K) · 4-bit IBM	40±1	local (slow)	~3.7GB			llama.cpp ›
682	Tulu 2 DPO 13B · 4-bit Allen Institute for AI	39±1	local (slow)	~9.8GB			llama.cpp ›
684	BioMistral-7B · 4-bit BioMistral	39±3	local (slow)	~6.1GB			llama.cpp ›
685	SOLAR 10.7B Instruct v1.0 · 4-bit Upstage	39±1	local (slow)	~8.3GB		4k	llama.cpp ›	+2
686	Gemma 2 2B IT · 4-bit Google	39±1	local (slow)	~3.4GB		8k	llama.cpp ›	+4
687	Code Tulu 2 7B · 16-bit Allen Institute for AI	39±2†	local (slow)	~16GB			how to run ›
688	Flan-T5 XXL · 4-bit Google	39±1	local (slow)	~49GB			how to run ›	+12
689	Yi-1.5 6B (base) · 4-bit 01.AI	39±3	local (slow)	~5.4GB		4k	llama.cpp ›
690	Dolphin 2.2.1 Mistral 7B · 4-bit Cognitive Computations	39±2	local (slow)	~5.9GB			llama.cpp ›
691	Gemma 1.1 7B IT · 4-bit Google	39±1	local (slow)	~7.1GB		8k	llama.cpp ›	+2
692	Granite 3.1 2B Instruct · 4-bit IBM	39±1	local (slow)	~3.1GB		128k	llama.cpp ›
694	Granite 20B Code Base (8K) · 4-bit IBM	39±1	local (slow)	~15GB			llama.cpp ›
695	Code Llama 7B Python · 4-bit Meta	39±1	local (slow)	~5.8GB		16k	llama.cpp ›
696	Granite 3.2 2B Instruct · 4-bit IBM	39±1	local (slow)	~3.1GB		131k	llama.cpp ›
697	Qwen1.5 7B Chat · 4-bit Alibaba	39±1	local (slow)	~9.7GB		32k	llama.cpp ›	+4
698	Zephyr 7B alpha · 4-bit Hugging Face	38±1	local (slow)	~6.1GB			llama.cpp ›
699	Code Llama 13B (base) · 4-bit Meta	38±1	local (slow)	~9.8GB		16k	llama.cpp ›	+1
700	Falcon3 3B Instruct · 4-bit TII	38±3	local (slow)	~3.6GB		32k	llama.cpp ›
701	Qwen2.5 Coder 0.5B Instruct · 4-bit Alibaba	38±1	local (slow)	~1.1GB		33k	Ollama ›
702	Vicuna 13B v1.5 · 4-bit LMSYS	38±1	local (slow)	~9.8GB		4k	llama.cpp ›
703	Yi 1.5 6B Chat · 4-bit 01.AI	38±2	local (slow)	~4.7GB		4k	llama.cpp ›
704	WizardLM 13B V1.2 · 4-bit Microsoft	38±1	local (slow)	~9.8GB			llama.cpp ›
705	Qwen2-VL 2B Instruct · 4-bit Alibaba	38±1	local (slow)	~2.6GB		33k	llama.cpp ›
706	Qwen2.5 1.5B Instruct · 4-bit Alibaba	38±1	local (slow)	~2GB	~98 tok/s	33k	llama.cpp ›	+6
707	Tulu 2 7B · 4-bit Allen Institute for AI	38±2	local (slow)	~5.8GB			llama.cpp ›
709	Mistral 7B Instruct v0.2 · 4-bit Mistral	38±1	local (slow)	~5.9GB		32k	llama.cpp ›	+9
710	Code Llama 7B Instruct · 4-bit Meta	38±1	local (slow)	~5.8GB		16k	llama.cpp ›
711	LFM2 700M · 4-bit Liquid AI	38±1	local (slow)	~1GB		33k	llama.cpp ›
712	Qwen3.5 0.8B · 4-bit Alibaba	38±1	local (slow)	~1.4GB	~319 tok/s	262k	llama.cpp ›	+2
714	EXAONE 3.5 2.4B Instruct · 4-bit LG AI Research	38±2	local (slow)	~3.2GB		33k	llama.cpp ›
715	xDAN-L1-Chat-RL-v1 · 4-bit xDAN-AI	37±1	local (slow)	~6.1GB			llama.cpp ›
717	Mistral 7B v0.1 (base) · 4-bit Mistral AI	37±1	local (slow)	~6.1GB		8k	llama.cpp ›	+4
718	Llama 3 8B (base) · 4-bit Meta	37±1	local (slow)	~6.6GB			llama.cpp ›
719	Flan-T5 XL · 4-bit Google	37±1	local (slow)	~14GB			how to run ›	+8
720	Gemma 7B (base) · 4-bit Google	37±1	local (slow)	~7.1GB		8k	llama.cpp ›	+3
721	Tulu 2 DPO 7B · 4-bit Allen Institute for AI	37±1	local (slow)	~5.8GB			llama.cpp ›
722	Vicuna 13B v1.3 · 4-bit LMSYS	37±2	local (slow)	~29GB		2k	how to run ›
723	Granite 3.1 3B-A800M Instruct · 4-bit IBM	37±2†	local (slow)	~3.6GB	~23 tok/s	131k	llama.cpp ›
724	Granite 3.0 3B-A800M Instruct · 4-bit IBM	37±1	local (slow)	~3.7GB		4k	llama.cpp ›
725	DeepSeek R1 Distill Qwen 1.5B · 4-bit DeepSeek	37±2	local (slow)	~2GB		131k	llama.cpp ›	+1
726	StarCoder2 7B · 4-bit BigCode	37±1	local (slow)	~5.4GB		16k	llama.cpp ›
728	DeepSeek LLM 7B Chat · 4-bit DeepSeek	37±2†	local (slow)	~5.7GB			Ollama ›
729	Falcon 40B (base) · 4-bit TII	36±1	local (slow)	~27GB		2k	Ollama ›	+2
730	StarCoder 15.5B · 4-bit BigCode	36±1	local (slow)	~11GB			Ollama ›
731	Nous-Hermes-13b · 4-bit Nous Research	36±2	local (slow)	~9.8GB		2k	llama.cpp ›
732	Eurus-2-7B-SFT · 4-bit PRIME-RL	36±3†	local (slow)	~6.4GB			llama.cpp ›
733	Qwen3 0.6B · 4-bit Alibaba	36±1	local (slow)	~2.1GB	~61 tok/s	33k	llama.cpp ›	+5
735	Code Llama 7B (base) · 4-bit Meta	36±1	local (slow)	~5.8GB		16k	llama.cpp ›	+2
736	Llama 2 13B (base) · 4-bit Meta	36±1	local (slow)	~9.3GB		4k	Ollama ›	+4
737	Llama 2 13B Chat · 4-bit Meta	36±1	local (slow)	~15GB		4k	llama.cpp ›	+10
738	Zephyr 7B beta · 4-bit Hugging Face	35±1	local (slow)	~6.1GB			llama.cpp ›	+3
739	Guanaco 33B · 16-bit University of Washington	35±1	local (slow)	~70GB			how to run ›
740	StarCoder2 3B · 4-bit BigCode	35±1	local (slow)	~3.4GB		16k	llama.cpp ›
741	Granite 3B Code Base (2K) · 4-bit IBM	35±1	local (slow)	~3.7GB			llama.cpp ›
742	StarCoderBase 15.5B · 4-bit BigCode	35±1	local (slow)	~12GB			llama.cpp ›
743	Vicuna 7B v1.5 · 4-bit LMSYS	35±1	local (slow)	~5.8GB		4k	llama.cpp ›	+1
744	ChatGLM3 6B 128K · 4-bit Zhipu AI (THUDM)	35±4	local (slow)	~5.8GB		131k	llama.cpp ›
746	OLMo 2 1B Instruct (0425) · 4-bit Allen Institute for AI	35±1	local (slow)	~2.4GB		4k	llama.cpp ›
747	Vicuna 7B v1.3 · 4-bit LMSYS	35±2	local (slow)	~5.8GB		2k	llama.cpp ›
748	Stable Code 3B · 4-bit Stability AI	35±1	local (slow)	~4.8GB		16k	llama.cpp ›
749	Orca 2 13B · 4-bit Microsoft	35±3	local (slow)	~9.8GB		4k	llama.cpp ›
751	DeepSeek-Coder 1.3B Base · 4-bit DeepSeek	34±1	local (slow)	~2.4GB		16k	Ollama ›
752	Qwen1.5 4B Chat · 4-bit Alibaba	34±2	local (slow)	~4.1GB		32k	llama.cpp ›
753	Mistral 7B Instruct v0.1 · 4-bit Mistral	34±1	local (slow)	~5.9GB		8k	llama.cpp ›	+3
754	Gemma 7B IT · 4-bit Google	34±1	local (slow)	~7.1GB		8k	llama.cpp ›	+5
757	CodeGemma 2B (v1.0) · 4-bit Google	34±1	local (slow)	~3.2GB			llama.cpp ›
758	Qwen2 1.5B Instruct · 4-bit Alibaba	34±1	local (slow)	~1.9GB		32k	llama.cpp ›	+1
759	Falcon-H1 1.5B Instruct · 4-bit TII	33±4	local (slow)	~2.4GB		131k	llama.cpp ›
760	Ghost 7B Alpha · 4-bit Ghost X	33±2	local (slow)	~6.1GB			llama.cpp ›
761	Gemma 3 1B · 4-bit Google	33±1	local (slow)	~1.8GB	~180 tok/s	32k	llama.cpp ›	+7
762	SmolLM2 1.7B Instruct · 4-bit Hugging Face	33±1	local (slow)	~3.1GB		8k	llama.cpp ›
763	LFM2 350M · 4-bit Liquid AI	33±1	local (slow)	~1.7GB		33k	llama.cpp ›
764	Qwen-7B (base) · 4-bit Alibaba	33±1	local (slow)	~6.6GB		33k	llama.cpp ›
767	StarCoderBase 7B · 4-bit BigCode	33±1	local (slow)	~6GB			Ollama ›
769	Llama 3.2 1B Instruct · 4-bit Meta	33±1	local (slow)	~1.7GB	~251 tok/s	131k	llama.cpp ›	+13
770	Phi-1.5 (1.3B) · 4-bit Microsoft	33±1	local (slow)	~2.4GB		2k	llama.cpp ›
772	Qwen-7B-Chat · 4-bit Alibaba	32±1	local (slow)	~6.6GB		33k	llama.cpp ›
773	Llama 2 7B Chat · 4-bit Meta	32±1	local (slow)	~8.8GB		4k	llama.cpp ›	+13
775	OLMo 7B Instruct · 16-bit Ai2	32±2	local (slow)	~16GB			how to run ›
776	Llama 2 7B (base) · 4-bit Meta	32±1	local (slow)	~8.5GB		4k	Ollama ›	+6
778	Flan-T5 Large · 4-bit Google	32±1	local (slow)	~4.8GB			how to run ›	+5
779	Granite 3.1 1B-A400M Instruct · 4-bit IBM	31±2†	local (slow)	~2.3GB	~20 tok/s	131k	llama.cpp ›
780	Falcon 40B Instruct · 4-bit TII	31±2	local (slow)	~27GB			Ollama ›
781	Gemma 2B (base) · 4-bit Google	31±1	local (slow)	~3.2GB		8k	llama.cpp ›	+3
782	Gemma 1.1 2B IT · 4-bit Google	31±1	local (slow)	~3.2GB		8k	llama.cpp ›	+1
783	Falcon 7B (base) · 4-bit TII	31±1	local (slow)	~5.9GB		2k	Ollama ›	+4
785	Baichuan2-7B-Base · 16-bit Baichuan	30±1	local (slow)	~17GB			how to run ›
787	NexusRaven V2 13B · 4-bit Nexusflow	30±3	local (slow)	~9.3GB		16k	Ollama ›
789	ChatGLM3-6B · 4-bit Zhipu AI (THUDM)	30±2	local (slow)	~5.8GB			llama.cpp ›
790	Qwen2.5 0.5B Instruct · 4-bit Alibaba	30±2	local (slow)	~1.2GB		33k	llama.cpp ›	+1
791	OLMo 7B · 4-bit Allen Institute for AI	30±1†	local (slow)	~30GB		2k	how to run ›
792	OpenLLaMA 7B v2 · 8-bit OpenLM Research	30±1	local (slow)	~9.1GB			llama.cpp ›
793	StableLM-3B-4E1T · 4-bit Stability AI	30±1	local (slow)	~3.3GB		4k	llama.cpp ›
794	StarCoderBase 3B · 4-bit BigCode	30±1	local (slow)	~3.4GB			Ollama ›
796	StableLM-Base-Alpha 7B v2 · 4-bit Stability AI	30±1	local (slow)	~30GB		4k	how to run ›
797	Granite 3.0 1B-A400M Instruct · 4-bit IBM	30±1	local (slow)	~2.3GB		4k	llama.cpp ›
798	OPT-66B · 4-bit Meta	29±1	local (slow)	~141GB		2k	how to run ›	+2
799	GPT4All-13B-Snoozy · 4-bit Nomic AI	29±2	local (slow)	~56GB			how to run ›
801	EuroLLM 1.7B Instruct · 4-bit UTTER (EuroLLM)	29±3	local (slow)	~2.6GB		4k	llama.cpp ›
802	Granite 4.0 H 350M · 4-bit IBM	29±1†	local (slow)	~1.7GB		33k	llama.cpp ›
804	Gemma 2B IT · 4-bit Google	29±1	local (slow)	~3.1GB		8k	llama.cpp ›	+3
806	Granite 4.0 350M · 4-bit IBM	28±1	local (slow)	~1.7GB		32k	llama.cpp ›
807	OPT-30B · 4-bit Meta	28±1	local (slow)	~64GB		2k	how to run ›	+5
809	GPT-NeoX-20B · 4-bit EleutherAI	28±1	local (slow)	~15GB		2k	llama.cpp ›	+1
810	Qwen2 0.5B Instruct · 4-bit Alibaba	28±2	local (slow)	~1.1GB		32k	llama.cpp ›
811	RedPajama-INCITE 7B Base · 4-bit Together	28±1	local (slow)	~16GB		2k	how to run ›
816	Falcon3 1B Instruct · 4-bit TII	26±4	local (slow)	~2.7GB		8k	llama.cpp ›
817	Qwen1.5 1.8B Chat · 4-bit Alibaba	26±2	local (slow)	~2.7GB		33k	Ollama ›
819	OPT-13B (13 billion parameters) · 4-bit Meta	26±1	local (slow)	~29GB		2k	how to run ›	+4
820	Falcon 7B Instruct · 4-bit TII	26±2	local (slow)	~5.9GB			Ollama ›	+1
822	OpenAssistant SFT-4 Pythia 12B · 4-bit LAION (OpenAssistant)	25±1	local (slow)	~9.5GB			llama.cpp ›	+1
823	Flan-T5 Base · 4-bit Google	25±1	local (slow)	~2.5GB			how to run ›	+3
824	RedPajama-INCITE Base 3B v1 · 4-bit Together	25±3	local (slow)	~3.4GB		2k	llama.cpp ›
826	Pythia 12B · 4-bit EleutherAI	25±1	local (slow)	~9.5GB		2k	llama.cpp ›	+1
827	OpenLLaMA 3B v2 · 4-bit OpenLM Research	25±1	local (slow)	~4.2GB			llama.cpp ›
828	GPT-J 6B · 4-bit EleutherAI	25±1	local (slow)	~14GB		2k	how to run ›	+6
830	StableLM-Base-Alpha 3B v2 · 4-bit Stability AI	24±1	local (slow)	~13GB		4k	how to run ›
831	OPT-6.7B · 4-bit Meta	24±1	local (slow)	~16GB		2k	how to run ›	+5
834	Qwen1.5 0.5B Chat · 4-bit Alibaba	23±3	local (slow)	~1.8GB		33k	Ollama ›
835	Pythia 6.9B · 4-bit EleutherAI	23±1	local (slow)	~6.1GB		2k	llama.cpp ›	+2
837	Phi-1 (1.3B) · 4-bit Microsoft	22±4	local (slow)	~2.4GB		2k	llama.cpp ›
839	SmolLM2 360M Instruct · 8-bit Hugging Face	22±3	local (slow)	~1.2GB		8k	llama.cpp ›
841	OLMo 1B · 4-bit Allen Institute for AI	21±2†	local (slow)	~2.2GB		2k	llama.cpp ›
842	BLOOM 7.1B · 4-bit BigScience	21±1	local (slow)	~7.1GB		2k	llama.cpp ›	+7
843	Pythia 2.8B · 4-bit EleutherAI	20±1	local (slow)	~3.4GB		2k	llama.cpp ›
844	Pythia 2.8B (deduped) · 4-bit EleutherAI	20±1	local (slow)	~3.4GB		2k	llama.cpp ›
845	Falcon-RW 1B · 16-bit TII	20±2	local (slow)	~4.3GB		2k	how to run ›
846	OPT-2.7B · 4-bit Meta	19±1	local (slow)	~7.1GB		2k	how to run ›	+3
847	StableLM-Tuned-Alpha 7B · 4-bit Stability AI	18±2	local (slow)	~6.9GB			llama.cpp ›
848	GPT-Neo 2.7B · 4-bit EleutherAI	18±1	local (slow)	~13GB		2k	how to run ›	+8
850	T5 Large · 4-bit Google	17±2	local (slow)	~4.6GB		1k	how to run ›
851	Gemma 3 270M IT · 8-bit Google	17±4	local (slow)	~1.2GB		32k	llama.cpp ›
852	Flan-T5 Small · 4-bit Google	16±3	local (slow)	~1.8GB			how to run ›
853	BLOOM 3B · 4-bit BigScience	16±1	local (slow)	~4GB		2k	llama.cpp ›	+2
856	OPT-1.3B · 4-bit Meta	14±1	local (slow)	~4.3GB		2k	how to run ›	+5
857	T5 Base · 4-bit Google	14±3	local (slow)	~2.4GB		1k	how to run ›
858	Pythia 1.4B · 4-bit EleutherAI	14±1	local (slow)	~2.4GB		2k	llama.cpp ›
859	Pythia 1B · 4-bit EleutherAI	12±1	local (slow)	~2.2GB		2k	llama.cpp ›
862	GPT-Neo 1.3B · 4-bit EleutherAI	12±2	local (slow)	~7.1GB		2k	how to run ›	+3
863	T5 Small · 4-bit Google	12±3	local (slow)	~1.8GB		1k	how to run ›
864	BLOOM 1.7B · 4-bit BigScience	11±1	local (slow)	~3.1GB		2k	llama.cpp ›	+1
865	Zyte-1B · 4-bit venkycs (aihub-app)	11±2	local (slow)	~2.2GB			llama.cpp ›
867	StableLM-Base-Alpha 7B · 4-bit Stability AI	8±1	local (slow)	~35GB		4k	how to run ›
868	Pythia 410M · 4-bit EleutherAI	8±2	local (slow)	~1.8GB		2k	llama.cpp ›
870	BLOOM 1.1B · 4-bit BigScience	7±1	local (slow)	~2.6GB		2k	llama.cpp ›
871	GPT-2 XL (1.5B) · 4-bit OpenAI	7±1	local (slow)	~2.8GB	~75 tok/s	1k	llama.cpp ›	+9
874	OPT-350M · 4-bit Meta	1±1	local (slow)	~2.2GB		2k	how to run ›	+1
876	StableLM-Base-Alpha 3B · 4-bit Stability AI	1±2	local (slow)	~17GB		4k	how to run ›
877	BLOOM 560M · 4-bit BigScience	0±1	local (slow)	~2.1GB		2k	llama.cpp ›	+1
878	Pythia 160M · 4-bit EleutherAI	-2±2	local (slow)	~1.6GB		2k	llama.cpp ›
879	GPT-2 Large (774M) · 4-bit OpenAI	-3±1	local (slow)	~2GB	~137 tok/s	1k	llama.cpp ›	+3
880	OPT-125M · 4-bit Meta	-3±1	local (slow)	~1.8GB		2k	how to run ›	+1
881	GPT-Neo 125M · 4-bit EleutherAI	-3±2	local (slow)	~2.1GB		2k	how to run ›
882	GPT-2 Medium (355M) · 4-bit OpenAI	-5±1	local (slow)	~1.8GB		1k	llama.cpp ›	+3
883	Pythia 70M · 4-bit EleutherAI	-13±2	local (slow)	~1.6GB		2k	llama.cpp ›
884	GPT-2 Small (124M) · 4-bit OpenAI	-13±2	local (slow)	~1.6GB		1k	llama.cpp ›	+3
—	K2 Horizon 7B · gguf-q4_k_m Institute of Foundation Models (MBZUAI)	not scored yet	local (slow)	~8GB		524k	llama.cpp ›
—	LFM2.5 24B-A2B · Q4_K_M Liquid AI	not yet calibrated	local (slow)	~17GB		131k	llama.cpp ›
—	LFM3 1.7B · q4_k_m Liquid AI	not yet calibrated	local (slow)	~2.6GB		262k	llama.cpp ›

+ 341 more don't fit your machine or budget · show them

+ 213 models with fewer than 3 results left off, since one or two tests say little about overall ability · show them

919 of 1227 catalogue models listed here · sources and licences

* new or thinly tested: ranked on too few benchmark results · † only the maker’s own numbers so far · ~RAM is estimated; full context may need more memory