whatmodel.sh · find the best AI models you can run

Best AI models to run locally on a 8GB PC without a graphics card

A leaderboard of the best AI models you can run locally on a computer with 8GB of RAM and no graphics card. MiniCPM5 2B is #1 right now, followed by Spark-X2.5 1.7B and EXAONE Deep 2.4B. Models are ranked by one score that combines 472 published benchmarks. Each model shows the download that fits and the command to run it.

78 models · scores combine 472 benchmarks · updated how it works · find a leaderboard · benchmark your machine
task[all tasks][agent tasks][coding][chat & writing][math][vision & documents][web search]
Models for 8GB RAM · no GPU → ~3GB for models (CPU, slow) · local only · reset
+ more

Detect your exact chip or graphics card:

curl -G whatmodel.sh/ -d max=0 --data-urlencode "mac=$(sysctl -n hw.memsize machdep.cpu.brand_string)"Mac

curl -G whatmodel.sh/ -d max=0 --data-urlencode "ram=$(awk '/MemT/{print $2}' /proc/meminfo)" --data-urlencode "nv=$(nvidia-smi --query-gpu=name,memory.total --format=csv,noheader 2>/dev/null)"Linux

curl.exe -G whatmodel.sh/ -d max=0 --data-urlencode "ram=$((gcim Win32_ComputerSystem).TotalPhysicalMemory)" --data-urlencode "nv=$(nvidia-smi --query-gpu=name,memory.total --format=csv,noheader 2>$null)"Windows

$ terminal

detecting your OS…

Run curl "whatmodel.sh/?ram=8&gpu=none&max=0"to get this list in your terminal (add &format=json for agents).

ram[8][16][24][32][48][64][96][128][192][256]GB
gpu[apple silicon][graphics card][none]
price[local][$0.02][$0.1][$0.5][$2][$10][$50][any]max per M

detecting your OS…

Score vs memory to run

#modelscore↓where↓speed↓RAM↓context↓get itsources
#modelscore↓where↓speed↓RAM↓context↓get itsources
186MiniCPM5 2B · 4-bit OpenBMB64±1†local (slow)~3.1GB131kllama.cpp › openbmb/MiniCPM5-2B model card
320Spark-X2.5 1.7B · 4-bit iFLYTEK (SparkLLM)55±1†local (slow)~2.7GB1Mllama.cpp › XHToken/Spark-X2.5-4B model card
409EXAONE Deep 2.4B · 4-bit LG AI Research50±2†local (slow)~3.2GB33kOllama › LG AI Research vendor-reported benchmark scores for its own EXAONE models (Hugging Face model cards)
433LFM2.5 1.2B Thinking · 4-bit Liquid AI49±2local (slow)~2.2GB33kllama.cpp › LiquidAI/LFM2.5-1.2B-Thinking model cardEuroEval leaderboards (results collection), English generative leaderboard
434Qwen3-VL 2B Thinking · 4-bit Alibaba49±1local (slow)~2.7GB256kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)
469Qwen3.5 2B · 4-bit Alibaba47±1local (slow)~2.9GB262kllama.cpp › Qwen/Qwen3.5-2B model cardopenbmb/MiniCPM5-2B model cardXHToken/Spark-X2.5-4B model cardCohereLabs/North-Micro-Vision-Instruct model card (benchmark table)EuroEval leaderboards (results collection), English generative leaderboardMathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets+7
478EXAONE 4.0 1.2B · 4-bit LG AI Research47±2†local (slow)~2.8GB66kllama.cpp › LG AI Research vendor-reported benchmark scores for its own EXAONE models (Hugging Face model cards)
504T5 Base · 4-bit Google46±9local (slow)~2.4GB1khow to run › COPEN — EMNLP 2022 original zero-shot evaluations
507Qwen2.5-Math 1.5B Instruct · 4-bit Alibaba46±2†local (slow)~2.5GB4kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
534Qwen2-Math 1.5B Instruct · 4-bit Alibaba45±2†local (slow)~2.5GB4kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
553Qwen3-VL 2B Instruct · 4-bit Alibaba44±1local (slow)~2.7GB256kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)CohereLabs/North-Micro-Vision-Instruct model card (benchmark table)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
558Qwen3 1.7B · 4-bit Alibaba44±1local (slow)~2.9GB33kllama.cpp › Marco-MoE: Open Multilingual Mixture-of-Expert Language Models with Efficient UpcyclingQwen/Qwen3.5-2B model cardQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)LiquidAI/LFM2-1.2B model cardHuggingFaceTB/SmolLM3-3B model card (Evaluation section)LiquidAI/LFM2.5-1.2B-Thinking model card+10
564LFM2.5 1.2B Instruct · 4-bit Liquid AI44±2local (slow)~2.3GB33kllama.cpp › LiquidAI/LFM2.5-1.2B-Thinking model cardEuroEval leaderboards (results collection), English generative leaderboard
573T5 Small · 4-bit Google43±9local (slow)~1.8GB1khow to run › COPEN — EMNLP 2022 original zero-shot evaluations
575Qwen2.5 Coder 1.5B Instruct · 4-bit Alibaba43±1local (slow)~2.5GB33kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Aider code editing benchmark runs (old edit leaderboard)
576LFM2 2.6B · 4-bit Liquid AI43±2local (slow)~3.1GB33kllama.cpp › LFM2 Technical Report — Liquid AI own SmolLM3 evaluationEuroEval leaderboards (results collection), English generative leaderboard
581DeepSeek-Coder 1.3B Instruct · 4-bit DeepSeek43±1local (slow)~2.4GB16kOllama › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsBigCodeBench paper (Zhuo et al., ICLR 2025), arXiv 2406.15877v4LiveCodeBench official website results (2024-12-26)CRUXEval published evaluation results (authors' generations and scores)CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
615Granite 4.0 1B · 4-bit IBM41±1local (slow)~2.6GB128kllama.cpp › ibm-granite/granite-4.0-h-1b model cardLiquidAI/LFM2.5-1.2B-Thinking model cardEpoch AI — internal evaluations
619Granite 4.0 H 1B · 4-bit IBM40±1local (slow)~2.4GB131kllama.cpp › ibm-granite/granite-4.0-h-1b model cardLiquidAI/LFM2.5-1.2B-Thinking model card
627LFM2 1.2B · 4-bit Liquid AI40±2local (slow)~2.3GB33kllama.cpp › LiquidAI/LFM2-1.2B model cardEuroEval leaderboards (results collection), English generative leaderboardOpen Portuguese LLM Leaderboard (archived)
630Bielik 1.5B v3.0 Instruct · 4-bit SpeakLeash40±3local (slow)~2.6GBllama.cpp › SpeakLeash CPTUB (Complex Polish Text Understanding Benchmark)EuroEval leaderboards (results collection), English generative leaderboard
632Granite 3.3 2B Instruct · 4-bit IBM39±1†local (slow)~3.1GB128kllama.cpp › ibm-granite/granite-3.3-8b-instruct model card
642Phi-2 (2.7B) · 4-bit Microsoft39±1local (slow)~3.2GB2kOllama › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsMiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies (Hu et al.)AlpacaEval 1.0 and 2.0 leaderboards (tatsu-lab/alpaca_eval repository)CRUXEval published evaluation results (authors' generations and scores)Open Portuguese LLM Leaderboard (archived)+2
643Granite 3.0 2B Instruct · 4-bit IBM39±1local (slow)~3.2GB4kllama.cpp › IBM Granite 3.0 Language Models technical report (GitHub)LMArena leaderboard datasetCodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)EuroEval leaderboards (results collection), English generative leaderboardVectara hallucination leaderboard (vectara/hallucination-leaderboard repository)
660Qwen3.5 0.8B · 4-bit Alibaba38±1local (slow)~2GB262kllama.cpp › Qwen/Qwen3.5-2B model cardEuroEval leaderboards (results collection), English generative leaderboardQwen/Qwen3.5-0.8B model cardChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)Knowledge Index of Noah's Ark (arXiv:2606.05104v2)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)+2
667DeepSeek R1 Distill Qwen 1.5B · 4-bit DeepSeek37±2local (slow)~2.7GB131kllama.cpp › deepseek-ai/DeepSeek-R1 model cardCodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)BRIDGE Medical Leaderboard (Harvard Medical School / Brigham and Women's YLab)Epoch AI — internal evaluationsTHINK-Bench: Evaluating Thinking Efficiency and Chain-of-Thought Quality of Large Reasoning Models (arXiv:2505.22113v1)EuroEval leaderboards (results collection), English generative leaderboard+1
669Qwen2.5 Coder 0.5B Instruct · 4-bit Alibaba37±1local (slow)~1.9GB33kOllama › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Aider code editing benchmark runs (old edit leaderboard)
680Granite 3.1 2B Instruct · 4-bit IBM36±1local (slow)~3.1GB128kllama.cpp › ibm-granite/granite-3.3-8b-instruct model cardibm-granite/granite-3.1-3b-a800m-instruct model cardLMArena leaderboard datasetSpeakLeash CPTUB (Complex Polish Text Understanding Benchmark)Vectara hallucination leaderboard (vectara/hallucination-leaderboard repository)
681EXAONE 3.5 2.4B Instruct · 4-bit LG AI Research36±2local (slow)~3.2GB33kllama.cpp › LG AI Research vendor-reported benchmark scores for its own EXAONE models (Hugging Face model cards)SpeakLeash CPTUB (Complex Polish Text Understanding Benchmark)CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)
684LFM2 700M · 4-bit Liquid AI36±2local (slow)~2GB33kllama.cpp › LiquidAI/LFM2-1.2B model cardEuroEval leaderboards (results collection), English generative leaderboardOpen Portuguese LLM Leaderboard (archived)
685Granite 3.2 2B Instruct · 4-bit IBM36±1local (slow)~3.1GB131kllama.cpp › ibm-granite/granite-3.3-8b-instruct model cardVectara hallucination leaderboard (vectara/hallucination-leaderboard repository)
692Qwen2.5 1.5B Instruct · 4-bit Alibaba36±1local (slow)~2.7GB33kllama.cpp › 2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsSmolLM2 paper (Hugging Face) — authors' own instruct-model evaluationsSpeakLeash CPTUB (Complex Polish Text Understanding Benchmark)SpeakLeash Polish EQ-Bench leaderboardOpen Persian LLM Leaderboard v2 (Part DP AI and AUT NLP Lab)CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)+6
709Qwen3 0.6B · 4-bit Alibaba33±1local (slow)~2GB33kllama.cpp › Olmo 3LiquidAI/LFM2-1.2B model cardBerkeley Function Calling Leaderboard result archiveOpen Persian LLM Leaderboard v2 (Part DP AI and AUT NLP Lab)BRIDGE Medical Leaderboard (Harvard Medical School / Brigham and Women's YLab)EuroEval leaderboards (results collection), English generative leaderboard+4
719OLMo 2 1B Instruct (0425) · 4-bit Allen Institute for AI33±2local (slow)~2.4GB4kllama.cpp › 2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsOpen Portuguese LLM Leaderboard (archived)
720DeepSeek-Coder 1.3B Base · 4-bit DeepSeek32±1local (slow)~2.4GB16kOllama › EvalPlus / EvalPerf published evaluation runsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsStarCoder 2 and The Stack v2: The Next Generation — authors' own runsBigCodeBench paper (Zhuo et al., ICLR 2025), arXiv 2406.15877v4CRUXEval published evaluation results (authors' generations and scores)
726CodeGemma 2B (v1.0) · 4-bit Google32±1local (slow)~3.2GBllama.cpp › EvalPlus / EvalPerf published evaluation runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsCodeGemma: Open Code Models Based on Gemma — authors' own runsBigCodeBench paper (Zhuo et al., ICLR 2025), arXiv 2406.15877v4
728Phi-1.5 (1.3B) · 4-bit Microsoft32±1local (slow)~2.4GB2kllama.cpp › Stability AI — original StableLM zero-shot evaluation outputsTextbooks Are All You Need II: phi-1.5 technical report — authors' own runsOpen Medical-LLM Leaderboard results (HF dataset openlifescienceai/results)Open Portuguese LLM Leaderboard (archived)
729Falcon-H1 1.5B Instruct · 4-bit TII31±4local (slow)~2.4GB131kllama.cpp › Inception Arabic/Hindi leaderboards (AraGen-v3, HindiGen-v1, Arabic IFEval)Open Portuguese LLM Leaderboard (archived)
731Qwen2 1.5B Instruct · 4-bit Alibaba31±1local (slow)~2.6GB32kllama.cpp › WildEval ZeroEval published resultsQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Qwen2-0.5B-Instruct model cardLiveBench model judgments (HF livebench/model_judgment, 2024-10-22 revision) with the LiveBench question datasetsSpeakLeash Polish EQ-Bench leaderboardOpen Persian LLM Leaderboard v2 (Part DP AI and AUT NLP Lab)+1
733Gemma 3 1B · 4-bit Google31±1local (slow)~2.3GB32kllama.cpp › Google DeepMind Gemma 3 270M IT model card2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsLiquidAI/LFM2-1.2B model cardLiquidAI/LFM2.5-1.2B-Thinking model cardMIMIC Clinical Decision Making leaderboardGemma Team — Gemma 3 Technical Report+7
737LFM2 350M · 4-bit Liquid AI30±2local (slow)~1.7GB33kllama.cpp › LiquidAI/LFM2-1.2B model cardEuroEval leaderboards (results collection), English generative leaderboardOpen Portuguese LLM Leaderboard (archived)
738SmolLM2 1.7B Instruct · 4-bit Hugging Face30±1local (slow)~2.7GB8kllama.cpp › 2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsSmolLM2 paper (Hugging Face) — authors' own instruct-model evaluationsLMArena leaderboard datasetSpeakLeash CPTUB (Complex Polish Text Understanding Benchmark)EuroEval leaderboards (results collection), English generative leaderboard
739Llama 3.2 1B Instruct · 4-bit Meta30±1local (slow)~2.3GB131kllama.cpp › IBM Granite 3.0 Language Models technical report (GitHub)2 OLMo 2 Furious (Team OLMo, Ai2) — authors' own evaluations of OLMo 2 Instruct and peer instruct modelsLiquidAI/LFM2-1.2B model cardSmolLM2 paper (Hugging Face) — authors' own instruct-model evaluationsLiquidAI/LFM2.5-1.2B-Thinking model cardLMArena leaderboard dataset+13
747Gemma 2B (base) · 4-bit Google29±1local (slow)~3.2GB8kllama.cpp › EvalPlus / EvalPerf published evaluation runsGemma report — original evaluationsTop Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM — authors' own runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsCodeGemma: Open Code Models Based on Gemma — authors' own runsHallucinations Leaderboard results (HF dataset hallucinations-leaderboard/results)+3
749Gemma 1.1 2B IT · 4-bit Google29±1local (slow)~3.2GB8kllama.cpp › EvalPlus / EvalPerf published evaluation runsPolyrating: A Cost-Effective and Bias-Aware Rating System for LLM Evaluation (arXiv:2409.00696v3)LMArena leaderboard datasetSpeakLeash Polish EQ-Bench leaderboardArena-Hard-Auto v0.1 leaderboard (repository README, pre-v2)Open Portuguese LLM Leaderboard (archived)+1
751Granite 3.1 1B-A400M Instruct · 4-bit IBM29±2†local (slow)~2.3GB131kllama.cpp › ibm-granite/granite-3.1-3b-a800m-instruct model card
760Granite 3.0 1B-A400M Instruct · 4-bit IBM27±1local (slow)~2.3GB4kllama.cpp › IBM Granite 3.0 Language Models technical report (GitHub)EuroEval leaderboards (results collection), English generative leaderboard
763Granite 4.0 H 350M · 4-bit IBM27±1†local (slow)~1.7GB33kllama.cpp › ibm-granite/granite-4.0-h-1b model card
766Gemma 2B IT · 4-bit Google27±1local (slow)~3.1GB8kllama.cpp › EvalPlus / EvalPerf published evaluation runsGranite Code Models: A Family of Open Foundation Models for Code Intelligence — authors' own runsWildBench v2 leaderboard data (Ai2)Polyrating: A Cost-Effective and Bias-Aware Rating System for LLM Evaluation (arXiv:2409.00696v3)LMArena leaderboard datasetAlpacaEval 1.0 and 2.0 leaderboards (tatsu-lab/alpaca_eval repository)+3
767EuroLLM 1.7B Instruct · 4-bit UTTER (EuroLLM)27±3local (slow)~2.6GB4kllama.cpp › SpeakLeash CPTUB (Complex Polish Text Understanding Benchmark)Open Portuguese LLM Leaderboard (archived)EuroEval leaderboards (results collection), English generative leaderboard
768Qwen2.5 0.5B Instruct · 4-bit Alibaba27±2local (slow)~2GB33kllama.cpp › HuggingFaceTB/SmolLM2-360M-Instruct model cardSpeakLeash CPTUB (Complex Polish Text Understanding Benchmark)Open Persian LLM Leaderboard v2 (Part DP AI and AUT NLP Lab)Inception Arabic/Hindi leaderboards (AraGen-v3, HindiGen-v1, Arabic IFEval)Berkeley Function Calling Leaderboard result archiveVectara hallucination leaderboard (vectara/hallucination-leaderboard repository)+1
772Granite 4.0 350M · 4-bit IBM26±1local (slow)~1.7GB32kllama.cpp › ibm-granite/granite-4.0-h-1b model cardBerkeley Function Calling Leaderboard result archiveEpoch AI — internal evaluations
776Qwen2 0.5B Instruct · 4-bit Alibaba25±2local (slow)~1.9GB32kllama.cpp › Qwen2-0.5B-Instruct model cardLiveBench model judgments (HF livebench/model_judgment, 2024-10-22 revision) with the LiveBench question datasetsOpen Persian LLM Leaderboard v2 (Part DP AI and AUT NLP Lab)Open Portuguese LLM Leaderboard (archived)
784Falcon3 1B Instruct · 4-bit TII24±4local (slow)~2.7GB8kllama.cpp › Berkeley Function Calling Leaderboard result archiveCodeReviewQA: The Code Review Comprehension Assessment for Large Language Models (arXiv:2503.16167v2)Open Portuguese LLM Leaderboard (archived)
786Qwen1.5 1.8B Chat · 4-bit Alibaba24±2local (slow)~2.7GB33kOllama › LiveBench model judgments (HF livebench/model_judgment, 2024-10-22 revision) with the LiveBench question datasetsAlpacaEval 1.0 and 2.0 leaderboards (tatsu-lab/alpaca_eval repository)EuroEval leaderboards (results collection), English generative leaderboardOpen Portuguese LLM Leaderboard (archived)
791OLMo 1B · 4-bit Allen Institute for AI21±2†local (slow)~2.2GB2kllama.cpp › OLMo: Accelerating the Science of Language Models — authors' own runs
792Phi-1 (1.3B) · 4-bit Microsoft21±4local (slow)~2.4GB2kllama.cpp › CRUXEval published evaluation results (authors' generations and scores)Open Portuguese LLM Leaderboard (archived)
793Qwen1.5 0.5B Chat · 4-bit Alibaba21±3local (slow)~1.9GB33kOllama › LiveBench model judgments (HF livebench/model_judgment, 2024-10-22 revision) with the LiveBench question datasetsEuroEval leaderboards (results collection), English generative leaderboardOpen Portuguese LLM Leaderboard (archived)
796Flan-T5 Base · 4-bit Google20±3†local (slow)~2.5GBhow to run › Scaling Instruction-Finetuned Language Models — authors' own runs
799SmolLM2 360M Instruct · 8-bit Hugging Face19±3local (slow)~1.9GB8kllama.cpp › HuggingFaceTB/SmolLM2-360M-Instruct model cardEuroEval leaderboards (results collection), English generative leaderboard
802Pythia 1.4B · 4-bit EleutherAI18±2local (slow)~2.4GB2kllama.cpp › Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling — authors' own runsOpen Medical-LLM Leaderboard results (HF dataset openlifescienceai/results)
807Gemma 3 270M IT · 8-bit Google15±4local (slow)~1.8GB32kllama.cpp › Google DeepMind Gemma 3 270M IT model cardEuroEval leaderboards (results collection), English generative leaderboardOpen Portuguese LLM Leaderboard (archived)
808Pythia 1B · 4-bit EleutherAI14±1local (slow)~2.2GB2kllama.cpp › Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling — authors' own runsOLMo: Accelerating the Science of Language Models — authors' own runsOpen Medical-LLM Leaderboard results (HF dataset openlifescienceai/results)Open Portuguese LLM Leaderboard (archived)
810BLOOM 1.7B · 4-bit BigScience14±1local (slow)~3.1GB2kllama.cpp › Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling — authors' own runsBLOOM: A 176B-Parameter Open-Access Multilingual Language Model — authors' own runsHallucinations Leaderboard results (HF dataset hallucinations-leaderboard/results)Open Portuguese LLM Leaderboard (archived)
811Flan-T5 Small · 4-bit Google14±3†local (slow)~1.8GBhow to run › Scaling Instruction-Finetuned Language Models — authors' own runs
813GPT-2 XL (1.5B) · 4-bit OpenAI11±1local (slow)~2.8GB1kllama.cpp › Surface Form Competition (Holtzman et al., EMNLP 2021) — authors' own GPT-2 runsTextbooks Are All You Need II: phi-1.5 technical report — authors' own runsEleutherAI GPT-J-6B model card — EleutherAI lm-evaluation-harness runsPROST (Aroca-Ouellette et al., Findings of ACL-IJCNLP 2021) - authors' own zero-shot runsEleutherAI GPT-Neo 2.7B model card — EleutherAI evaluation-harness runsOpen Medical-LLM Leaderboard results (HF dataset openlifescienceai/results)+2
814BLOOM 1.1B · 4-bit BigScience11±1local (slow)~2.6GB2kllama.cpp › Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling — authors' own runsBLOOM: A 176B-Parameter Open-Access Multilingual Language Model — authors' own runsHallucinations Leaderboard results (HF dataset hallucinations-leaderboard/results)
815Pythia 410M · 4-bit EleutherAI10±2local (slow)~1.8GB2kllama.cpp › Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling — authors' own runsOpen Portuguese LLM Leaderboard (archived)
818Zyte-1B · 4-bit venkycs (aihub-app)8±2local (slow)~2.2GBllama.cpp › EvalPlus / EvalPerf published evaluation runs
819GPT-Neo 125M · 4-bit EleutherAI5±5local (slow)~2.1GB2khow to run › Hallucinations Leaderboard results (HF dataset hallucinations-leaderboard/results)COPEN — EMNLP 2022 original zero-shot evaluationsOpen Portuguese LLM Leaderboard (archived)
820BLOOM 560M · 4-bit BigScience5±2local (slow)~2.1GB2kllama.cpp › Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling — authors' own runsBLOOM: A 176B-Parameter Open-Access Multilingual Language Model — authors' own runsHallucinations Leaderboard results (HF dataset hallucinations-leaderboard/results)Open Portuguese LLM Leaderboard (archived)
821OPT-350M · 4-bit Meta5±2local (slow)~2.2GB2khow to run › Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling — authors' own runsOpen Portuguese LLM Leaderboard (archived)
823Pythia 160M · 4-bit EleutherAI3±2local (slow)~1.6GB2kllama.cpp › Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling — authors' own runsOpen Portuguese LLM Leaderboard (archived)
824OPT-125M · 4-bit Meta3±2local (slow)~1.8GB2khow to run › Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling — authors' own runsOpen Portuguese LLM Leaderboard (archived)
825GPT-2 Large (774M) · 4-bit OpenAI1±2local (slow)~2GB1kllama.cpp › Surface Form Competition (Holtzman et al., EMNLP 2021) — authors' own GPT-2 runsPROST (Aroca-Ouellette et al., Findings of ACL-IJCNLP 2021) - authors' own zero-shot runsCOPEN — EMNLP 2022 original zero-shot evaluationsEuroEval leaderboards (results collection), English generative leaderboardOpen Portuguese LLM Leaderboard (archived)
826GPT-2 Medium (355M) · 4-bit OpenAI-1±2local (slow)~1.8GB1kllama.cpp › Surface Form Competition (Holtzman et al., EMNLP 2021) — authors' own GPT-2 runsPROST (Aroca-Ouellette et al., Findings of ACL-IJCNLP 2021) - authors' own zero-shot runsCOPEN — EMNLP 2022 original zero-shot evaluationsEuroEval leaderboards (results collection), English generative leaderboardOpen Portuguese LLM Leaderboard (archived)
827Pythia 70M · 4-bit EleutherAI-7±2local (slow)~1.6GB2kllama.cpp › Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling — authors' own runsOpen Portuguese LLM Leaderboard (archived)
828GPT-2 Small (124M) · 4-bit OpenAI-9±3local (slow)~1.6GB1kllama.cpp › Surface Form Competition (Holtzman et al., EMNLP 2021) — authors' own GPT-2 runsPROST (Aroca-Ouellette et al., Findings of ACL-IJCNLP 2021) - authors' own zero-shot runsCOPEN — EMNLP 2022 original zero-shot evaluationsEuroEval leaderboards (results collection), English generative leaderboardOpen Portuguese LLM Leaderboard (archived)

+ 752 more don't fit your machine or budget · show them

+ 16 models with fewer than 3 results left off, since one or two tests say little about overall ability · show them

830 of 1134 catalogue models listed here · sources and licences

* new or thinly tested: ranked on too few benchmark results · † only the maker’s own numbers so far · ~RAM is estimated; full context may need more memory