whatmodel.sh · find the best decision models you can run

Best Decision models for knowledge & reasoning to run locally

A leaderboard of the best Decision models for knowledge & reasoning you can run on your own computer. Clef-omni is #1 right now, followed by Clef and Clef-flash. Published typed-choice knowledge and reasoning evaluations. Each task score uses only the reviewed benchmarks and their original evaluator protocols. Each model shows the download that fits and the command to run it.

31 models · 37 benchmarks · updated

Compare tested decision models and inference recipes across text, vision and workflow tasks. Use task filters and raw results: probability consistency measures coherence, not correctness.

Filter by your hardware and budget · local only · reset
ram[2][4][8][16][24][32][48][64][96][128][192][256]
[]
GB
gpu[apple silicon][graphics card][unified memory][none]
price[local][$0.05][$0.1][any]max per M input tokens
Filter by task
task[all tasks][tools & automation][retrieval & classification][language understanding][arts & human taste][knowledge & reasoning][vision][workflows][consistency]

Scores use reviewed knowledge & reasoning evaluations only. Compare scores within this task. Models without task measurements are excluded.

New #1s:
orRSS

detecting your OS…

$ terminal

detecting your OS…

Run curl "whatmodel.sh/decision?max=0"to get this list in your terminal (add &format=json for agents).

Score vs release date

Release dates available for 12 of 31 models. Undated models are omitted; month-only dates are plotted at the start of the month.

#modeltask score↓where↓RAM↓speed↓get itsources
#modeltask score↓where↓RAM↓speed↓get itsources
28Clef-omni Cloudflare67±1local~87GBhow to run › Decision Index 0.4.1LeanMCP · JevBenchFreyer et al. · MedQAEtsabary · decision benchmarks
30Clef Cloudflare66±1local~68GBhow to run › Decision Index 0.4.1LeanMCP · JevBenchDecision Models as Judges for Hallucination DetectionDecisionPivot · StartLux LabsFreyer et al. · MedQAEtsabary · decision benchmarks
47Clef-flash Cloudflare65±1local~25GBhow to run › Decision Index 0.4.1LeanMCP · JevBenchDecisionPivot · StartLux LabsOllaya · original runsFreyer et al. · MedQAEtsabary · decision benchmarks
51Jebadiah 27B v2.1 (T1e) frontier-infra64±1†local~69GBhow to run › Decision Index 0.4.1
86vLLM-SR d3-flash (9B) vLLM Semantic Router60±1local~18GBhow to run › Decision Index 0.4.1Ollaya · original runs
94Jebadiah 27B v2.1 (Ollaya Q4_K_M) frontier-infra59±4local~16GBhow to run › Ollaya · original runs
99Perplexity Decider Flash v1.2 (4B) Perplexity58±1local~10GBhow to run › Decision Index 0.4.1Ollaya · original runsDo We Need an LLM to Know Why Sources Conflict? Decision Models for Knowledge-Conflict Typing in RAGEtsabary · decision benchmarks
104vLLM-SR d3-mini (4B) vLLM Semantic Router57±1local~11GBhow to run › Decision Index 0.4.1Ollaya · original runs
105Jebadiah 9B v2.1 (T1e) frontier-infra57±1†local~25GBhow to run › Decision Index 0.4.1
107Bespoke Nimble 9B v3 Bespoke Labs57±1local~21GBhow to run › Decision Index 0.4.1Ollaya · original runs
125vLLM-SR Decision 2.0 Lux 9B vLLM Semantic Router54±1local~20GBhow to run › Decision Index 0.4.1Ollaya · original runs
129Bespoke Nimble 9B v2 Bespoke Labs54±1local~20GBhow to run › Decision Index 0.4.1Ollaya · original runs
137Jebadiah 9B v2.1 (Ollaya Q8_0) frontier-infra53±4local~9.1GBhow to run › Ollaya · original runs
142Decider 4B Mapika52±1local~11GBhow to run › Decision Index 0.4.1Ollaya · original runs
152Winnow-12B (DecisionBench b6ac22b0) EldanRing51±4local~16GBhow to run › Ollaya · original runs
155vLLM-SR Decision 2.0 Nox 4B vLLM Semantic Router51±1local~12GBhow to run › Decision Index 0.4.1Ollaya · original runs
159Kev 4B r10 Jared Palmer50±1local~11GBhow to run › Decision Index 0.4.1Ollaya · original runs
164Jebadiah 4B v2 (Ollaya Q8_0) frontier-infra49±4local~5.5GBhow to run › Ollaya · original runs
172vLLM-SR d3-nano (2B) vLLM Semantic Router47±1local~8.2GBhow to run › Decision Index 0.4.1Ollaya · original runs
193laya (DecisionBench 1c5edc17) ConvAI Innovations40±4local~1.7GBhow to run › Ollaya · original runs
197vLLM-SR d3-lite (0.8B) vLLM Semantic Router40±1local~4.5GBhow to run › Decision Index 0.4.1Ollaya · original runs
201vLLM-SR Decision 2.0 Sol 2B vLLM Semantic Router37±1local~11GBhow to run › Decision Index 0.4.1Ollaya · original runs
203Strands Decider 2B (Hobson v21) Amazon Web Services37±1local~6.6GBhow to run › Decision Index 0.4.1
204GLiClass v4 edge (0.4B) Knowledgator Engineering37±1local~2.7GBhow to run › Decision Index 0.4.1Ollaya · original runs
217Kev 0.8B r15 Jared Palmer33±1local~4.6GBhow to run › Decision Index 0.4.1Ollaya · original runs
223vLLM-SR d3-edge (0.6B) vLLM Semantic Router30±1local~2.6GBhow to run › Decision Index 0.4.1Ollaya · original runs
225vLLM-SR Decision 2.0 Eos 0.8B vLLM Semantic Router30±1local~5.8GBhow to run › Decision Index 0.4.1Ollaya · original runs
228vLLM-SR Decision 2.0 Kai 0.6B vLLM Semantic Router29±1local~3.7GBhow to run › Decision Index 0.4.1Ollaya · original runs
231LiquidAI d1-omni-600M Liquid AI28±1local~2.7GBhow to run › Decision Index 0.4.1Ollaya · original runs
237Decision-1.0-Eos-0.8B (DecisionBench 3c2d6326) llm-semantic-router26±3local~5.8GBhow to run › Ollaya · original runs
245CLM-v0.1-8B Qwen3-8B heads Contrastive-LM23±1local~15GBhow to run › Decision Index 0.4.1Ollaya · original runs

+ 232 more don't fit your machine or budget · show them

263 of 263 catalogue models listed here · sources and licences

* new or thinly tested: ranked on too few benchmark results · † no independently run results verified · ~RAM is estimated; full context may need more memory

31 models · 37 benchmarks · updated