whatmodel.sh · find the best decision models you can run

Best Decision models for knowledge & reasoning to run locally on a 16GB graphics card

A leaderboard of the best Decision models for knowledge & reasoning you can run locally on a 16GB graphics card (with 32GB of system RAM). Clef-flash is #1 right now, followed by vLLM-SR d3-flash (9B) and Jebadiah 27B v2.1 (Ollaya Q4_K_M). Published typed-choice knowledge and reasoning evaluations. Each task score uses only the reviewed benchmarks and their original evaluator protocols. Each model shows the download that fits and the command to run it.

28 models · 37 benchmarks · updated

Compare tested decision models and inference recipes across text, vision and workflow tasks. Use task filters and raw results: probability consistency measures coherence, not correctness.

Filter by your hardware and budget → ~16GB fast · local only · reset
ram[2][4][8][16][24][32][48][64][96][128][192][256]
[]
GB
gpu[apple silicon][graphics card][unified memory][none]
vram[4][8][12][16][24][32][48][64][80][96][128]
[]
GB
price[local][$0.05][$0.1][any]max per M input tokens
Filter by task
task[all tasks][tools & automation][retrieval & classification][language understanding][arts & human taste][knowledge & reasoning][vision][workflows][consistency]

Scores use reviewed knowledge & reasoning evaluations only. Compare scores within this task. Models without task measurements are excluded.

New #1s for your hardware:
orRSS

detecting your OS…

$ terminal

detecting your OS…

Run curl "whatmodel.sh/decision?ram=32&gpu=card&vram=16&max=0"to get this list in your terminal (add &format=json for agents).

Score vs release date

Release dates available for 9 of 28 models. Undated models are omitted; month-only dates are plotted at the start of the month.

#modeltask score↓where↓RAM↓speed↓get itsources
#modeltask score↓where↓RAM↓speed↓get itsources
47Clef-flash · bf16 Cloudflare65±1local (slow)~25GBhow to run › Decision Index 0.4.1LeanMCP · JevBenchDecisionPivot · StartLux LabsOllaya · original runsFreyer et al. · MedQAEtsabary · decision benchmarks
86vLLM-SR d3-flash (9B) · ollaya-f32 vLLM Semantic Router60±1local (slow)~18GBhow to run › Decision Index 0.4.1Ollaya · original runs
94Jebadiah 27B v2.1 (Ollaya Q4_K_M) · q4_k_m-ollaya frontier-infra59±4local (slow)~16GBhow to run › Ollaya · original runs
99Perplexity Decider Flash v1.2 (4B) · ollaya-f32 Perplexity58±1local~10GBhow to run › Decision Index 0.4.1Ollaya · original runsDo We Need an LLM to Know Why Sources Conflict? Decision Models for Knowledge-Conflict Typing in RAGEtsabary · decision benchmarks
104vLLM-SR d3-mini (4B) · ollaya-f32 vLLM Semantic Router57±1local~11GBhow to run › Decision Index 0.4.1Ollaya · original runs
105Jebadiah 9B v2.1 (T1e) · bf16-t1e frontier-infra57±1†local (slow)~25GBhow to run › Decision Index 0.4.1
107Bespoke Nimble 9B v3 · ollaya-f32 Bespoke Labs57±1local (slow)~21GBhow to run › Decision Index 0.4.1Ollaya · original runs
125vLLM-SR Decision 2.0 Lux 9B · ollaya-f32 vLLM Semantic Router54±1local (slow)~20GBhow to run › Decision Index 0.4.1Ollaya · original runs
129Bespoke Nimble 9B v2 · ollaya-f32 Bespoke Labs54±1local (slow)~20GBhow to run › Decision Index 0.4.1Ollaya · original runs
137Jebadiah 9B v2.1 (Ollaya Q8_0) · q8_0-ollaya frontier-infra53±4local~9.1GBhow to run › Ollaya · original runs
142Decider 4B · ollaya-f32 Mapika52±1local~11GBhow to run › Decision Index 0.4.1Ollaya · original runs
152Winnow-12B (DecisionBench b6ac22b0) · ollaya-q8-0 EldanRing51±4local~16GBhow to run › Ollaya · original runs
155vLLM-SR Decision 2.0 Nox 4B · ollaya-f32 vLLM Semantic Router51±1local~12GBhow to run › Decision Index 0.4.1Ollaya · original runs
159Kev 4B r10 · ollaya-f32 Jared Palmer50±1local~11GBhow to run › Decision Index 0.4.1Ollaya · original runs
164Jebadiah 4B v2 (Ollaya Q8_0) · q8_0-ollaya frontier-infra49±4local~5.5GBhow to run › Ollaya · original runs
172vLLM-SR d3-nano (2B) · ollaya-f32 vLLM Semantic Router47±1local~8.2GBhow to run › Decision Index 0.4.1Ollaya · original runs
193laya (DecisionBench 1c5edc17) · ollaya-f16 ConvAI Innovations40±4local~1.7GBhow to run › Ollaya · original runs
197vLLM-SR d3-lite (0.8B) · ollaya-f32 vLLM Semantic Router40±1local~4.5GBhow to run › Decision Index 0.4.1Ollaya · original runs
201vLLM-SR Decision 2.0 Sol 2B · ollaya-f32 vLLM Semantic Router37±1local~11GBhow to run › Decision Index 0.4.1Ollaya · original runs
203Strands Decider 2B (Hobson v21) · bf16 Amazon Web Services37±1local~6.6GBhow to run › Decision Index 0.4.1
204GLiClass v4 edge (0.4B) · ollaya-f32 Knowledgator Engineering37±1local~2.7GBhow to run › Decision Index 0.4.1Ollaya · original runs
217Kev 0.8B r15 · ollaya-f32 Jared Palmer33±1local~4.6GBhow to run › Decision Index 0.4.1Ollaya · original runs
223vLLM-SR d3-edge (0.6B) · ollaya-f32 vLLM Semantic Router30±1local~2.6GBhow to run › Decision Index 0.4.1Ollaya · original runs
225vLLM-SR Decision 2.0 Eos 0.8B · ollaya-f32 vLLM Semantic Router30±1local~5.8GBhow to run › Decision Index 0.4.1Ollaya · original runs
228vLLM-SR Decision 2.0 Kai 0.6B · ollaya-f32 vLLM Semantic Router29±1local~3.7GBhow to run › Decision Index 0.4.1Ollaya · original runs
231LiquidAI d1-omni-600M · ollaya-f32 Liquid AI28±1local~2.7GBhow to run › Decision Index 0.4.1Ollaya · original runs
237Decision-1.0-Eos-0.8B (DecisionBench 3c2d6326) · ollaya-f32 llm-semantic-router26±3local~5.8GBhow to run › Ollaya · original runs
245CLM-v0.1-8B Qwen3-8B heads · ollaya-f32 Contrastive-LM23±1local~15GBhow to run › Decision Index 0.4.1Ollaya · original runs

+ 235 more don't fit your machine or budget · show them

263 of 263 catalogue models listed here · sources and licences

* new or thinly tested: ranked on too few benchmark results · † no independently run results verified · ~RAM is estimated; full context may need more memory

28 models · 37 benchmarks · updated