whatmodel.sh · find the best decision models you can run

Best Decision models for language understanding to run locally

A leaderboard of the best Decision models for language understanding you can run on your own computer. Clef-omni is #1 right now, followed by Clef and Clef-flash. Published typed-decision evaluations, with evaluator-specific protocols and tested settings retained. Each task score uses only its reviewed benchmarks. Each model shows the download that fits and the command to run it.

25 models · 21 benchmarks · updated

Compare tested decision models and inference recipes across text, vision and workflow tasks. Use task filters and raw results: probability consistency measures coherence, not correctness.

Filter by your hardware and budget · local only · reset
ram[2][4][8][16][24][32][48][64][96][128][192][256]
[]
GB
gpu[apple silicon][graphics card][unified memory][none]
price[local][$0.05][$0.1][any]max per M input tokens
Filter by task
task[all tasks][tools & automation][retrieval & classification][language understanding][arts & human taste][knowledge & reasoning][vision][workflows][consistency]

Scores use reviewed language understanding evaluations only. Compare scores within this task. Models without task measurements are excluded.

New #1s:
orRSS

detecting your OS…

$ terminal

detecting your OS…

Run curl "whatmodel.sh/decision?max=0"to get this list in your terminal (add &format=json for agents).

Score vs release date

Release dates available for 9 of 25 models. Undated models are omitted; month-only dates are plotted at the start of the month.

#modeltask score↓where↓RAM↓speed↓get itsources
#modeltask score↓where↓RAM↓speed↓get itsources
7Clef-omni Cloudflare73±2local~87GBhow to run › Decision Index 0.4.1System One Bench (Ali Alhashimi)
14Clef Cloudflare71±1local~68GBhow to run › Decision Index 0.4.1System One Bench (Ali Alhashimi)DecideBench (Cho Yin Yong)
18Clef-flash Cloudflare70±1local~25GBhow to run › Decision Index 0.4.1System One Bench (Ali Alhashimi)DecideBench (Cho Yin Yong)
31vLLM-SR d3-flash (9B) vLLM Semantic Router67±1†local~18GBhow to run › Decision Index 0.4.1
47vLLM-SR d3-mini (4B) vLLM Semantic Router64±1†local~11GBhow to run › Decision Index 0.4.1
56Jebadiah 27B v2.1 (T1e) frontier-infra62±1†local~69GBhow to run › Decision Index 0.4.1
78Perplexity Decider Flash v1.2 (4B) Perplexity60±1local~10GBhow to run › Decision Index 0.4.1System One Bench (Ali Alhashimi)
87Decider 4B Mapika59±1†local~11GBhow to run › Decision Index 0.4.1
121vLLM-SR d3-nano (2B) vLLM Semantic Router55±1local~8.2GBhow to run › Decision Index 0.4.1System One Bench (Ali Alhashimi)
129Bespoke Nimble 9B v3 Bespoke Labs53±1†local~21GBhow to run › Decision Index 0.4.1
131Jebadiah 9B v2.1 (T1e) frontier-infra52±1†local~25GBhow to run › Decision Index 0.4.1
132vLLM-SR Decision 2.0 Lux 9B vLLM Semantic Router52±1†local~20GBhow to run › Decision Index 0.4.1
141Bespoke Nimble 9B v2 Bespoke Labs49±1†local~20GBhow to run › Decision Index 0.4.1
156GLiClass v4 edge (0.4B) Knowledgator Engineering47±1†local~2.7GBhow to run › Decision Index 0.4.1
162vLLM-SR d3-lite (0.8B) vLLM Semantic Router46±1local~4.5GBhow to run › Decision Index 0.4.1System One Bench (Ali Alhashimi)
164vLLM-SR Decision 2.0 Nox 4B vLLM Semantic Router46±1†local~12GBhow to run › Decision Index 0.4.1
175Kev 4B r10 Jared Palmer44±1local~11GBhow to run › Decision Index 0.4.1System One Bench (Ali Alhashimi)
207vLLM-SR Decision 2.0 Sol 2B vLLM Semantic Router35±1†local~11GBhow to run › Decision Index 0.4.1
213LiquidAI d1-omni-600M Liquid AI33±1local~2.7GBhow to run › Decision Index 0.4.1System One Bench (Ali Alhashimi)
214vLLM-SR d3-edge (0.6B) vLLM Semantic Router33±1local~2.6GBhow to run › Decision Index 0.4.1System One Bench (Ali Alhashimi)
216Strands Decider 2B (Hobson v21) Amazon Web Services32±1local~6.6GBhow to run › Decision Index 0.4.1
230vLLM-SR Decision 2.0 Kai 0.6B vLLM Semantic Router26±1†local~3.7GBhow to run › Decision Index 0.4.1
231vLLM-SR Decision 2.0 Eos 0.8B vLLM Semantic Router26±1†local~5.8GBhow to run › Decision Index 0.4.1
233Kev 0.8B r15 Jared Palmer26±1local~4.6GBhow to run › Decision Index 0.4.1System One Bench (Ali Alhashimi)
236CLM-v0.1-8B Qwen3-8B heads Contrastive-LM24±1local~15GBhow to run › Decision Index 0.4.1DecideBench (Cho Yin Yong)

+ 231 more don't fit your machine or budget · show them

256 of 256 catalogue models listed here · sources and licences

* new or thinly tested: ranked on too few benchmark results · † no independently run results verified · ~RAM is estimated; full context may need more memory

25 models · 21 benchmarks · updated