whatmodel.sh · find the best AI models you can run

AI models in the ARC Challenge model set

A leaderboard of the best AI models. Models are ranked by one score that combines 566 published benchmarks. Filter by your computer or budget to find the best one you can use.

0 models · scores combine 566 benchmarks · updated how it works · find a leaderboard · benchmark your machine
task[all tasks][agent tasks][coding][chat & writing][math][vision & documents][web search]
Filter by your hardware and budget
+ more · ARC Challenge
set[all sets][LMArena (text) · 1182][ARC Challenge · 8][ANLI Round 1 (prompted) · 8][LAMBADA (OpenAI version), last-word accuracy · 7][ARC Challenge · 3][ARC Challenge · 2]
score[overall][within selected set]

Filter the model list while keeping overall scores. Models without a shared score scale are not yet calibrated; select a set to see its own scores.

Detect your exact chip or graphics card:

curl -G whatmodel.sh/ --data-urlencode "mac=$(sysctl -n hw.memsize machdep.cpu.brand_string)"Mac

curl -G whatmodel.sh/ --data-urlencode "ram=$(awk '/MemT/{print $2}' /proc/meminfo)" --data-urlencode "nv=$(nvidia-smi --query-gpu=name,memory.total --format=csv,noheader 2>/dev/null)"Linux

curl.exe -G whatmodel.sh/ --data-urlencode "ram=$((gcim Win32_ComputerSystem).TotalPhysicalMemory)" --data-urlencode "nv=$(nvidia-smi --query-gpu=name,memory.total --format=csv,noheader 2>$null)"Windows

$ terminal

detecting your OS…

Run curl "whatmodel.sh/?set=arc-challenge%40first-party-aleph-alpha"to get this list in your terminal (add &format=json for agents).

ram[8][16][24][32][48][64][96][128][192][256]
[]
GB
gpu[apple silicon][graphics card][unified memory][none]
price[local][$0.02][$0.1][$0.5][$2][$10][$50][any]max per M

detecting your OS…

#modelscore↓where↓RAM↓speed↓context↓get itsources
#modelscore↓where↓RAM↓speed↓context↓get itsources

No models match these filters.

0 of 1212 catalogue models listed here · sources and licences

Models outside this leaderboard (3 models)

No current run option verified: Luminous Base (13B) · Luminous Extended (30B) · Luminous Supreme (70B)

* new or thinly tested: ranked on too few benchmark results · † only the maker’s own numbers so far · ~RAM is estimated; full context may need more memory