Best AI models for images and documents to run locally on a 32GB graphics card
A leaderboard of the best AI models for images and documents you can run locally on a 32GB graphics card (with 32GB of system RAM). Qwen3.8 27B is #1 right now, followed by Gemma 4 31B and Qwen3.6 27B. Models are ranked on tests that ask questions about images, charts and documents, like MMMU and CharXiv. Each model shows the download that fits and the command to run it.
Scores use reviewed vision & documents evaluations only. Compare scores within this task. Models without task measurements are excluded.
+ more
$ terminal
↗ share
detecting your OS…
Score vs memory to run
● open weights ◆ API only ─┘ best score for the memory · x: GB of RAM / VRAM for the smallest download (log)
| # | model | task score↓ | where↓ | speed↓ | sources |
|---|
| # | model | task score↓ | where↓ | speed↓ | sources |
|---|---|---|---|---|---|
| 42 | 64±2 | local | |||
| 52 | 62±2 | local | |||
| 53 | 62±2 | local | |||
| 56 | 61±2 | local | |||
| 60 | 61±3 | local | |||
| 61 | 61±2 | local | |||
| 64 | 60±1 | local | |||
| 68 | 60±4† | local | |||
| 78 | 57±2 | local | |||
| 80 | 56±4† | local | |||
| 87 | 55±2* | local (slow) | |||
| 96 | 54±2† | local | |||
| 97 | 53±2 | local | |||
| 101 | 52±2† | local | |||
| 103 | 52±7*† | local (slow) | |||
| 106 | 51±2 | local (slow) | |||
| 107 | 50±4*† | local | |||
| 110 | 49±2† | local | |||
| 115 | 47±2 | local | |||
| 119 | 46±2† | local | |||
| 120 | 46±5* | local | |||
| 124 | 45±2* | local (slow) | |||
| 125 | 44±2 | local | |||
| 126 | 44±2 | local | |||
| 128 | 44±1 | local (slow) | |||
| 129 | 44±2 | local | |||
| 131 | 44±2 | local | |||
| 133 | 42±2 | local | |||
| 135 | 42±2 | local | |||
| 136 | 42±2 | local | |||
| 138 | 40±4† | local | |||
| 139 | 40±2 | local (slow) | |||
| 140 | 40±2 | local | |||
| 141 | 39±2 | local | |||
| 143 | 38±1 | local (slow) | |||
| 148 | 35±2 | local | |||
| 150 | 34±2 | local | |||
| 155 | 30±2 | local | |||
| 156 | 30±4 | local | |||
| 161 | 29±1 | local | |||
| 163 | 27±4 | local | |||
| 164 | 27±1 | local | |||
| 165 | 27±3 | local | |||
| 166 | 27±2 | local | |||
| 167 | 26±2 | local | |||
| 171 | 24±2 | local (slow) | |||
| 173 | 22±2 | local | |||
| 175 | 21±2 | local (slow) | |||
| 176 | 21±2 | local | |||
| 177 | 20±2 | local | |||
| 178 | 19±2 | local | |||
| 179 | 16±2 | local | |||
| 180 | 14±2† | local | |||
| 181 | 14±4 | local | |||
| 182 | 12±2 | local | |||
| — | not scored yet | local |
+ 128 more don't fit your machine or budget · show them
+ 1 models with fewer than 3 results left off, since one or two tests say little about overall ability · show them
184 of 202 catalogue models listed here · sources and licences
* new or thinly tested: ranked on too few benchmark results · † only the maker’s own numbers so far · ~RAM is estimated; full context may need more memory