whatmodel.sh · find the best AI models you can run

Best AI models for images and documents

A leaderboard of the best AI models for images and documents. Claude Mythos Preview (limited preview) is #1 right now, followed by Qwen3.8 Max (2.4T-A95B) and Claude Fable 5. Models are ranked on tests that ask questions about images, charts and documents, like MMMU and CharXiv. Filter by your computer or budget to find the best one you can use.

184 models · scores combine 47 benchmarks · updated how it works · find a leaderboard · benchmark your machine
task[all tasks][agent tasks][coding][chat & writing][math][vision & documents][web search]

Scores use reviewed vision & documents evaluations only. Compare scores within this task. Models without task measurements are excluded.

Filter by your hardware and budget · reset
+ more
set[all sets][Arena vision (style controlled) · 199][CharXiv descriptive questions · 2]

Filter the model list while keeping task scores. Models without a shared score scale are not yet calibrated; select a set to see its own scores.

Detect your exact chip or graphics card:

curl -G whatmodel.sh/ -d max=0 --data-urlencode "mac=$(sysctl -n hw.memsize machdep.cpu.brand_string)"Mac

curl -G whatmodel.sh/ -d max=0 --data-urlencode "ram=$(awk '/MemT/{print $2}' /proc/meminfo)" --data-urlencode "nv=$(nvidia-smi --query-gpu=name,memory.total --format=csv,noheader 2>/dev/null)"Linux

curl.exe -G whatmodel.sh/ -d max=0 --data-urlencode "ram=$((gcim Win32_ComputerSystem).TotalPhysicalMemory)" --data-urlencode "nv=$(nvidia-smi --query-gpu=name,memory.total --format=csv,noheader 2>$null)"Windows

$ terminal

detecting your OS…

Run curl whatmodel.shto get this list in your terminal (add &format=json for agents).

ram[8][16][24][32][48][64][96][128][192][256]GB
gpu[apple silicon][graphics card][none]
price[local][$0.05][$0.25][$1][$5][$20][any]max per M

detecting your OS…

Score vs API price

#modeltask score↓where↓speed↓RAM↓context↓get itsources
#modeltask score↓where↓speed↓RAM↓context↓get itsources
1Claude Mythos Preview (limited preview) Anthropic73±6*†limited preview1MAnthropic system cards and model announcements (lab-reported scores)
2Qwen3.8 Max (2.4T-A95B) Alibaba71±2*api $3.00/M +local~380GB262kdeepinfra.com ↗LMArena leaderboard datasetQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
3Claude Fable 5 Anthropic71±2api $20.00/M1Mdocs.anthropic.com ↗LMArena leaderboard datasetMeridian Labs inspect_charxiv evaluation report (GitHub README)
4Claude Opus 4.7 Anthropic70±2api $10.00/M1Mdocs.anthropic.com ↗LMArena leaderboard datasetAnthropic system cards and model announcements (lab-reported scores)
5Gemini 3.7 Flash Google69±2*api $1.50/M1Mai.google.dev ↗LMArena leaderboard datasetGoogle DeepMind Gemini model page and model cards (lab-reported scores)
6Claude Opus 5 Anthropic69±2api $10.00/M1Mdocs.anthropic.com ↗LMArena leaderboard datasetSciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding (arXiv:2609.05141v2)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
7Gemini 3.8 Flash Google69±2*api $1.50/M1Mai.google.dev ↗LMArena leaderboard datasetGoogle DeepMind Gemini model page and model cards (lab-reported scores)
8Muse Spark 1.2 Meta69±2*api $2.00/M1Mdev.meta.ai ↗LMArena leaderboard dataset
9GPT-6 Astra OpenAI69±2api $20.00/M1.1Mplatform.openai.com ↗LMArena leaderboard datasetMeridian Labs inspect_charxiv evaluation report (GitHub README)OpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
10Qwen3.8-Flash-Next Alibaba69±4*local~59GB262kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
11GPT-5.6 Sol OpenAI69±2api $8.00/M1.1Mplatform.openai.com ↗LMArena leaderboard datasetSciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding (arXiv:2609.05141v2)OpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
12Claude Fable 5.1 Anthropic68±2*api $20.00/M1Mdocs.anthropic.com ↗LMArena leaderboard dataset
13GPT-6.1 Sol OpenAI68±2*api $4.00/M1.1Mdevelopers.openai.com ↗LMArena leaderboard dataset
14Muse Spark Meta68±2*comparison onlyLMArena leaderboard dataset
15Qwen3.8-Omni-Flash Alibaba68±4*†api $0.23/M1Mwww.alibabacloud.com ↗Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
16Claude Opus 4.8 Anthropic68±2api $10.00/M1Mdocs.anthropic.com ↗LMArena leaderboard datasetSciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding (arXiv:2609.05141v2)Anthropic system cards and model announcements (lab-reported scores)
17Gemini 3.5 Flash Google68±2api $3.38/M1Mai.google.dev ↗LMArena leaderboard datasetGoogle DeepMind Gemini model page and model cards (lab-reported scores)SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models (arXiv:2610.12402v1)
18Muse Spark 1.3 Meta68±2*api $2.00/M1Mdev.meta.ai ↗LMArena leaderboard dataset
19Claude Opus 4.6 Anthropic68±2api $10.00/M1Mdocs.anthropic.com ↗LMArena leaderboard datasetAnthropic system cards and model announcements (lab-reported scores)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams (arXiv:2608.12262v1)
20Gemini 3.1 Pro (Preview) Google67±2api $4.50/M1Mai.google.dev ↗LMArena leaderboard datasetGoogle DeepMind Gemini model page and model cards (lab-reported scores)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams (arXiv:2608.12262v1)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
21Gemini 3.6 Flash Google67±2api $1.50/M1Mai.google.dev ↗LMArena leaderboard datasetGoogle DeepMind Gemini model page and model cards (lab-reported scores)SciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding (arXiv:2609.05141v2)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
22GPT-5.5 OpenAI67±2api $11.25/M1.1Mplatform.openai.com ↗LMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
23Muse Spark 1.1 Meta67±2*api $2.00/M1Mdev.meta.ai ↗LMArena leaderboard dataset
24Gemini 3 Pro (Preview) Google67±2comparison only1MLMArena leaderboard datasetGoogle DeepMind Gemini model page and model cards (lab-reported scores)Qwen/Qwen3.5-397B-A17B model cardBaidu - ERNIE 5.0 Technical Report (arXiv:2602.04705v1)Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams (arXiv:2608.12262v1)Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding (Ai2, arXiv 2601.10611v4)
25GLM-5.3-Flash Z.ai67±2*api $0.24/M +local~103GB1Mdocs.z.ai ↗LMArena leaderboard datasetHow Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
26Kimi K3 Moonshot AI67±6*†api $6.00/M +local~884GB1Mplatform.moonshot.ai ↗Moonshot AI vendor-reported benchmark scores for its own Kimi models (Hugging Face model cards)
27GPT-5.4 OpenAI67±2api $5.63/M1.1Mplatform.openai.com ↗LMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models (arXiv:2610.12402v1)
28Grok 4.5 SpaceXAI (xAI)67±2*api $3.00/M500kdocs.x.ai ↗LMArena leaderboard dataset
29Qwen3.7 Plus Alibaba66±2api $0.70/M1Mwww.alibabacloud.com ↗LMArena leaderboard datasetQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Qwen/Qwen3.8-27B model cardSciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding (arXiv:2609.05141v2)SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models (arXiv:2610.12402v1)
30GPT-5.5 Instant OpenAI66±2comparison onlyLMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
31Qwen3.6 Plus Alibaba66±4*api $1.13/M1Mdocs.together.ai ↗Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)
32Gemini 3 Flash (Preview) Google66±2api $1.13/M1Mai.google.dev ↗LMArena leaderboard datasetGoogle DeepMind Gemini model page and model cards (lab-reported scores)SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models (arXiv:2610.12402v1)Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams (arXiv:2608.12262v1)
33GPT-5.6 Terra OpenAI66±2api $4.50/M1.1Mplatform.openai.com ↗LMArena leaderboard datasetSciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding (arXiv:2609.05141v2)OpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
34Claude Sonnet 4.6 Anthropic65±2api $6.00/M1Mdocs.anthropic.com ↗LMArena leaderboard datasetSciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding (arXiv:2609.05141v2)Anthropic system cards and model announcements (lab-reported scores)SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models (arXiv:2610.12402v1)VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback? (arXiv:2608.10408v1)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)
35Claude Sonnet 5.5 Anthropic65±2*api $4.00/M1Mplatform.claude.com ↗LMArena leaderboard dataset
36Claude Sonnet 5 Anthropic65±2api $4.00/M1Mdocs.anthropic.com ↗LMArena leaderboard datasetAnthropic system cards and model announcements (lab-reported scores)SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models (arXiv:2610.12402v1)
37Qwen3.6 Flash Alibaba65±6*api $0.56/M1Mwww.alibabacloud.com ↗SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models (arXiv:2610.12402v1)
38Grok 4.6 SpaceXAI (xAI)65±2*api $3.00/M500kdocs.x.ai ↗LMArena leaderboard dataset
39Qwen3.5 397B-A17B Alibaba65±2api $1.09/M +local~65GB262kdeepinfra.com ↗LMArena leaderboard datasetQwen/Qwen3.5-397B-A17B model cardQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams (arXiv:2608.12262v1)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
40Kimi K2.6 Moonshot AI64±2api $1.71/M +local~317GB262kplatform.moonshot.ai ↗LMArena leaderboard datasetMoonshot AI vendor-reported benchmark scores for its own Kimi models (Hugging Face model cards)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
41GPT-5.6 Luna OpenAI64±2api $0.45/M1.1Mplatform.openai.com ↗LMArena leaderboard datasetSciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding (arXiv:2609.05141v2)OpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models (arXiv:2610.12402v1)
42Qwen3.8 27B Alibaba64±2api $1.60/M +local~18GB262kconsole.groq.com ↗LMArena leaderboard datasetQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Qwen/Qwen3.8-27B model cardSciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding (arXiv:2609.05141v2)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
43Step 5 Preview StepFun64±2*comparison onlyLMArena leaderboard dataset
44Gemini 3.5 Flash-Lite Google64±2*api $0.85/M1Mai.google.dev ↗LMArena leaderboard datasetGoogle DeepMind Gemini model page and model cards (lab-reported scores)
45Dola Seed 2.0 Pro ByteDance63±2*comparison onlyLMArena leaderboard dataset
46Grok 4.20 (0309 reasoning) SpaceXAI (xAI)63±2*api $1.56/M1Mdocs.x.ai ↗LMArena leaderboard dataset
47Kimi K2.5 Moonshot AI63±2api $1.20/M +local~160GB262kdocs.aws.amazon.com ↗LMArena leaderboard datasetSciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding (arXiv:2609.05141v2)Qwen/Qwen3.5-397B-A17B model cardChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)Moonshot AI vendor-reported benchmark scores for its own Kimi models (Hugging Face model cards)Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams (arXiv:2608.12262v1)
48GPT-5.4 mini OpenAI62±2*api $1.69/M400kplatform.openai.com ↗LMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
49GPT-5.2 OpenAI62±2api $4.81/M400kplatform.openai.com ↗LMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)Qwen/Qwen3.5-397B-A17B model cardDiagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams (arXiv:2608.12262v1)
50Grok 4.20 Multi-Agent (0309) SpaceXAI (xAI)62±2*api $1.56/M1Mdocs.x.ai ↗LMArena leaderboard dataset
51MiMo-V2.6-Flash (309B-A15B) Xiaomi62±2*api $0.17/M +local~136GB1Mmimo.mi.com ↗LMArena leaderboard dataset
52Gemma 4 31B Google62±2api $0.19/M +local~21GB262kdeepinfra.com ↗LMArena leaderboard datasetGemma Team — Gemma 4 Technical Reportmeta-models/Muse-Glimmer-30B model card (speed and benchmark tables)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)
53Qwen3.6 27B Alibaba62±2api $1.20/M +local~18GB262kconsole.groq.com ↗Qwen/Qwen3.6-27B model cardQwen/Qwen3.8-27B model cardmeta-models/Muse-Glimmer-30B model card (speed and benchmark tables)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
54GPT-5.1 OpenAI62±2api $3.44/M400kplatform.openai.com ↗LMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
55MiMo-V2.6-Pro Xiaomi62±2*api $0.54/M +local~443GB1Mmimo.mi.com ↗LMArena leaderboard dataset
56Qwen3.5 35B-A3B Alibaba61±2api $0.35/M +local~23GB262kdeepinfra.com ↗Qwen/Qwen3.5-122B-A10B model cardQwen/Qwen3.6-35B-A3B model cardChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)Qwen/Qwen3.5-27B model cardHow Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
57Grok 4.3 SpaceXAI (xAI)61±2*api $1.56/M1Mdocs.x.ai ↗LMArena leaderboard dataset
58Qwen3.5 122B-A10B Alibaba61±2api $1.10/M +local~75GB262kwww.alibabacloud.com ↗Qwen/Qwen3.5-122B-A10B model cardLMArena leaderboard datasetQwen/Qwen3.5-27B model cardHow Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
59Gemini 2.5 Pro Google61±2api $3.44/M1Mai.google.dev ↗LMArena leaderboard datasetGoogle DeepMind Gemini model page and model cards (lab-reported scores)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)Baidu - ERNIE 5.0 Technical Report (arXiv:2602.04705v1)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding (Ai2, arXiv 2601.10611v4)
60Qwen3.6 35B-A3B Alibaba61±3api $0.31/M +local~23GB262kdeepinfra.com ↗Qwen/Qwen3.6-27B model cardQwen/Qwen3.6-35B-A3B model cardHow Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
61Gemma 4 26B-A4B Google61±2api $0.14/M +local~18GB262kdeepinfra.com ↗LMArena leaderboard datasetGemma Team — Gemma 4 Technical Reportgoogle/diffusiongemma-26B-A4B-it model card
62Claude Opus 4.5 Anthropic61±3api $10.00/M200kdocs.anthropic.com ↗LMArena leaderboard datasetAnthropic system cards and model announcements (lab-reported scores)Qwen/Qwen3.5-397B-A17B model card
63ChatGPT-4o (2025-03-26) OpenAI61±2*comparison onlyLMArena leaderboard dataset
64Qwen3.5 27B Alibaba60±1api $0.84/M +local~18GB262kdeepinfra.com ↗Qwen/Qwen3.5-122B-A10B model cardLMArena leaderboard datasetQwen/Qwen3.6-35B-A3B model cardQwen/Qwen3.5-27B model cardSpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models (arXiv:2610.12402v1)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)+1
65MiniMax-M3 MiniMax60±2api $0.48/M +local~137GB1Mdeepinfra.com ↗LMArena leaderboard datasetHow Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
66Gemini 3.1 Flash-Lite Google60±2*api $0.56/M1Mai.google.dev ↗LMArena leaderboard datasetGoogle DeepMind Gemini model page and model cards (lab-reported scores)
67Claude Haiku 4.5 Anthropic60±4*api $2.00/M200kdocs.anthropic.com ↗LMArena leaderboard dataset
68Muse Glimmer 30B Meta60±4†api $0.64/M +local~19GB131kfireworks.ai ↗meta-models/Muse-Glimmer-30B model card (speed and benchmark tables)
69MiMo-V2.5 (310B-A15B) Xiaomi60±2api $0.21/M +local~100GB1Mnovita.ai ↗LMArena leaderboard datasetSciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding (arXiv:2609.05141v2)XiaomiMiMo/MiMo-V2.5 model cardXiaomi MiMo vendor-reported benchmark scores for its own models (mimo.xiaomi.com launch pages)
70Gemini 2.5 Flash Preview (09-2025) Google59±2*comparison onlyLMArena leaderboard dataset
71GLM-5V-Turbo Z.ai59±2*api $1.90/M200kwww.siliconflow.com ↗LMArena leaderboard dataset
72Inkling (975B-A41B) Thinking Machines59±5*†api $1.73/M +local~156GB1Mdeepinfra.com ↗thinkingmachines/Inkling-Small model card
73MiMo-V2-Omni Xiaomi58±2comparison only262kLMArena leaderboard datasetXiaomiMiMo/MiMo-V2.5 model cardChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)Xiaomi MiMo vendor-reported benchmark scores for its own models (mimo.xiaomi.com launch pages)
74Claude Sonnet 4.5 Anthropic58±3api $6.00/M200kdocs.anthropic.com ↗LMArena leaderboard datasetVisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback? (arXiv:2608.10408v1)Qwen/Qwen3.5-27B model cardMolmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding (Ai2, arXiv 2601.10611v4)
75o3 OpenAI57±2*api $3.50/M200kplatform.openai.com ↗LMArena leaderboard dataset
76GPT-4.5 Preview OpenAI57±2comparison onlyLMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
77GPT-5 OpenAI57±2api $3.44/M400kplatform.openai.com ↗LMArena leaderboard datasetServiceNow-AI/Apriel-1.6-15b-Thinker model cardBaidu - ERNIE 5.0 Technical Report (arXiv:2602.04705v1)VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback? (arXiv:2608.10408v1)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding (Ai2, arXiv 2601.10611v4)
78Qwen3.5 9B Alibaba57±2api $0.11/M +local~7.4GB262kdeepinfra.com ↗Qwen/Qwen3.5-9B model cardChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)Qwen/Qwen3.5-4B model cardBEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models (arXiv:2610.12402v1)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
79Inkling Small (266B-A12B) Thinking Machines56±2api $0.64/M +local~86GB1Mdeepinfra.com ↗LMArena leaderboard datasetthinkingmachines/Inkling-Small model card
80Gemma 4 12B Google56±4†local~8.5GB262kLM Studio › Gemma Team — Gemma 4 Technical Report
81Claude Opus 4 Anthropic56±2*comparison onlyLMArena leaderboard dataset
82Claude Sonnet 4 Anthropic56±2*comparison onlyLMArena leaderboard dataset
83GPT-4.1 OpenAI56±2api $3.50/M1Mplatform.openai.com ↗LMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
84Gemini 2.5 Pro Preview (05-06) Google56±10*comparison onlyMSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs (arXiv:2505.20740v3)
85o4-mini OpenAI55±2*api $1.93/M200kplatform.openai.com ↗LMArena leaderboard dataset
86Qwen3-VL 235B-A22B Instruct Alibaba55±1local~134GB256kLM Studio › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)LMArena leaderboard datasetChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)
87Mistral Medium 3.5 (128B) Mistral55±2*api $3.00/M +local~42GB262kdocs.mistral.ai ↗LMArena leaderboard dataset
88Claude 3.7 Sonnet Anthropic55±2comparison onlyLMArena leaderboard datasetServiceNow-AI/Apriel-1.6-15b-Thinker model cardMSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs (arXiv:2505.20740v3)
89Gemini 2.5 Flash Google55±2api $0.85/M1Mai.google.dev ↗LMArena leaderboard datasetGoogle DeepMind Gemini model page and model cards (lab-reported scores)ServiceNow-AI/Apriel-1.6-15b-Thinker model cardBEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding (Ai2, arXiv 2601.10611v4)
90GPT-4.1 mini OpenAI54±2api $0.70/M1Mplatform.openai.com ↗LMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
91Grok 4.1 Fast (Reasoning) SpaceXAI (xAI)54±2*api $0.28/M128kazure.microsoft.com ↗LMArena leaderboard dataset
92Qwen3-VL 235B-A22B Thinking Alibaba54±2local~111GB256kLM Studio › LMArena leaderboard datasetQwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)Qwen/Qwen3.5-397B-A17B model card
93GPT-5.4 nano OpenAI54±2*api $0.46/M400kplatform.openai.com ↗LMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
94Mistral Large 3 (675B-A41B) Mistral54±2*api $0.75/M +local~108GB262kdocs.mistral.ai ↗LMArena leaderboard datasetmistralai/Mistral-Small-4-119B-2603 model card
95o1 (2024-12-17) OpenAI54±2api $26.25/M200kdevelopers.openai.com ↗LMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding (arXiv:2501.16411v2)
96Qwen3-VL 32B Thinking Alibaba54±2†api $0.28/M +local~22GB256kwww.alibabacloud.com ↗Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
97Qwen3.5 4B Alibaba53±2local~4.3GB262kllama.cpp › Qwen/Qwen3.5-9B model cardChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)Qwen/Qwen3.5-4B model cardBEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models (arXiv:2610.12402v1)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
98Gemini 2.5 Flash-Lite Preview (06-17) Google53±2*comparison onlyLMArena leaderboard dataset
99GPT-5 mini OpenAI53±2api $0.69/M400kplatform.openai.com ↗LMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback? (arXiv:2608.10408v1)Qwen/Qwen3.5-27B model cardMolmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding (Ai2, arXiv 2601.10611v4)
100Grok 4 (0709) SpaceXAI (xAI)53±2*comparison onlyLMArena leaderboard dataset
101Qwen3-VL 32B Instruct Alibaba52±2†api $0.28/M +local~22GB256kwww.alibabacloud.com ↗Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
102Gemini 1.5 Pro (002) Google52±2*comparison onlyLMArena leaderboard datasetCapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (arXiv:2503.12329v1)
103Mistral Small 4 (119B-A6.5B) Mistral52±7*†api $0.26/M +local~40GB262kdocs.mistral.ai ↗mistralai/Mistral-Small-4-119B-2603 model card
104Gemini 2.0 Flash (001) Google51±2*comparison onlyLMArena leaderboard dataset
105Gemini 2.5 Flash Preview (04-17) Google51±10*comparison onlyMSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs (arXiv:2505.20740v3)
106GLM-4.6V Z.ai51±2api $0.45/M +local~51GB128kdocs.z.ai ↗LMArena leaderboard datasetZ.ai GLM-V GitHub repository benchmark image (GLM-4.6V)SciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding (arXiv:2609.05141v2)
107Apriel 1.6 15B Thinker ServiceNow50±4*†local~10GBLM Studio › ServiceNow-AI/Apriel-1.6-15b-Thinker model card
108GLM-4.5V Z.ai50±2api $0.90/M +local~69GB64kdocs.z.ai ↗LMArena leaderboard datasetZ.ai GLM-V GitHub repository benchmark image (GLM-4.6V)ServiceNow-AI/Apriel-1.6-15b-Thinker model cardChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)
109Claude 3.5 Sonnet (2024-10-22) Anthropic49±2*comparison onlyLMArena leaderboard datasetKaleidoscope: In-language Exams for Massively Multilingual Vision Evaluation (arXiv:2504.07072v2)
110Qwen3-VL 30B-A3B Thinking Alibaba49±2†api $0.75/M +local~21GB256kwww.alibabacloud.com ↗Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
111GPT-4o (2024-11-20) OpenAI49±4*†api $4.38/M128kdevelopers.openai.com ↗OpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
112Mistral Medium 3.1 (2508) Mistral49±2*comparison onlyLMArena leaderboard dataset
113Mistral Medium 3 (2505) Mistral48±2*comparison onlyLMArena leaderboard dataset
114GPT-5 nano OpenAI47±2*api $0.14/M400kplatform.openai.com ↗LMArena leaderboard datasetQwen/Qwen3.5-4B model card
115Qwen3-VL 8B Thinking Alibaba47±2api $0.66/M +local~6.8GB256kwww.alibabacloud.com ↗Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)
116Llama 4 Maverick (402B-A17B) Meta47±2api $0.42/M +local~65GB1Mdocs.aws.amazon.com ↗LMArena leaderboard datasetApriel-1.5-15b-Thinker (arXiv:2510.01141v1), Table 4 multimodal benchmarksVMMU: A Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark (arXiv:2508.13680v5)
117DiffusionGemma 26B-A4B Google47±5†comparison only262kgoogle/diffusiongemma-26B-A4B-it model card
118Gemini 1.5 Flash (002) Google46±2*comparison onlyLMArena leaderboard dataset
119Qwen3-VL 30B-A3B Instruct Alibaba46±2†api $0.35/M +local~21GB256kwww.alibabacloud.com ↗Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
120Magistral Small 1.2 Mistral46±5*api $0.75/M +local~16GB131kdocs.aws.amazon.com ↗Apriel-1.5-15b-Thinker (arXiv:2510.01141v1), Table 4 multimodal benchmarks
121GPT-4o (2024-05-13) OpenAI46±2api $7.50/M128kdevelopers.openai.com ↗LMArena leaderboard datasetVHELM: A Holistic Evaluation of Vision Language Models (Stanford CRFM), arXiv 2410.07112v2CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs (arXiv:2406.18521v1)Pixtral 12B (Mistral AI, arXiv 2410.07073v2)CharXiv leaderboard (princeton-nlp/CharXiv README)Microsoft Phi-3.5-vision-instruct model card: Benchmarks table
122Gemini 2.0 Flash-Lite Preview (02-05) Google45±2*comparison onlyLMArena leaderboard dataset
123Gemini 2.5 Flash-Lite Google45±3*api $0.17/M1Mai.google.dev ↗Google DeepMind Gemini model page and model cards (lab-reported scores)Qwen/Qwen3.5-4B model card
124Llama 4 Scout (109B-A17B) Meta45±2*api $0.15/M +local~36GB328kdeepinfra.com ↗LMArena leaderboard datasetVMMU: A Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark (arXiv:2508.13680v5)
125Mistral Small 3.2 24B Mistral44±2api $0.11/M +local~16GB128kdeepinfra.com ↗LMArena leaderboard datasetVMMU: A Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark (arXiv:2508.13680v5)mistralai/Mistral-Small-3.2-24B-Instruct-2506 model cardmistralai/Mistral-Small-4-119B-2603 model card
126Qwen3-VL 4B Thinking Alibaba44±2local~4.1GB256kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)
127Claude 3.5 Sonnet (2024-06-20) Anthropic44±2comparison onlyLMArena leaderboard datasetVHELM: A Holistic Evaluation of Vision Language Models (Stanford CRFM), arXiv 2410.07112v2Pixtral 12B (Mistral AI, arXiv 2410.07073v2)CharXiv leaderboard (princeton-nlp/CharXiv README)Microsoft Phi-3.5-vision-instruct model card: Benchmarks tableCapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (arXiv:2503.12329v1)+1
128Qwen2.5-VL 72B Instruct Alibaba44±1local~46GB33kLM Studio › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)LMArena leaderboard datasetQwen2.5-VL-32B-Instruct model cardChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)VMMU: A Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark (arXiv:2508.13680v5)Kaleidoscope: In-language Exams for Massively Multilingual Vision Evaluation (arXiv:2504.07072v2)+2
129Qwen3-VL 8B Instruct Alibaba44±2api $0.31/M +local~6.8GB256kwww.alibabacloud.com ↗Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
130Claude 3.5 Haiku Anthropic44±2*comparison onlyLMArena leaderboard datasetMSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs (arXiv:2505.20740v3)
131Mistral Small 3.1 24B (2503) Mistral44±2local~17GB128kllama.cpp › LMArena leaderboard datasetMistral AI vendor-reported benchmark scores for its own models (Hugging Face model cards)mistralai/Mistral-Small-3.2-24B-Instruct-2506 model card
132GPT-4o (2024-08-06) OpenAI43±2api $4.38/M128kdevelopers.openai.com ↗LMArena leaderboard datasetVHELM: A Holistic Evaluation of Vision Language Models (Stanford CRFM), arXiv 2410.07112v2Meridian Labs inspect_charxiv evaluation report (GitHub README)Kaleidoscope: In-language Exams for Massively Multilingual Vision Evaluation (arXiv:2504.07072v2)CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (arXiv:2503.12329v1)
133Gemma 3 27B Google42±2api $0.10/M +local~18GB131kdeepinfra.com ↗LMArena leaderboard datasetGemma Team — Gemma 4 Technical ReportGoogle DeepMind Gemma 3 270M IT model cardVisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback? (arXiv:2608.10408v1)VMMU: A Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark (arXiv:2508.13680v5)Gemma Team — Gemma 3 Technical Report
134Nova Premier Amazon42±5*†api $5.00/M1Maws.amazon.com ↗Amazon vendor-reported benchmark scores for its own Nova models (Amazon Science technical reports)
135Molmo 2 8B Ai242±2local~6.8GBllama.cpp › LMArena leaderboard datasetMolmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding (Ai2, arXiv 2601.10611v4)
136Qwen2.5-VL 32B Instruct Alibaba42±2local~22GB33kLM Studio › LMArena leaderboard datasetQwen2.5-VL-32B-Instruct model cardApriel-1.5-15b-Thinker (arXiv:2510.01141v1), Table 4 multimodal benchmarksChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)Kaleidoscope: In-language Exams for Massively Multilingual Vision Evaluation (arXiv:2504.07072v2)VMMU: A Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark (arXiv:2508.13680v5)
137Gemini 1.5 Pro (001) Google42±2comparison onlyLMArena leaderboard datasetVHELM: A Holistic Evaluation of Vision Language Models (Stanford CRFM), arXiv 2410.07112v2CharXiv leaderboard (princeton-nlp/CharXiv README)
138Gemma 4 E4B Google40±4†local~6.9GB131kLM Studio › Gemma Team — Gemma 4 Technical Report
139Pixtral Large (2411) Mistral40±2local~51GBllama.cpp › LMArena leaderboard datasetMistral AI vendor-reported benchmark scores for its own models (Hugging Face model cards)
140Qwen3-VL 4B Instruct Alibaba40±2local~4.1GB256kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
141Qwen3.5 2B Alibaba39±2local~2.9GB262kllama.cpp › Qwen/Qwen3.5-2B model cardCohereLabs/North-Micro-Vision-Instruct model card (benchmark table)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models (arXiv:2610.12402v1)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
142GPT-4.1 nano OpenAI38±2api $0.17/M1Mdevelopers.openai.com ↗LMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)
143Qwen2-VL 72B Instruct Alibaba38±1local~34GBllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)LMArena leaderboard datasetPixtral 12B (Mistral AI, arXiv 2410.07073v2)Qwen2.5-VL-32B-Instruct model cardCapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (arXiv:2503.12329v1)Ai2 Molmo-72B-0924 model card: Human Preference Elo Rating column
144GPT-4 Turbo (2024-04-09) OpenAI38±2api $15.00/M128kdevelopers.openai.com ↗LMArena leaderboard datasetVHELM: A Holistic Evaluation of Vision Language Models (Stanford CRFM), arXiv 2410.07112v2CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs (arXiv:2406.18521v1)CharXiv leaderboard (princeton-nlp/CharXiv README)Phi-3 Technical Report (Microsoft, arXiv 2404.14219v3)
145GPT-4o mini (2024-07-18) OpenAI37±2api $0.26/M128kdevelopers.openai.com ↗LMArena leaderboard datasetOpenAI vendor-reported benchmark scores for its own models (openai.com announcement posts and Deployment Safety Hub system cards)VHELM: A Holistic Evaluation of Vision Language Models (Stanford CRFM), arXiv 2410.07112v2CharXiv leaderboard (princeton-nlp/CharXiv README)Microsoft Phi-3.5-vision-instruct model card: Benchmarks tableCapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (arXiv:2503.12329v1)+1
146Gemini 1.5 Flash-8B (001) Google36±2*comparison onlyLMArena leaderboard dataset
147CogVLM2 Llama3 Chinese Chat 19B Zhipu AI (THUDM)36±10†comparison onlyZhipu AI (THUDM) CogVLM2 model card, Benchmark table (own models)
148Qwen2.5-VL 7B Instruct Alibaba35±2local~6.4GBllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)
149Gemini 1.5 Flash (001) Google35±2comparison onlyLMArena leaderboard datasetVHELM: A Holistic Evaluation of Vision Language Models (Stanford CRFM), arXiv 2410.07112v2CharXiv leaderboard (princeton-nlp/CharXiv README)
150Qwen3-VL 2B Thinking Alibaba34±2local~2.7GB256kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)
151DeepSeek V4 Flash Vision (Exp) DeepSeek33±12*local~104GB1Mllama.cpp › How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
152Molmo 72B (0924) Ai233±2local~309GBhow to run › LMArena leaderboard datasetMolmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding (Ai2, arXiv 2601.10611v4)Pixtral 12B (Mistral AI, arXiv 2410.07073v2)Ai2 Molmo-72B-0924 model card: Human Preference Elo Rating column
153Claude 3 Opus Anthropic32±2comparison onlyLMArena leaderboard datasetVHELM: A Holistic Evaluation of Vision Language Models (Stanford CRFM), arXiv 2410.07112v2CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs (arXiv:2406.18521v1)CharXiv leaderboard (princeton-nlp/CharXiv README)Ai2 Molmo-72B-0924 model card: Human Preference Elo Rating columnPhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding (arXiv:2501.16411v2)
154Grok 4 Fast SpaceXAI (xAI)32±4*comparison onlyServiceNow-AI/Apriel-1.6-15b-Thinker model card
155Pixtral 12B (2409) Mistral30±2local~9.6GBllama.cpp › LMArena leaderboard datasetPixtral 12B (Mistral AI, arXiv 2410.07073v2)VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback? (arXiv:2608.10408v1)Ai2 Molmo-72B-0924 model card: Human Preference Elo Rating column
156Gemma 3 12B Google30±4api $0.075/M +local~9.1GB131kdeepinfra.com ↗Google DeepMind Gemma 3 270M IT model cardVisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback? (arXiv:2608.10408v1)Gemma Team — Gemma 3 Technical Report
157Llama 3.2 90B Vision Instruct Meta29±2local~58GB128kOllama › LMArena leaderboard datasetPixtral 12B (Mistral AI, arXiv 2410.07073v2)CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (arXiv:2503.12329v1)
158InternVL2-26B Shanghai AI Laboratory (OpenGVLab)29±2local~55GBhow to run › LMArena leaderboard datasetCharXiv leaderboard (princeton-nlp/CharXiv README)OpenGVLab InternVL2 model cards (InternVL2-4B and InternVL2-26B), Evaluation tablesCapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (arXiv:2503.12329v1)PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding (arXiv:2501.16411v2)
159Nova Pro Amazon29±2api $1.40/M300kdocs.aws.amazon.com ↗LMArena leaderboard datasetAmazon vendor-reported benchmark scores for its own Nova models (Amazon Science technical reports)
160Claude 3 Sonnet Anthropic29±2comparison onlyLMArena leaderboard datasetVHELM: A Holistic Evaluation of Vision Language Models (Stanford CRFM), arXiv 2410.07112v2CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs (arXiv:2406.18521v1)CharXiv leaderboard (princeton-nlp/CharXiv README)PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding (arXiv:2501.16411v2)
161Qwen2-VL 7B Instruct Alibaba29±1local~6.4GBLM Studio › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)LMArena leaderboard datasetPixtral 12B (Mistral AI, arXiv 2410.07073v2)CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (arXiv:2503.12329v1)Ai2 Molmo-72B-0924 model card: Human Preference Elo Rating column
162Nova Lite Amazon28±2*api $0.10/M300kdocs.aws.amazon.com ↗LMArena leaderboard dataset
163Ministral 3 3B Mistral27±4api $0.10/M +local~3.5GB262kdocs.mistral.ai ↗CohereLabs/North-Micro-Vision-Instruct model card (benchmark table)
164Qwen3-VL 2B Instruct Alibaba27±1local~2.7GB256kllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)CohereLabs/North-Micro-Vision-Instruct model card (benchmark table)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
165Gemma 4 E2B Google27±3api $0.050/M +local~5.1GB131kdocs.aws.amazon.com ↗CohereLabs/North-Micro-Vision-Instruct model card (benchmark table)Gemma Team — Gemma 4 Technical Report
166Qwen2.5-VL 3B Instruct Alibaba27±2local~3.5GBllama.cpp › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)
167Qwen3.5 0.8B Alibaba26±2local~2GB262kllama.cpp › Qwen/Qwen3.5-2B model cardChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats (arXiv:2606.01348v3)BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models (arXiv:2608.17895v1)How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings (arXiv:2605.07492v2)
168Claude 3 Haiku Anthropic25±2comparison onlyLMArena leaderboard datasetVHELM: A Holistic Evaluation of Vision Language Models (Stanford CRFM), arXiv 2410.07112v2CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs (arXiv:2406.18521v1)CharXiv leaderboard (princeton-nlp/CharXiv README)Pixtral 12B (Mistral AI, arXiv 2410.07073v2)Phi-3 Technical Report (Microsoft, arXiv 2404.14219v3)+2
169Aya Vision 32B Cohere25±2api price unknown +local~71GB16kdocs.cohere.com ↗LMArena leaderboard datasetKaleidoscope: In-language Exams for Massively Multilingual Vision Evaluation (arXiv:2504.07072v2)VMMU: A Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark (arXiv:2508.13680v5)
170North Micro Vision Instruct (2.4B) Cohere24±4†local~3.8GB128khow to run › CohereLabs/North-Micro-Vision-Instruct model card (benchmark table)
171Molmo 7B-D (0924) Ai224±2local~35GBhow to run › LMArena leaderboard datasetMolmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding (Ai2, arXiv 2601.10611v4)Pixtral 12B (Mistral AI, arXiv 2410.07073v2)Kaleidoscope: In-language Exams for Massively Multilingual Vision Evaluation (arXiv:2504.07072v2)Ai2 Molmo-72B-0924 model card: Human Preference Elo Rating column
172LLaVA-OneVision Qwen2 72B (ov-sft) LLaVA (lmms-lab)23±2local~155GBhow to run › LMArena leaderboard datasetCapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (arXiv:2503.12329v1)MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs (arXiv:2505.20740v3)
173Llama 3.2 11B Vision Instruct Meta22±2local~8.8GB128kOllama › LMArena leaderboard datasetPixtral 12B (Mistral AI, arXiv 2410.07073v2)
174Reka Flash 21B (2024-02-26) Reka AI22±3comparison onlyCharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs (arXiv:2406.18521v1)CharXiv leaderboard (princeton-nlp/CharXiv README)
175CogVLM2 Llama3 Chat 19B Zhipu AI (THUDM)21±2local~43GBhow to run › LMArena leaderboard datasetCapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (arXiv:2503.12329v1)Zhipu AI (THUDM) CogVLM2 model card, Benchmark table (own models)
176MiniCPM-V 2.6 OpenBMB21±2local~6.4GBllama.cpp › LMArena leaderboard datasetCharXiv leaderboard (princeton-nlp/CharXiv README)CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (arXiv:2503.12329v1)PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding (arXiv:2501.16411v2)
177InternVL2-4B Shanghai AI Laboratory (OpenGVLab)20±2local~10GBhow to run › LMArena leaderboard datasetOpenGVLab InternVL2 model cards (InternVL2-4B and InternVL2-26B), Evaluation tablesMicrosoft Phi-3.5-vision-instruct model card: Benchmarks tablePhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding (arXiv:2501.16411v2)
178LLaVA-v1.6-34B LLaVA19±2local~24GB4kOllama › LMArena leaderboard datasetCharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs (arXiv:2406.18521v1)CharXiv leaderboard (princeton-nlp/CharXiv README)CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (arXiv:2503.12329v1)LLaVA repository model zoo (haotian-liu/LLaVA docs/MODEL_ZOO.md)
179Phi-3.5-vision-instruct Microsoft16±2local~10GBhow to run › LMArena leaderboard datasetCohereLabs/North-Micro-Vision-Instruct model card (benchmark table)Microsoft Phi-3.5-vision-instruct model card: Benchmarks tableAi2 Molmo-72B-0924 model card: Human Preference Elo Rating columnPhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding (arXiv:2501.16411v2)
180Qwen2-VL 2B Instruct Alibaba14±2†local~2.8GB33kLM Studio › Qwen (Alibaba) vendor-reported benchmark scores for its own models (qwen.ai launch posts, Qwen2.5-VL and Qwen3-VL technical reports, Qwen3.8-Flash-Next card)
181Gemma 3 4B Google14±4api $0.063/M +local~3.8GB131kdeepinfra.com ↗Google DeepMind Gemma 3 270M IT model cardVisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback? (arXiv:2608.10408v1)Gemma Team — Gemma 3 Technical ReportVMMU: A Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark (arXiv:2508.13680v5)
182Phi-3-vision-128k-instruct Microsoft12±2local~10GBhow to run › LMArena leaderboard datasetCharXiv leaderboard (princeton-nlp/CharXiv README)Phi-3 Technical Report (Microsoft, arXiv 2404.14219v3)PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding (arXiv:2501.16411v2)
—Command A+ (05-2026) Coherenot yet calibratedapi price unknown +local~71GB128kdocs.cohere.com ↗Cohere vendor-reported benchmark scores for its own models (cohere.com blog)
—EXAONE 4.5 33B LG AI Researchnot scored yetlocal~24GB262kllama.cpp ›

+ 17 models with fewer than 3 results left off, since one or two tests say little about overall ability · show them

Includes 49 comparison-only models with no verified API or download · hide them

184 of 202 catalogue models listed here · sources and licences

Models outside this leaderboard (1 models)

No current run option verified: Command A Vision (07-2025)

* new or thinly tested: ranked on too few benchmark results · † only the maker’s own numbers so far · ~RAM is estimated; full context may need more memory