whatmodel.sh / Qwen2-VL 72B Instruct

Qwen2-VL 72B Instruct is an open-weights language model from Alibaba, released September 2024. Its published size is 73.4B parameters. Licence: tongyi-qianwen.

Catalogue identity notes

Comparison-only. Arena entry 'qwen2-vl-72b' (vision). LMArena's leaderboard table (arena-leaderboard space @6f2eeeb) labels 'qwen2-vl-72b' as 'Qwen2-VL-72b-Instruct' (Alibaba, Qwen), linking https://qwenlm.github.io/zh/blog/qwen2-vl/. Maker repo Qwen/Qwen2-VL-72B-Instruct @2ac26c9: licence tag other (tongyi-qianwen). 73,405,560,320 parameters from the Hugging Face safetensors metadata (dense, so active = total). Released 2024-09: month the maker's Hugging Face repo was created (createdAt 2024-09-17). Arena key 'qwen2-vl-72b'; LMArena's table labels it 'Qwen2-VL-72b-Instruct'.

53.2±1.0#294 of 719 LLMsfrom 29 benchmark results across 6 sources

$ how it compares

The LLMs ranked either side of Qwen2-VL 72B Instruct, out of 828 with a score, then more from Alibaba.

#modelscorewhereRAMreleased
349GLM-4 9B Chat 1M Zhipu AI (THUDM)53±5local~8.1GB2024-06
350Mistral Small 3 24B (2501) Mistral53±1local~16GB2025-01
351Qwen2-VL 72B Instruct Alibaba53±1local~34GB2024-09
352Gemini 1.5 Flash Experimental (0827) Google53±1comparison only2024-08
353GPT-4o mini (2024-07-18) OpenAI53±0api $0.26/M2024-07
more from Alibaba
18Qwen3.8 Max (2.4T-A95B) Alibaba78±1api $3.00/M +local~380GB2026-08
34Qwen3.8 Max (0902) Alibaba76±1api $3.00/M2026-09
37Qwen3.8-Flash-Next Alibaba75±1local~59GB2026-08

see all LLMs · find the ones that fit your machine

$ what it's good at

math▁▂▃▅▆▅▄█▄▁▁▁ #246 of 398 · 17% of its score · 2 tests

Beats GPT-4o (2024-11-20), GPT-4 Turbo (2024-04-09), Molmo 2 8B here, though they rank higher overall. Trails DeepSeek R1 Distill Qwen 1.5B, Tulu 2 DPO 70B, OpenThinker 7B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
MathVista (testmini) lab +170.5% ✎▃··▃▅·▃█▅▅▅█ beats 5/16medium · avg 69%▇▇▇▇▇ 12%at its level · several runs
MATH-Vision lab25.9% ✎▁▁·▃··▄▁▃▇▇█ beats 2/24hard · avg 27%▇▇ 5.1%at its level · small run
vision & documents▁▁▃▂▁▃▄▂▆▇█▄ #116 of 147 · 87% of its score · 18 tests

Beats DeepSeek V4 Flash Vision (Exp), GPT-4 Turbo (2024-04-09) here, though they rank higher overall. Trails Qwen3.5 2B, Qwen3-VL 4B Instruct, Gemma 4 E4B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
MMMU (val) lab +164.5% ✎▂···▆▂▂▃▄▄▄█ beats 6/16medium · avg 61%▇▇▇▇▇▇ 16%at its level · several runs
MathVista (testmini) lab +170.5% ✎▃··▃▅·▃█▅▅▅█ beats 5/16medium · avg 69%▇▇▇▇▇ 12%at its level · several runs
MMStar lab +168.3% ✎▂··▄▂▂·▄█▂▄▆ beats 6/16medium · avg 65%▇▇▇▇▇ 11%at its level · several runs
MMMU Pro lab +146.2% ✎▃·█·▅▃▃▃▅▅▃█ beats 6/16medium · avg 46%▇▇▇▇ 11%at its level · several runs
Arena vision (style controlled)1084.8 ✎▁▁▂▂▂▃▄▅▅▆██ beats 27/145avg 1068▇▇ 5.8%blunt
MATH-Vision lab25.9% ✎▁▁·▃··▄▁▃▇▇█ beats 2/24hard · avg 27%▇▇ 5.1%at its level · small run
CapArena-Auto detailed image captioning (Score_Avg, GPT-4o judge)-9.0000 ✎▃▃▃·▃█·▅▃▃▃▃ beats 5/12avg -0.671▇▇ 3.9%typical
DocVQA lab +196.5% ✎▃··▅▃▅▃█▃█▅▅ beats 14/17very easy · avg 94%▇ 3.6%blunt · maxed out · several runs
10 more tests
testresultvs the others in its rundifficultycountswhy
HallusionBench lab58.1% ✎▃·▃·▅▃▅▅▃▅█▅ beats 8/16medium · avg 55%▇ 3.5%blunt · at its level
ChartQA lab +188.3% ✎▂··▂·▂▃·▅▃▆█ beats 8/17easy · avg 85%▇ 2.9%blunt · several runs
MM-MT-Bench (Mistral, GPT-4o judge)6.5900 MM-MT-Bench score (1-10) ✎▅··▃·█·▃▃··▅ beats 7/9avg 5.740 MM-MT-Bench score (1-10)▇ 2.9%sharp · noisy
InfographicVQA lab84.5% ✎▃·▃▅█▃▃▃▃▃▃▃ beats 10/13easy · avg 80%▇ 2.6%small run
RealWorldQA lab77.8% ✎▅▃·▃▅▅·█·▃▅█ beats 13/16easy · avg 70%▇ 2.5%blunt · at its level
VQAv2 (val)81.6% ✎▃···█▃··▅▃▃▃ beats 9/9easy · avg 74%▇ 1.5%blunt
Ai2 Molmo human preference Elo (Sept 2024, 27 VLMs)1037.0 ✎▄▄·▄·▄▄▄·▄·█ beats 5/8avg 1037▇ 0.9%blunt
OCRBench lab87.7% ✎▅█·▃▃█▃▅▅▃·▃ beats 10/16easy · avg 84%▇ 0.9%blunt
CC-OCR lab68.7% ✎▁·▃··▂▂▃▃▂▆█ beats 2/26easy · avg 72%▇ 0.7%blunt · at its level · small run
TextVQA lab85.5% ✎█······▄·▄▄▄ beats 5/5easy · avg 80%▇ 0.5%blunt
other tests3 not in a task · 13% of its score
testresultvs the others in its rundifficultycountswhy
Video-MME (without subtitles) lab +171.2% ✎▃··█··▅█▃▃▅▃ beats 6/13medium · avg 66%▇▇▇ 6.4%blunt · at its level · several runs
Video-MME (with subtitles) lab +177.8% ✎▁▁▁▁▁·▁▃▁▁▁█ beats 6/16medium · avg 73%▇▇ 4.5%at its level · small run · several runs
MVBench lab73.6% ✎▂▂▂·▂█··▆▄·▂ beats 12/13medium · avg 67%▇ 2.0%blunt · at its level

$ where to run it

llama.cpp · recommended

version

  1. Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.
    macOS / Linux
    curl -LsSf https://llama.app/install.sh | sh
    Windows
    irm https://llama.app/install.ps1 | iex

    other ways to install ↗

  2. Run Qwen2-VL 72B Instruct · needs ~48.82 GB · from huggingface.co/bartowski
    chat in the terminal
    llama cli -hf bartowski/Qwen2-VL-72B-Instruct-GGUF:Q4_K_M
  3. Or start a local server and open the address it prints (http://localhost:9931)
    llama serve -hf bartowski/Qwen2-VL-72B-Instruct-GGUF:Q4_K_M

LM Studio

version

  1. Install LM Studio · Open the app once before using the lms command.

    download it (macOS / Windows / Linux) ↗

  2. Run Qwen2-VL 72B Instruct · needs ~48.82 GB · from huggingface.co/bartowski

    open in LM Studio ↗

  3. Or download it in the terminal
    lms get https://huggingface.co/bartowski/Qwen2-VL-72B-Instruct-GGUF@Q4_K_M -y
  4. Then run lms ls to see its name, and lms chat followed by that name

Ollama

  1. Install Ollama

    download it (macOS / Windows) ↗

    Linux
    curl -fsSL https://ollama.com/install.sh | sh
  2. Run Qwen2-VL 72B Instruct · needs ~31.21 GB · from huggingface.co/bartowski
    chat in the terminal
    ollama run hf.co/bartowski/Qwen2-VL-72B-Instruct-GGUF:Q2_K

MLX (Mac)

version

  1. Install MLX (Mac) · Apple silicon Macs only, text only.
    with uv
    uv tool install mlx-lm
    or
    pip install mlx-lm
  2. Run Qwen2-VL 72B Instruct · needs ~41.3 GB, Mac only · from huggingface.co/mlx-community
    chat in the terminal
    mlx_lm.chat --model mlx-community/Qwen2-VL-72B-Instruct-4bit
  3. Or start an OpenAI-compatible server at http://localhost:8080/v1
    mlx_lm.server --model mlx-community/Qwen2-VL-72B-Instruct-4bit

Official weights and documentation: huggingface.co/Qwen ↗

$ how the score was worked out · Qwen (Alibaba) vendor-reporte… 69%, Qwen2.5-VL-32B-Instruct model… 11%, Pixtral 12B (Mistral AI, arXi… 9% and 3 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json