whatmodel.sh / Qwen3.7 Plus

Qwen3.7 Plus is a closed-weights language model from Alibaba, released June 2026.

72.1±0.7#66 of 719 LLMsfrom 33 benchmark results across 6 sources

$ how it compares

The LLMs ranked either side of Qwen3.7 Plus, out of 828 with a score, then more from Alibaba.

#modelscorewhereRAMreleased
69DeepSeek V4 Pro (Preview, Apr 2026) DeepSeek72±1local~604GB2026-04
70Claude Opus 4.5 Anthropic72±1api $10.00/M2025-11
71Qwen3.7 Plus Alibaba72±1api $0.70/M2026-06
72Kimi K2.7 Code Moonshot AI72±1api $1.71/M +local~359GB2026-06
73DeepSeek V4 Flash (Preview, Apr 2026) DeepSeek72±1local~103GB2026-04
more from Alibaba
18Qwen3.8 Max (2.4T-A95B) Alibaba78±1api $3.00/M +local~380GB2026-08
34Qwen3.8 Max (0902) Alibaba76±1api $3.00/M2026-09
37Qwen3.8-Flash-Next Alibaba75±1local~59GB2026-08

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #60 of 300 · 22% of its score · 7 tests

Beats Gemini 3.6 Flash, GPT-5 Pro, LongCat 2.0 (1.6T-A48B) here, though they rank higher overall. Trails MiniMax-M3, GLM-5.1 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Arena Agent (October 2026 aggregate IPS)-0.0715 IPS ✎▁▁▁▄▂▃▇█▂▂▁▃ beats 7/49avg -0.312 IPS▇▇▇ 8.3%sharp
SWE-bench Pro public set, Qwen-refined lab +157.6% ✎▂·····▂·▂█▃▅ beats 9/12hard · avg 18%▇▇ 4.3%at its level · several runs
Terminal-Bench 2.1 lab64.0% ✎▁·▁·▁▁▄▃▄█▃▇ beats 27/56hard · avg 16%▇ 2.9%at its level · small run
SWE-bench Multilingual lab75.8% ✎▁··▁▃▂▅▇█▃▃▁ beats 43/60hard · avg 29%▇ 2.7%at its level
OSWorld-Verified lab73.3% ✎█▄·▂▆▂▄▂▆▄▆█ beats 14/25hard · avg 27%▇ 1.7%at its level · small run
WebArena-Verified lab55.3% ✎█···█······█ beats 1/2hard · avg 22%▇ 1.1%at its level · small run
DeepSWE v1.1 (resolved) lab16.5% ✎▃····▁▁▁▆██▆ beats 0/28hard · avg 15%▇ 0.7%at its level · noisy
coding▁▁▁▃▆██▇▆▄▃▁ #48 of 458 · 12% of its score · 4 tests

Beats GPT-5.4, DeepSeek V4 Flash Vision (Exp), Gemini 3.1 Pro (Preview) here, though they rank higher overall. Trails Mistral Large 4 (public preview) here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
LiveCodeBench v6 (window unspecified) lab +189.6% ✎▃▅█▅▅▃▅···▃█ beats 13/16medium · avg 46%▇▇ 4.6%small run · several runs
SWE-bench Pro public set, Qwen-refined lab +157.6% ✎▂·····▂·▂█▃▅ beats 9/12hard · avg 18%▇▇ 4.3%at its level · several runs
SWE-bench Multilingual lab75.8% ✎▁··▁▃▂▅▇█▃▃▁ beats 43/60hard · avg 29%▇ 2.7%at its level
DeepSWE v1.1 (resolved) lab16.5% ✎▃····▁▁▁▆██▆ beats 0/28hard · avg 15%▇ 0.7%at its level · noisy
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #47 of 393 * · 4.1% of its score · 1 test

Beats MiMo-V2.6-Flash (309B-A15B), GPT-6 Luna, GPT-5.6 Luna here, though they rank higher overall. Trails Claude Sonnet 4.5, MiMo-V2.5-Pro (1T-A42B), GLM-5 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
LMArena (text)1455.8 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 323/379avg 1268▇▇ 4.1%blunt
math▁▂▃▅▆▅▄█▄▁▁▁ #78 of 398 * · 22% of its score · 2 tests

Beats Claude Sonnet 4.6, Claude Opus 4.5 here, though they rank higher overall. Trails Granite 4.2 30B, INTELLECT-3, EXAONE 4.5 33B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
FrontierMath tiers 1–3 v234.4% ✎▂··▁▁▃▄▄█▅▃▃ beats 24/82very hard · avg 1.2%▇▇▇▇▇▇▇▇ 20%sharp · at its level
OTIS mock AIME 2024–202593.3% ✎▃▃▄▃▃▃▇▇█▃▂▅ beats 154/193very hard · avg 8.5%▇ 1.4%sharp · noisy
vision & documents▁▁▃▂▁▃▄▂▆▇█▄ #27 of 147 · 15% of its score · 7 tests

Beats Claude Sonnet 5.5, MiMo-V2.6-Pro, GPT-5.6 Terra here, though they rank higher overall.

testresultvs the others in its rundifficultycountswhy
CharXiv (reasoning questions) lab +184.4% ✎▄▂▄▆▄▄▆··▄█▂ beats 19/21medium · avg 39%▇▇▇ 6.8%several runs
Arena vision (style controlled)1265.5 ✎▁▁▂▂▂▂▄▅▅▆██ beats 115/145avg 1068▇ 2.8%blunt
SciDocBench scientific-document workflows (overall, 496 instances)55.9% ✎▃▃···█▃▅▃·▃▅ beats 8/11hard · avg 26%▇ 1.4%blunt · at its level
Arena document (style controlled)1452.5 ✎▁▁▃▃▄▃▇█▅▇▄▅ beats 13/37avg 1335▇ 1.4%blunt
OmniDocBench 1.5 overall (higher is better) lab91.4% ✎▂··▂▂▂··▂▂█▅ beats 13/13easy · avg 69%▇ 1.3%small run
SpaceCast-Bench predictive spatial reasoning (overall, 16 task types)55.3% ✎▃·▅▃▅▃··▅··█ beats 9/11very hard · avg 32%▇ 0.4%blunt · at its level · noisy
RealWorldQA lab86.9% ✎▂▃▂█▃██▆█▂▆▆ beats 38/38easy · avg 72%▇ 0.4%blunt · small run
other tests8 not in a task · 33% of its score
testresultvs the others in its rundifficultycountswhy
GPQA Diamond +287.9% ✎▁▁▁▁▂▄▆▄▅▇█▅ beats 161/208hard · avg 41%▇▇▇▇▇▇ 15%sharp · several runs
Humanity's Last Exam lab +134.7% ✎▁▁▁▃▆▆▇██▆▁▃ beats 81/104very hard · avg 5.1%▇▇ 5.0%at its level · several runs
Mystery Game Puzzles (Epoch)17.0% ✎█··▂▃▇▄█▂▃▁▁ beats 28/74very hard · avg 9.4%▇ 3.6%sharp · noisy
IFBench (aggregation unspecified) lab +179.1% ✎▃▇▂▄▅▅▂▄▄▆█▇ beats 72/80medium · avg 42%▇ 3.2%several runs
Chess Puzzles (Epoch)24.0% ✎█▁▁▁▁▂▁▄▂▂▁▁ beats 93/135very hard · avg 5.9%▇ 2.7%sharp · noisy
NL2Repo lab41.1% ✎▂▂·▂▂▄█▆▆▂▄▆ beats 10/21very hard · avg 9.6%▇ 2.0%at its level · small run
ERQA lab69.8% ✎▃··▃··█·▃█▅▅ beats 12/12hard · avg 35%▇ 1.1%at its level · small run
AndroidWorld lab81.0% ✎▁·▁▁▂▃█▅▂▂·▃ beats 23/24medium · avg 46%▇ 0.9%blunt · at its level · small run

$ where to run it

Through an API

api · Alibaba Cloud Model Studio · $0.70/M · $0.4 in / $1.6 out per 1M tokens · 1M context · www.alibabacloud.com ↗ · price sourceUSD per 1M tokens, Singapore (International), qwen3.7-plus, ≤256K input tier list price (a limited-time 20% discount is also advertised and not applied); 256K–1M input tier priced higher. Observed 2026-09-25.

$ how the score was worked out · Epoch AI — internal evaluatio… 32%, Qwen/Qwen3.8-27B model card 26%, Qwen (Alibaba) vendor-reporte… 23% and 3 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json