whatmodel.sh / GLM-4.7

GLM-4.7 is an open-weights language model from Z.ai, released December 2025. Its published size is 357B parameters (32B active per token) and a 205k-token context window. Licence: mit.

68.7±0.7#98 of 719 LLMsfrom 48 benchmark results across 11 sources

$ how it compares

The LLMs ranked either side of GLM-4.7, out of 828 with a score, then more from Z.ai.

#modelscorewhereRAMreleased
105Qwen3.5 122B-A10B Alibaba69±1api $1.10/M +local~75GB2026-02
106Gemini 3.5 Flash-Lite Google69±1api $0.85/M2026-07
107GLM-4.7 Z.ai69±1api $1.00/M +local~58GB2025-12
108GPT-5.5 Instant OpenAI69±1comparison only2026-05
109GPT-5.4 nano OpenAI69±1api $0.46/M2026-03
more from Z.ai
33GLM-5.3 Z.ai76±1api $2.15/M +local~239GB2026-08
52GLM-5.3-Flash Z.ai74±1api $0.24/M +local~103GB2026-08
57GLM-5.2 Z.ai74±1api $2.15/M +local~121GB2026-06

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #90 of 300 · 37% of its score · 11 tests

Beats Grok 4.20 (0309 reasoning), GPT-5.1, Grok 4.3 here, though they rank higher overall. Trails Hy3 preview (295B-A21B), Qwen3.6 35B-A3B, MiniMax-M2.7 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
MCP-Atlas (public set) lab +152.0% ✎▄······▄▄▄▄█ beats 0/6hard · avg 25%▇▇ 5.9%at its level · several runs
SWE-bench Verified lab +173.8% ✎▁▁▁▁▁▁▂▄█▆▁▁ beats 94/131hard · avg 25%▇▇ 5.0%sharp · at its level · small run · several runs
Terminal-Bench 2.0 lab +141.0% ✎▂▂▅▅████▆▂▃▃ beats 14/36very hard · avg 8.4%▇▇ 4.0%at its level · small run · several runs
τ²-bench aggregate lab +187.4% ✎▁▁▁·▂▂▄▃▃▅█▂ beats 34/37medium · avg 48%▇▇ 3.8%small run · several runs
BrowseComp-ZH lab +166.6% ✎▁▁▁▁▁▃·▁▄▅▄█ beats 18/23hard · avg 22%▇▇ 3.8%at its level · small run · several runs
SWE-bench Multilingual lab +166.7% ✎▁··▁▃▂▅▇█▃▃▁ beats 26/60hard · avg 28%▇ 3.2%at its level · small run · several runs
BrowseComp lab +152.0% ✎▂·▄▁▂▃▆▄█▂▃▄ beats 20/42hard · avg 18%▇ 3.0%at its level · small run · several runs
Terminal-Bench Hard lab33.3% ✎▂▅▆▂▂▆▂▂█▅▅▂ beats 22/27very hard · avg 4.5%▇ 2.7%sharp · at its level · small run
3 more tests
testresultvs the others in its rundifficultycountswhy
Humanity's Last Exam with tools lab +142.8% ✎▂▂▂▁▄▂▃▆█▇▂▆ beats 19/54hard · avg 16%▇ 2.2%at its level · small run · several runs
BrowseComp with context management lab +167.5% ✎▅·▅▃·█▃·█▅·▃ beats 3/14medium · avg 41%▇ 2.1%at its level · small run · several runs
Toolathlon (Tool Decathlon) lab23.8% ✎▂▃▄▂▄▄▆▂█▆██ beats 1/27very hard · avg 11%▇ 1.0%at its level · small run
coding▁▁▁▃▆██▇▆▄▃▁ #74 of 458 · 17% of its score · 4 tests

Beats GPT-5.2, GPT-5, Grok 4.20 (0309 reasoning) here, though they rank higher overall.

testresultvs the others in its rundifficultycountswhy
Arena WebDev (Code Arena)1434.5 ✎▁▂▄▃▅█▄▇▆▄▁▁ beats 54/119avg 981▇▇▇ 7.3%sharp
SWE-bench Verified lab +173.8% ✎▁▁▁▁▁▁▂▄█▆▁▁ beats 94/131hard · avg 25%▇▇ 5.0%sharp · at its level · small run · several runs
SWE-bench Multilingual lab +166.7% ✎▁··▁▃▂▅▇█▃▃▁ beats 26/60hard · avg 28%▇ 3.2%at its level · small run · several runs
LiveCodeBench v6 (window unspecified) lab84.9% ✎▂▃▄▄▅██▅▄▇▃▆ beats 51/65medium · avg 47%▇ 1.9%small run
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #62 of 393 * · 4.1% of its score · 1 test

Beats GPT-5.2, Qwen3.8 27B, LongCat 2.0 (1.6T-A48B) here, though they rank higher overall. Trails Gemma 4 31B, Gemini 2.5 Pro, Claude Sonnet 4.5 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
LMArena (text)1441.5 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 301/379avg 1268▇▇ 4.1%blunt
math▁▂▃▅▆▅▄█▄▁▁▁ #55 of 398 · 16% of its score · 7 tests

Beats LongCat 2.0 (1.6T-A48B), Qwen3.6 Max Preview, Claude Sonnet 4.6 here, though they rank higher overall. Trails INTELLECT-3 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
IMO-AnswerBench lab +182.0% ✎▁▁·▁▁▁▄▅█▄▂▃ beats 27/42medium · avg 37%▇▇ 4.3%small run · several runs
HMMT February 2025 lab +197.1% ✎▁▁▁▃▁▅▅▃██▃▄ beats 28/31easy · avg 77%▇ 3.5%maxed out · small run · several runs
AIME 2025 lab95.7% ✎▁·▁▁▁▂▅▆█▇▅▃ beats 130/133medium · avg 62%▇ 2.8%sharp · maxed out · small run
HMMT November 2025 lab +193.5% ✎▁▁····▁▅▃█▇▁ beats 18/23easy · avg 74%▇ 2.4%maxed out · small run · several runs
OTIS mock AIME 2024–202583.3% ✎▃▃▄▃▃▃▇▇█▃▂▅ beats 120/193very hard · avg 8.5%▇ 2.4%sharp · noisy
FormalProofBench (200 graduate-level Lean 4 problems, agentic)4.5% ✎▃▅·▃··▅▃█··▃ beats 2/10very hard · avg 3.0%▇ 0.7%noisy
AIME 2026 I lab92.9% ✎█··········█ beats 1/1—not counted yet: no other model in the same run to compare it with
web search▂▁▂▆▄█▃▃▁▁·▁ #68 of 80 · 11% of its score · 4 tests

Beats DeepSeek V4 Flash (Preview, Apr 2026), Nemotron 3 Ultra 550B-A55B here, though they rank higher overall. Trails GPT-4.1 nano, GPT-4o mini (2024-07-18), Mistral Small 3.1 24B (2503) here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
BrowseComp-ZH lab +166.6% ✎▁▁▁▁▁▃·▁▄▅▄█ beats 18/23hard · avg 22%▇▇ 3.8%at its level · small run · several runs
BrowseComp lab +152.0% ✎▂·▄▁▂▃▆▄█▂▃▄ beats 20/42hard · avg 18%▇ 3.0%at its level · small run · several runs
Humanity's Last Exam with tools lab +142.8% ✎▂▂▂▁▄▂▃▆█▇▂▆ beats 19/54hard · avg 16%▇ 2.2%at its level · small run · several runs
BrowseComp with context management lab +167.5% ✎▅·▅▃·█▃·█▅·▃ beats 3/14medium · avg 41%▇ 2.1%at its level · small run · several runs
other tests13 not in a task · 34% of its score
testresultvs the others in its rundifficultycountswhy
GPQA Diamond +283.3% ✎▁▁▁▁▂▄▆▄▅▇█▅ beats 137/208hard · avg 40%▇▇▇▇▇ 12%sharp · several runs
Humanity's Last Exam lab +124.8% ✎▁▁▁▃▆▆▇██▆▁▃ beats 58/104very hard · avg 4.9%▇ 3.6%small run · several runs
Medmarks-V weighted mean win rate (61 models, 71 configurations)62.0% ✎▂▃▅▂▆▃█▅█▅▃▆ beats 31/34medium · avg 42%▇ 2.9%blunt · at its level
EQ-Bench 3 (emotional intelligence, judge Elo)1271.3 ✎▁·▂▁▄▅▅▃█▄▁▁ beats 39/62avg 1044▇ 2.5%typical
Chess Puzzles (Epoch)6.0% ✎█▃▁▁▁▂▁▄▂▂▁▁ beats 47/135very hard · avg 5.9%▇ 2.0%sharp · noisy
ResearchRubrics62.0% ✎███··██·█··█ beats 5/6hard · avg 31%▇ 1.9%at its level
LongBench v2 lab59.1% ✎▂·▁·▂▂▁▃▄▁█▄ beats 19/28very hard · avg 35%▇ 1.9%at its level · small run
RPC-Bench overall, text input (Z.ai) lab28.8% ✎▄··▄▄·▄▄█·▄▄ beats 3/8very hard · avg 11%▇ 1.8%at its level
5 more tests
testresultvs the others in its rundifficultycountswhy
MMLU-Pro lab84.3% ✎▁▁·▁▁▁▃▂▄▅█▁ beats 163/188medium · avg 56%▇ 1.6%small run
SimpleQA Verified32.2% ✎▁▁▃▂▃▃▆▆█▃▂▅ beats 22/78very hard · avg 8.0%▇ 1.5%at its level
GAIA (no-file subset)61.9% ✎▃▃····█▃···▃ beats 0/6medium · avg 47%▇ 1.0%at its level
CyberGym lab23.5% ✎▄···▄··▄█▄█▄ beats 0/8hard · avg 19%▇ 0.9%at its level · small run
Vectara hallucination leaderboard (HHEM-2.3, factual consistency rate)88.3% ✎▁▂▁▂▅█▂▃▄▃▁▁ beats 29/98very easy · avg 90%▇ 0.0%blunt

$ where to run it

Through an API

api · $1.00/M · $0.6 in / $2.2 out per 1M tokens · 205k context · docs.z.ai ↗ · price sourceStandard base token rate from models.dev. Provider-specific tiers, long-context surcharges, caching and promotions may differ.

llama.cpp · recommended

version

  1. Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.
    macOS / Linux
    curl -LsSf https://llama.app/install.sh | sh
    Windows
    irm https://llama.app/install.ps1 | iex

    other ways to install ↗

  2. Run GLM-4.7 · needs ~214.7 GB · from huggingface.co/unsloth
    chat in the terminal
    llama cli -hf unsloth/GLM-4.7-GGUF:UD-Q4_K_XL
  3. Or start a local server and open the address it prints (http://localhost:9931)
    llama serve -hf unsloth/GLM-4.7-GGUF:UD-Q4_K_XL

LM Studio

version

  1. Install LM Studio · Open the app once before using the lms command.

    download it (macOS / Windows / Linux) ↗

  2. Run GLM-4.7 · needs ~214.7 GB · from huggingface.co/unsloth

    open in LM Studio ↗

  3. Or download it in the terminal
    lms get https://huggingface.co/unsloth/GLM-4.7-GGUF@UD-Q4_K_XL -y
  4. Then run lms ls to see its name, and lms chat followed by that name

MLX (Mac)

version

  1. Install MLX (Mac) · Apple silicon Macs only, text only.
    with uv
    uv tool install mlx-lm
    or
    pip install mlx-lm
  2. Run GLM-4.7 · needs ~198.6 GB, Mac only · from huggingface.co/mlx-community
    chat in the terminal
    mlx_lm.chat --model mlx-community/GLM-4.7-4bit
  3. Or start an OpenAI-compatible server at http://localhost:8080/v1
    mlx_lm.server --model mlx-community/GLM-4.7-4bit

Weights and documentation: huggingface.co/zai-org ↗

$ how the score was worked out · zai-org/GLM-4.7 model card 32%, GLM-5 Team (Zhipu AI) — GLM-5… 19%, zai-org/GLM-5 model card 15% and 8 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

not counted (1)

zai-org/GLM-5 model cardAIME 2026 I [correct]92.9%fewer than three models have this test yet, or this source ran it for this model alone

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json