whatmodel.sh / GLM-4.7-Flash

GLM-4.7-Flash is an open-weights language model from Z.ai, released January 2026. Its published size is 31.2B parameters (3B active per token) and a 200k-token context window. Licence: mit.

58.8±1.3#208 of 719 LLMsfrom 10 benchmark results across 6 sources

$ how it compares

The LLMs ranked either side of GLM-4.7-Flash, out of 828 with a score, then more from Z.ai.

#modelscorewhereRAMreleased
248Gemma 2 9B IT DPO (Princeton) Princeton NLP59±1local~7.6GB2024-07
249Trinity-Large-Preview Arcee AI59±2local~155GB2026-01
250GLM-4.7-Flash Z.ai59±1api $0.0000/M +local~19GB2026-01
251EXAONE 4.0 32B LG AI Research59±1local~20GB2025-07
252Phi-4-reasoning-plus 14B Microsoft59±1local~10GB2025-04
more from Z.ai
33GLM-5.3 Z.ai76±1api $2.15/M +local~239GB2026-08
52GLM-5.3-Flash Z.ai74±1api $0.24/M +local~103GB2026-08
57GLM-5.2 Z.ai74±1api $2.15/M +local~121GB2026-06

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasksnot ranked on this task yet · 3 tests
testresultvs the others in its rundifficultycountswhy
SWE-bench Verified lab59.2% ✎▁▁▁▁▁▁▂▄█▆▁▁ beats 52/131hard · avg 19%—not counted yet: no other model in the same run to compare it with
BrowseComp lab42.8% ✎▂·▄▁▂▃▆▄█▂▃▄ beats 15/42very hard · avg 10%—not counted yet: no other model in the same run to compare it with
τ²-bench aggregate lab79.5% ✎▁▁▁·▂▂▄▃▃▅█▂ beats 22/37medium · avg 40%—not counted yet: no other model in the same run to compare it with
coding▁▁▁▃▆██▇▆▄▃▁ #339 of 458 * · 12% of its score · 3 tests

Trails Phi-3-mini-128k-instruct (Apr 2024), DeepSeek LLM 67B Chat, WizardLM 70B V1.0 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Luau Leetcode fully solved (Torpedo Software)14.9% ✎▁▃▁▁·▁▂▃▅▃█▇ beats 1/49hard · avg 18%▇▇▇▇▇ 12%at its level
SWE-bench Verified lab59.2% ✎▁▁▁▁▁▁▂▄█▆▁▁ beats 52/131hard · avg 19%—not counted yet: no other model in the same run to compare it with
LiveCodeBench v6 (window unspecified) lab64.0% ✎▂▃▄▄▅██▅▄▇▃▆ beats 28/65medium · avg 39%—not counted yet: no other model in the same run to compare it with
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #142 of 393 * · 15% of its score · 1 test

Beats INTELLECT-3, Nemotron 3 Super 120B-A12B, MiniMax-M2 here, though they rank higher overall. Trails LFM2.5 1.2B Thinking, LFM2.5 8B-A1B, LFM2.5 2.6B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
LMArena (text)1364.9 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 209/379avg 1268▇▇▇▇▇▇ 15%blunt
math▁▂▃▅▆▅▄█▄▁▁▁ #160 of 398 * · 14% of its score · 2 tests

Beats MiMo-V2.5 (310B-A15B), MiniMax-M2.7, MiniMax-M2.1 here, though they rank higher overall. Trails Olmo 3 7B Think, Qwen3-VL 4B Thinking, Granite 4.2 3B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
OTIS mock AIME 2024–202558.3% ✎▃▃▄▃▃▃▇▇█▃▂▅ beats 88/193very hard · avg 8.5%▇▇▇▇▇▇ 14%sharp · at its level · noisy
AIME 2025 lab91.6% ✎▁·▁▁▁▂▅▆█▇▅▁ beats 118/133medium · avg 42%—not counted yet: no other model in the same run to compare it with
web searchnot ranked on this task yet · 1 test
testresultvs the others in its rundifficultycountswhy
BrowseComp lab42.8% ✎▂·▄▁▂▃▆▄█▂▃▄ beats 15/42very hard · avg 10%—not counted yet: no other model in the same run to compare it with
other tests9 not in a task · 59% of its score
testresultvs the others in its rundifficultycountswhy
GPQA Diamond60.5% ✎▁▁▁▁▂▄▆▄▅▇█▅ beats 88/208hard · avg 40%▇▇▇▇▇▇▇▇▇▇▇ 27%sharp · at its level
EQ-Bench 3 (emotional intelligence, judge Elo)1151.3 ✎▁·▂▁▄▅▅▃█▄▁▁ beats 20/62avg 1044▇▇▇▇ 8.9%typical
EuroEval Life in the UK (English knowledge MC), validation split, 5-shot, accuracy94.1% ✎▂·▂▂·▂·▃▃·█▃ beats 13/14easy · avg 80%▇▇▇ 8.1%typical
RobloxQA v2.0 multiple choice (Torpedo Software)83.1% ✎▁▁▃▁█▄▃▃▆▂▂▂ beats 3/49easy · avg 78%▇▇▇ 7.4%typical
EuroEval HellaSwag (English), validation split, 5-shot generative MC, accuracy74.8% ✎▂··▂▂·▂▆▆█·▄ beats 7/15medium · avg 63%▇▇ 5.7%at its level
Chess Puzzles (Epoch)0.0% ✎█▁▁▁▁▂▁▄▂▂▁▁ beats 31/135very hard · avg 5.9%▇ 2.0%sharp · too hard for it · noisy
Vectara hallucination leaderboard (HHEM-2.3, factual consistency rate)90.7% ✎▁▂▁▂▅█▂▃▄▃▁▁ beats 51/98very easy · avg 90%▇ 0.0%blunt
GPQA (subset unspecified) lab75.2% ✎▂▁▂▂▄▃▆▃▅█▄▃ beats 87/104very hard · avg 33%—not counted yet: no other model in the same run to compare it with
1 more test
testresultvs the others in its rundifficultycountswhy
Humanity's Last Exam lab14.4% ✎▁▁▁▃▆▆▇██▆▁▃ beats 33/104very hard · avg 3.8%—not counted yet: no other model in the same run to compare it with

$ where to run it

Through an API

api · $0.0000/M · $0 in / $0 out per 1M tokens · 200k context · docs.z.ai ↗ · price sourceStandard base token rate from models.dev. Provider-specific tiers, long-context surcharges, caching and promotions may differ.

llama.cpp · recommended

version

  1. Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.
    macOS / Linux
    curl -LsSf https://llama.app/install.sh | sh
    Windows
    irm https://llama.app/install.ps1 | iex

    other ways to install ↗

  2. Run GLM-4.7-Flash · needs ~18.1 GB · from huggingface.co/lmstudio-community
    chat in the terminal
    llama cli -hf lmstudio-community/GLM-4.7-Flash-GGUF:Q4_K_M
  3. Or start a local server and open the address it prints (http://localhost:9931)
    llama serve -hf lmstudio-community/GLM-4.7-Flash-GGUF:Q4_K_M

LM Studio

version

  1. Install LM Studio · Open the app once before using the lms command.

    download it (macOS / Windows / Linux) ↗

  2. Run GLM-4.7-Flash · needs ~18.1 GB · from huggingface.co/lmstudio-community

    open in LM Studio ↗

  3. Or download it in the terminal
    lms get https://huggingface.co/lmstudio-community/GLM-4.7-Flash-GGUF@Q4_K_M -y
  4. Then run lms ls to see its name, and lms chat followed by that name

Ollama

  1. Install Ollama

    download it (macOS / Windows) ↗

    Linux
    curl -fsSL https://ollama.com/install.sh | sh
  2. Run GLM-4.7-Flash · needs ~19.22 GB · from ollama.com
    chat in the terminal
    ollama run glm-4.7-flash:q4_K_M

MLX (Mac)

version

  1. Install MLX (Mac) · Apple silicon Macs only, text only.
    with uv
    uv tool install mlx-lm
    or
    pip install mlx-lm
  2. Run GLM-4.7-Flash · needs ~16.9 GB, Mac only · from huggingface.co/lmstudio-community
    chat in the terminal
    mlx_lm.chat --model lmstudio-community/GLM-4.7-Flash-MLX-4bit
  3. Or start an OpenAI-compatible server at http://localhost:8080/v1
    mlx_lm.server --model lmstudio-community/GLM-4.7-Flash-MLX-4bit

Weights and documentation: huggingface.co/zai-org ↗

$ how the score was worked out · Epoch AI — internal evaluatio… 43%, Roblox LLM Leaderboard (Torpe… 19%, LMArena leaderboard dataset 15% and 3 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

not counted (7)

zai-org/GLM-4.7-Flash model cardAIME 2025 [correct]91.6%fewer than three models have this test yet, or this source ran it for this model alone
zai-org/GLM-4.7-Flash model cardBrowseComp [correct]42.8%fewer than three models have this test yet, or this source ran it for this model alone
zai-org/GLM-4.7-Flash model cardGPQA (subset unspecified) [correct]75.2%fewer than three models have this test yet, or this source ran it for this model alone
zai-org/GLM-4.7-Flash model cardHumanity's Last Exam [correct]14.4%fewer than three models have this test yet, or this source ran it for this model alone
zai-org/GLM-4.7-Flash model cardLiveCodeBench v6 (window unspecified) [correct]64.0%fewer than three models have this test yet, or this source ran it for this model alone
zai-org/GLM-4.7-Flash model cardSWE-bench Verified [correct]59.2%fewer than three models have this test yet, or this source ran it for this model alone
zai-org/GLM-4.7-Flash model cardτ²-bench aggregate [correct]79.5%fewer than three models have this test yet, or this source ran it for this model alone
$ published speed measurements · 14

Reference results for the hardware, engine and settings below. They aren't verified speeds of the downloads above or predictions for your machine.

NVIDIA DGX Spark (GB10)Q8_048.68 tok/sllama.cpp 11fb327bf (7941), CUDA · llama-bench; tg32; 32 generated tokens; context depth 0; n_ubatch=2048; flash attention=1; one sequence

Published token-generation mean; not prompt processing or aggregate batch throughput. Hardware core count and installed RAM are not inferred.

source ↗
NVIDIA DGX Spark (GB10)Q8_044.62 tok/sllama.cpp 11fb327bf (7941), CUDA · llama-bench; tg32 @ d4096; 32 generated tokens; context depth 4096; n_ubatch=2048; flash attention=1; one sequence

Published token-generation mean; not prompt processing or aggregate batch throughput. Hardware core count and installed RAM are not inferred.

source ↗
NVIDIA DGX Spark (GB10)Q8_032.65 tok/sllama.cpp 11fb327bf (7941), CUDA · llama-bench; tg32 @ d32768; 32 generated tokens; context depth 32768; n_ubatch=2048; flash attention=1; one sequence

Published token-generation mean; not prompt processing or aggregate batch throughput. Hardware core count and installed RAM are not inferred.

source ↗
Apple M2 Ultra (GPU core count and RAM not specified)Q8_059.58 tok/sllama.cpp b828e18c7 (7948), Metal/BLAS · llama-bench; tg32; 32 generated tokens; context depth 0; n_ubatch=2048; flash attention=1; one sequence

Published token-generation mean; not prompt processing or aggregate batch throughput. Hardware core count and installed RAM are not inferred.

source ↗
Apple M2 Ultra (GPU core count and RAM not specified)Q8_047.44 tok/sllama.cpp b828e18c7 (7948), Metal/BLAS · llama-bench; tg32 @ d4096; 32 generated tokens; context depth 4096; n_ubatch=2048; flash attention=1; one sequence

Published token-generation mean; not prompt processing or aggregate batch throughput. Hardware core count and installed RAM are not inferred.

source ↗
Apple M2 Ultra (GPU core count and RAM not specified)Q8_021.81 tok/sllama.cpp b828e18c7 (7948), Metal/BLAS · llama-bench; tg32 @ d32768; 32 generated tokens; context depth 32768; n_ubatch=2048; flash attention=1; one sequence

Published token-generation mean; not prompt processing or aggregate batch throughput. Hardware core count and installed RAM are not inferred.

source ↗
NVIDIA DGX Spark (GB10)Q8_042.59 tok/sllama.cpp 11fb327bf (7941), CUDA · llama-bench; tg32 @ d8192; 32 generated tokens; context depth 8192; n_ubatch=2048; flash attention=1; one sequence

Published token-generation mean; not prompt processing or aggregate batch throughput. Hardware core count and installed RAM are not inferred.

source ↗
NVIDIA DGX Spark (GB10)Q8_038.72 tok/sllama.cpp 11fb327bf (7941), CUDA · llama-bench; tg32 @ d16384; 32 generated tokens; context depth 16384; n_ubatch=2048; flash attention=1; one sequence

Published token-generation mean; not prompt processing or aggregate batch throughput. Hardware core count and installed RAM are not inferred.

source ↗
Apple M2 Ultra (GPU core count and RAM not specified)Q8_040.2 tok/sllama.cpp b828e18c7 (7948), Metal/BLAS · llama-bench; tg32 @ d8192; 32 generated tokens; context depth 8192; n_ubatch=2048; flash attention=1; one sequence

Published token-generation mean; not prompt processing or aggregate batch throughput. Hardware core count and installed RAM are not inferred.

source ↗
Apple M2 Ultra (GPU core count and RAM not specified)Q8_031.5 tok/sllama.cpp b828e18c7 (7948), Metal/BLAS · llama-bench; tg32 @ d16384; 32 generated tokens; context depth 16384; n_ubatch=2048; flash attention=1; one sequence

Published token-generation mean; not prompt processing or aggregate batch throughput. Hardware core count and installed RAM are not inferred.

source ↗
NVIDIA GeForce RTX 5090 (32GB; host CPU/RAM not stated)GGUF Q6_K_XL (Unsloth repository)151.3 tok/sllama.cpp (GGUF; version not stated) · Offload column: 0%; prompt-length variant not stated in Table 5 (study prompts ~16/~300/~496 tokens); fixed 256 output tokens, greedy decoding, fixed seed; two untimed warm-up generations; mean of three timed runs; generation throughput measured strictly during the decode phase

Model fully resident in GPU/unified memory as published.

source ↗
Apple M4 Pro (14-core CPU / 20-core GPU, 64GB)MLX 4-bit53.6 tok/sMLX v0.30.6 (macOS 26 Tahoe) · Offload column: 0%; prompt-length variant not stated in Table 5 (study prompts ~16/~300/~496 tokens); fixed 256 output tokens, greedy decoding, fixed seed; two untimed warm-up generations; mean of three timed runs; generation throughput measured strictly during the decode phase

Model fully resident in GPU/unified memory as published.

source ↗
Apple M3 Ultra (28-core CPU / 60-core GPU, 96GB)MLX 4-bit55 tok/sMLX v0.30.6 (macOS 26 Tahoe) · Offload column: 0%; prompt-length variant not stated in Table 5 (study prompts ~16/~300/~496 tokens); fixed 256 output tokens, greedy decoding, fixed seed; two untimed warm-up generations; mean of three timed runs; generation throughput measured strictly during the decode phase

Model fully resident in GPU/unified memory as published.

source ↗
Apple M2 Max (12-core CPU / 38-core GPU, 32GB)MLX 4-bit39.7 tok/sMLX v0.30.6 (macOS 26 Tahoe) · Offload column: 0%; prompt-length variant not stated in Table 5 (study prompts ~16/~300/~496 tokens); fixed 256 output tokens, greedy decoding, fixed seed; two untimed warm-up generations; mean of three timed runs; generation throughput measured strictly during the decode phase

Model fully resident in GPU/unified memory as published.

source ↗

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json