whatmodel.sh / DeepSeek V4 Flash (0731)

DeepSeek V4 Flash (0731) is an open-weights language model from DeepSeek, released July 2026. Its published size is 284B parameters (13B active per token) and a 1M-token context window. Licence: mit.

74.1±0.6#47 of 719 LLMsfrom 40 benchmark results across 8 sources

$ how it compares

The LLMs ranked either side of DeepSeek V4 Flash (0731), out of 828 with a score, then more from DeepSeek.

#modelscorewhereRAMreleased
48Claude Opus 4.6 Anthropic75±1api $10.00/M2026-02
49GPT-5.3-Codex OpenAI74±1api $4.81/M2026-02
50DeepSeek V4 Flash (0731) DeepSeek74±1api $0.11/M +local~92GB2026-07
51Qwen3.7 Max Alibaba74±1api $3.75/M2026-05
52GLM-5.3-Flash Z.ai74±1api $0.24/M +local~103GB2026-08
more from DeepSeek
21DeepSeek V4.1 Flash DeepSeek78±1api $0.26/M +local~537GB2026-09
31DeepSeek V4 Pro (0813) DeepSeek76±1api $1.63/M +local~1010GB2026-08
35DeepSeek V3.2 Speciale DeepSeek76±3comparison only

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #43 of 300 · 17% of its score · 9 tests

Beats Gemini 3.1 Pro (Preview), Muse Spark 1.2, Muse Spark 1.1 here, though they rank higher overall. Trails GLM-5.2, GLM-5.3-Flash here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Terminal-Bench 2.1 lab +182.7% ✎▁·▁·▁▁▄▃▄█▃▇ beats 42/56hard · avg 26%▇▇ 4.9%small run · several runs
GameLogicBench solve rate (72 Godot game-logic tasks, Claude Code scaffold)31.9% ✎█▄·█·▄·██▄·▄ beats 5/11very hard · avg 4.7%▇ 2.7%at its level
Terminal-Bench 4.0 lab7.0% ✎▁·▁··▃▇▇▅██▃ beats 2/30very hard · avg 0.3%▇ 2.5%sharp · small run
DeepSWE v1.1 (resolved) lab +154.4% ✎▂····▁▁▃▆██▆ beats 4/28hard · avg 21%▇ 2.0%at its level · small run · several runs
Toolathlon-Verified lab +170.3% ✎▂·▂▂▅▃···▃██ beats 8/18hard · avg 33%▇ 1.3%blunt · at its level · small run · several runs
Humanity's Last Exam with tools lab51.5% ✎▂▂▂▁▄▂▃▆█▇▂▆ beats 32/54hard · avg 17%▇ 1.2%at its level · small run
Agents' Last Exam (pass@1, official scaffold) lab25.2% ✎█··········▄ beats 0/2very hard · avg 6.2%▇ 0.9%at its level · small run
Agents' Last Exam (metric/harness unspecified) lab25.2% ✎▂·▂·█▂···▂▄▄ beats 2/11very hard · avg 7.1%▇ 0.8%at its level · small run
1 more test
testresultvs the others in its rundifficultycountswhy
Terminal-Bench 3.0 lab7.6% ✎█··█·······█ beats 0/2very hard · avg 2.1%▇ 0.5%noisy · small run
coding▁▁▁▃▆██▇▆▄▃▁ #33 of 458 · 14% of its score · 4 tests

Beats GPT-5.5, GPT-5.6 Terra, Claude Opus 4.8 here, though they rank higher overall. Trails Qwen3.8 27B, GLM-5.2, GLM-5.3-Flash here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Arena WebDev (Code Arena)1581.0 ✎▁▂▄▃▅█▄▇▆▄▁▁ beats 90/119avg 981▇▇▇ 6.4%sharp
GameLogicBench solve rate (72 Godot game-logic tasks, Claude Code scaffold)31.9% ✎█▄·█·▄·██▄·▄ beats 5/11very hard · avg 4.7%▇ 2.7%at its level
Luau Leetcode fully solved (Torpedo Software)77.9% ✎▁▁▁▁·▁▂▃▅▃█▇ beats 29/49hard · avg 18%▇ 2.6%at its level
DeepSWE v1.1 (resolved) lab +154.4% ✎▂····▁▁▃▆██▆ beats 4/28hard · avg 21%▇ 2.0%at its level · small run · several runs
math▁▂▃▅▆▅▄█▄▁▁▁ #39 of 398 · 33% of its score · 4 tests

Beats Grok 4.7 here, though they rank higher overall. Trails GPT-5.2, Qwen3.7 Max here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
FrontierMath tiers 1–3 v257.5% ✎▂··▁▁▃▄▄█▅▃▃ beats 44/82very hard · avg 1.2%▇▇▇▇▇▇▇ 17%sharp · at its level
FrontierMath tier 4 v224.4% ✎▁▂▁▂█▅▂▂▁▁▁▁ beats 26/63very hard · avg 0.1%▇▇▇▇▇ 13%sharp · at its level
MathArena Apex (pass@1) lab58.6% ✎▄····▄···▄█▄ beats 2/5very hard · avg 15%▇ 1.6%at its level · small run
OTIS mock AIME 2024–202594.4% ✎▃▃▄▃▃▃▇▇█▃▂▅ beats 159/193very hard · avg 8.5%▇ 0.8%sharp · maxed out · noisy
web search██·········█ #3 of 3 * · 1.2% of its score · 1 test
testresultvs the others in its rundifficultycountswhy
Humanity's Last Exam with tools lab51.5% ✎▂▂▂▁▄▂▃▆█▇▂▆ beats 32/54hard · avg 17%▇ 1.2%at its level · small run
other tests18 not in a task · 41% of its score
testresultvs the others in its rundifficultycountswhy
GPQA Diamond +191.0% ✎▁▁▁▁▂▄▆▄▅▇█▅ beats 182/208hard · avg 39%▇▇▇ 7.2%sharp · small run · several runs
KMMLU-HARD (Daekeun Kim, zero-shot)74.2% ✎█···▁▁▁▂▃·▆▂ beats 17/23very hard · avg 29%▇▇ 4.7%sharp · at its level
Mystery Game Puzzles (Epoch)34.0% ✎█··▂▃▇▄█▂▃▁▁ beats 53/74very hard · avg 9.4%▇▇ 4.1%sharp · noisy
NL2Repo lab +154.2% ✎▂▂·▂▂▄█▆▆▂▄▆ beats 17/21very hard · avg 13%▇ 3.1%at its level · small run · several runs
Chess Puzzles (Epoch)33.0% ✎█▁▁▁▁▂▁▄▃▂▁▁ beats 109/135very hard · avg 5.9%▇ 2.8%sharp · noisy
CyberGym lab +176.7% ✎▄···▄··▄█▄█▄ beats 4/8medium · avg 36%▇ 2.2%small run · several runs
KoBALT-700 (Daekeun Kim)73.3% ✎▄▄█·····▄··▄ beats 0/5hard · avg 37%▇ 2.1%at its level
CLIcK Korean (Daekeun Kim)90.6% ✎▆▄▄▄█▄▂·▄█·▄ beats 17/23medium · avg 58%▇ 2.0%typical
10 more tests
testresultvs the others in its rundifficultycountswhy
Humanity's Last Exam lab37.8% ✎▁▁▁▃▆▆▇██▆▁▃ beats 87/104very hard · avg 5.3%▇ 1.9%at its level · small run
KMMLU-Pro (Daekeun Kim)79.2% ✎▄·▄█·····▄·▄ beats 0/5medium · avg 40%▇ 1.9%typical
AutomationBench (Public) lab +125.1% ✎█··········█ beats 0/1very hard · avg 6.2%▇ 1.5%at its level · small run · several runs
HAE-RAE 1.0 (Daekeun Kim)91.9% ✎▄▄▄▂▂█▂▄▂█▂▄ beats 17/22medium · avg 63%▇ 1.5%maxed out
SimpleQA Verified33.6% ✎▁▁▃▂▃▃▆▆█▃▂▅ beats 25/78very hard · avg 8.0%▇ 1.4%at its level
SEC-Bench Pro (pass@1) lab30.9% ✎▄··▄···▄·▄·█ beats 1/5very hard · avg 7.2%▇ 1.3%at its level · small run
MuSR Korean (Daekeun Kim)81.2% ✎█·····███·██ beats 1/5medium · avg 42%▇ 1.2%typical
AutomationBench (DeepSeek V4.1 card) lab37.7% ✎█··█·······█ beats 0/2very hard · avg 12%▇ 0.9%at its level · small run
RobloxQA v2.0 multiple choice (Torpedo Software)91.8% ✎▁▁▃▁█▄▃▃▆▂▂▂ beats 20/49easy · avg 78%▇ 0.9%maxed out
ExploitGym (pass@1) lab1.8% ✎▄···▄··▄▄··█ beats 1/5very hard · avg 0.5%▇ 0.8%too hard for it · noisy · small run

$ where to run it

Through an API

api · Deep Infra · $0.11/M · $0.09 in / $0.18 out per 1M tokens · 1M context · deepinfra.com ↗ · price sourceStandard base token rate from models.dev. Provider-specific tiers, long-context surcharges, caching and promotions may differ.

llama.cpp · recommended

version

  1. Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.
    macOS / Linux
    curl -LsSf https://llama.app/install.sh | sh
    Windows
    irm https://llama.app/install.ps1 | iex

    other ways to install ↗

  2. Run DeepSeek V4 Flash (0731) · needs ~170.9 GB · from huggingface.co/unsloth
    chat in the terminal
    llama cli -hf unsloth/DeepSeek-V4-Flash-0731-GGUF:UD-Q4_K_XL
  3. Or start a local server and open the address it prints (http://localhost:9931)
    llama serve -hf unsloth/DeepSeek-V4-Flash-0731-GGUF:UD-Q4_K_XL

LM Studio

version

  1. Install LM Studio · Open the app once before using the lms command.

    download it (macOS / Windows / Linux) ↗

  2. Run DeepSeek V4 Flash (0731) · needs ~170.9 GB · from huggingface.co/unsloth

    open in LM Studio ↗

  3. Or download it in the terminal
    lms get https://huggingface.co/unsloth/DeepSeek-V4-Flash-0731-GGUF@UD-Q4_K_XL -y
  4. Then run lms ls to see its name, and lms chat followed by that name

Weights and documentation: huggingface.co/deepseek-ai ↗

$ how the score was worked out · Epoch AI — internal evaluatio… 42%, deepseek-ai/DeepSeek-V4.1-Fla… 23%, Daekeun Kim Korean LLM benchm… 13% and 5 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json