whatmodel.sh / DeepSeek V4 Flash (0731)
DeepSeek V4 Flash (0731)
↗ share
+ contribute
DeepSeek V4 Flash (0731) is an open-weights language model from DeepSeek, released July 2026. Its published size is 284B parameters (13B active per token) and a 1M-token context window. Licence: mit.
$ how it compares
The LLMs ranked either side of DeepSeek V4 Flash (0731), out of 828 with a score, then more from DeepSeek.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 48 | 75±1 | api $10.00/M | |||
| 49 | 74±1 | api $4.81/M | |||
| 50 | 74±1 | api $0.11/M +local | |||
| 51 | 74±1 | api $3.75/M | |||
| 52 | 74±1 | api $0.24/M +local | |||
| more from DeepSeek | |||||
| 21 | 78±1 | api $0.26/M +local | |||
| 31 | 76±1 | api $1.63/M +local | |||
| 35 | 76±3 | comparison only | |||
$ what it's good at
agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #43 of 300 · 17% of its score · 9 tests
Beats Gemini 3.1 Pro (Preview), Muse Spark 1.2, Muse Spark 1.1 here, though they rank higher overall. Trails GLM-5.2, GLM-5.3-Flash here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Terminal-Bench 2.1 lab +1 | 82.7% ✎ | ▁·▁·▁▁▄▃▄█▃▇ beats 42/56 | 4.9% |
| GameLogicBench solve rate (72 Godot game-logic tasks, Claude Code scaffold) | 31.9% ✎ | █▄·█·▄·██▄·▄ beats 5/11 | 2.7% |
| Terminal-Bench 4.0 lab | 7.0% ✎ | ▁·▁··▃▇▇▅██▃ beats 2/30 | 2.5% |
| DeepSWE v1.1 (resolved) lab +1 | 54.4% ✎ | ▂····▁▁▃▆██▆ beats 4/28 | 2.0% |
| Toolathlon-Verified lab +1 | 70.3% ✎ | ▂·▂▂▅▃···▃██ beats 8/18 | 1.3% |
| Humanity's Last Exam with tools lab | 51.5% ✎ | ▂▂▂▁▄▂▃▆█▇▂▆ beats 32/54 | 1.2% |
| Agents' Last Exam (pass@1, official scaffold) lab | 25.2% ✎ | █··········▄ beats 0/2 | 0.9% |
| Agents' Last Exam (metric/harness unspecified) lab | 25.2% ✎ | ▂·▂·█▂···▂▄▄ beats 2/11 | 0.8% |
1 more test
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Terminal-Bench 3.0 lab | 7.6% ✎ | █··█·······█ beats 0/2 | 0.5% |
coding▁▁▁▃▆██▇▆▄▃▁ #33 of 458 · 14% of its score · 4 tests
Beats GPT-5.5, GPT-5.6 Terra, Claude Opus 4.8 here, though they rank higher overall. Trails Qwen3.8 27B, GLM-5.2, GLM-5.3-Flash here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena WebDev (Code Arena) | 1581.0 ✎ | ▁▂▄▃▅█▄▇▆▄▁▁ beats 90/119 | 6.4% |
| GameLogicBench solve rate (72 Godot game-logic tasks, Claude Code scaffold) | 31.9% ✎ | █▄·█·▄·██▄·▄ beats 5/11 | 2.7% |
| Luau Leetcode fully solved (Torpedo Software) | 77.9% ✎ | ▁▁▁▁·▁▂▃▅▃█▇ beats 29/49 | 2.6% |
| DeepSWE v1.1 (resolved) lab +1 | 54.4% ✎ | ▂····▁▁▃▆██▆ beats 4/28 | 2.0% |
math▁▂▃▅▆▅▄█▄▁▁▁ #39 of 398 · 33% of its score · 4 tests
Beats Grok 4.7 here, though they rank higher overall. Trails GPT-5.2, Qwen3.7 Max here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| FrontierMath tiers 1–3 v2 | 57.5% ✎ | ▂··▁▁▃▄▄█▅▃▃ beats 44/82 | 17% |
| FrontierMath tier 4 v2 | 24.4% ✎ | ▁▂▁▂█▅▂▂▁▁▁▁ beats 26/63 | 13% |
| MathArena Apex (pass@1) lab | 58.6% ✎ | ▄····▄···▄█▄ beats 2/5 | 1.6% |
| OTIS mock AIME 2024–2025 | 94.4% ✎ | ▃▃▄▃▃▃▇▇█▃▂▅ beats 159/193 | 0.8% |
web search██·········█ #3 of 3 * · 1.2% of its score · 1 test
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Humanity's Last Exam with tools lab | 51.5% ✎ | ▂▂▂▁▄▂▃▆█▇▂▆ beats 32/54 | 1.2% |
other tests18 not in a task · 41% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| GPQA Diamond +1 | 91.0% ✎ | ▁▁▁▁▂▄▆▄▅▇█▅ beats 182/208 | 7.2% |
| KMMLU-HARD (Daekeun Kim, zero-shot) | 74.2% ✎ | █···▁▁▁▂▃·▆▂ beats 17/23 | 4.7% |
| Mystery Game Puzzles (Epoch) | 34.0% ✎ | █··▂▃▇▄█▂▃▁▁ beats 53/74 | 4.1% |
| NL2Repo lab +1 | 54.2% ✎ | ▂▂·▂▂▄█▆▆▂▄▆ beats 17/21 | 3.1% |
| Chess Puzzles (Epoch) | 33.0% ✎ | █▁▁▁▁▂▁▄▃▂▁▁ beats 109/135 | 2.8% |
| CyberGym lab +1 | 76.7% ✎ | ▄···▄··▄█▄█▄ beats 4/8 | 2.2% |
| KoBALT-700 (Daekeun Kim) | 73.3% ✎ | ▄▄█·····▄··▄ beats 0/5 | 2.1% |
| CLIcK Korean (Daekeun Kim) | 90.6% ✎ | ▆▄▄▄█▄▂·▄█·▄ beats 17/23 | 2.0% |
10 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Humanity's Last Exam lab | 37.8% ✎ | ▁▁▁▃▆▆▇██▆▁▃ beats 87/104 | 1.9% |
| KMMLU-Pro (Daekeun Kim) | 79.2% ✎ | ▄·▄█·····▄·▄ beats 0/5 | 1.9% |
| AutomationBench (Public) lab +1 | 25.1% ✎ | █··········█ beats 0/1 | 1.5% |
| HAE-RAE 1.0 (Daekeun Kim) | 91.9% ✎ | ▄▄▄▂▂█▂▄▂█▂▄ beats 17/22 | 1.5% |
| SimpleQA Verified | 33.6% ✎ | ▁▁▃▂▃▃▆▆█▃▂▅ beats 25/78 | 1.4% |
| SEC-Bench Pro (pass@1) lab | 30.9% ✎ | ▄··▄···▄·▄·█ beats 1/5 | 1.3% |
| MuSR Korean (Daekeun Kim) | 81.2% ✎ | █·····███·██ beats 1/5 | 1.2% |
| AutomationBench (DeepSeek V4.1 card) lab | 37.7% ✎ | █··█·······█ beats 0/2 | 0.9% |
| RobloxQA v2.0 multiple choice (Torpedo Software) | 91.8% ✎ | ▁▁▃▁█▄▃▃▆▂▂▂ beats 20/49 | 0.9% |
| ExploitGym (pass@1) lab | 1.8% ✎ | ▄···▄··▄▄··█ beats 1/5 | 0.8% |
$ where to run it
Through an API
api · Deep Infra · $0.11/M · $0.09 in / $0.18 out per 1M tokens · 1M context · deepinfra.com ↗ · price sourceStandard base token rate from models.dev. Provider-specific tiers, long-context surcharges, caching and promotions may differ.
llama.cpp · recommended
version
- Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.macOS / Linux
curl -LsSf https://llama.app/install.sh | shWindowsirm https://llama.app/install.ps1 | iex - Run DeepSeek V4 Flash (0731) · needs ~170.9 GB · from huggingface.co/unslothchat in the terminal
llama cli -hf unsloth/DeepSeek-V4-Flash-0731-GGUF:UD-Q4_K_XL - Or start a local server and open the address it prints (http://localhost:9931)
llama serve -hf unsloth/DeepSeek-V4-Flash-0731-GGUF:UD-Q4_K_XL
LM Studio
version
- Install LM Studio · Open the app once before using the lms command.
- Run DeepSeek V4 Flash (0731) · needs ~170.9 GB · from huggingface.co/unsloth
- Or download it in the terminal
lms get https://huggingface.co/unsloth/DeepSeek-V4-Flash-0731-GGUF@UD-Q4_K_XL -y - Then run lms ls to see its name, and lms chat followed by that name
Weights and documentation: huggingface.co/deepseek-ai ↗
$ how the score was worked out · Epoch AI — internal evaluatio… 42%, deepseek-ai/DeepSeek-V4.1-Fla… 23%, Daekeun Kim Korean LLM benchm… 13% and 5 more
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
| source | results | share of the score |
|---|---|---|
| 7 | 42% | |
| 14 | 23% | |
| 6 | 13% | |
| 7 | 8% | |
| 1 | 6% | |
| 2 | 3% | |
| 1 | 3% | |
| 2 | 1% | |
| prior · pull toward the middle | 0% | |
| weighted average | = 74.1 |
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json