whatmodel.sh / DeepSeek V4 Pro (0813)
DeepSeek V4 Pro (0813)
↗ share
+ contribute
DeepSeek V4 Pro (0813) is an open-weights language model from DeepSeek, released August 2026. Its published size is 1600B parameters (49B active per token) and a 1M-token context window. Licence: mit.
$ how it compares
The LLMs ranked either side of DeepSeek V4 Pro (0813), out of 828 with a score, then more from DeepSeek.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 29 | 77±1 | api $0.45/M | |||
| 30 | 77±1 | api $3.00/M | |||
| 31 | 76±1 | api $1.63/M +local | |||
| 32 | 76±1 | api $1.50/M | |||
| 33 | 76±1 | api $2.15/M +local | |||
| more from DeepSeek | |||||
| 21 | 78±1 | api $0.26/M +local | |||
| 35 | 76±3 | comparison only | |||
| 36 | 76±2 | local | |||
$ what it's good at
agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #31 of 300 · 24% of its score · 10 tests
Beats GPT-5.4, GPT-6 Luna, GPT-5.6 Luna here, though they rank higher overall. Trails GLM-5.3-Flash, Grok 4.7, Qwen3.8 Max (0902) here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena Agent (October 2026 aggregate IPS) | 0.0119 IPS ✎ | ▁▁▁▄▂▃▇█▂▂▁▃ beats 23/49 | 7.6% |
| GameLogicBench solve rate (72 Godot game-logic tasks, Claude Code scaffold) | 41.7% ✎ | █▄·█·▄·██▄·▄ beats 8/11 | 3.1% |
| Terminal-Bench 4.0 lab | 12.4% ✎ | ▁·▁··▁▇▇▅██▃ beats 4/30 | 3.1% |
| Terminal-Bench 2.1 lab | 87.9% ✎ | ▁·▁·▁▁▄▃▄█▃▇ beats 52/56 | 2.7% |
| Terminal-Bench Hard | 51.4% ✎ | ▂▅▆▂▂▆▂▂█▅▅▃ beats 27/27 | 2.5% |
| Humanity's Last Exam with tools lab | 60.0% ✎ | ▂▂▂▁▄▂▃▆█▇▃▆ beats 47/54 | 1.3% |
| DeepSWE v1.1 (resolved) lab | 62.7% ✎ | ▂····▁▁▁▆██▆ beats 9/28 | 1.1% |
| Agents' Last Exam (pass@1, official scaffold) lab | 25.7% ✎ | █··········▄ beats 1/2 | 1.0% |
2 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Toolathlon-Verified lab | 74.1% ✎ | ▂·▂▂▅▃···▂██ beats 10/18 | 0.7% |
| Terminal-Bench 3.0 lab | 11.8% ✎ | █··█·······█ beats 1/2 | 0.6% |
coding▁▁▁▃▆██▇▆▄▃▁ #28 of 458 · 13% of its score · 4 tests
Beats GPT-5.5, GPT-5.6 Terra, Claude Opus 4.8 here, though they rank higher overall. Trails GLM-5.2, GLM-5.3-Flash, Grok 4.7 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena WebDev (Code Arena) | 1582.6 ✎ | ▁▂▄▃▅█▄▇▆▄▁▁ beats 91/119 | 6.7% |
| GameLogicBench solve rate (72 Godot game-logic tasks, Claude Code scaffold) | 41.7% ✎ | █▄·█·▄·██▄·▄ beats 8/11 | 3.1% |
| Luau Leetcode fully solved (Torpedo Software) | 82.2% ✎ | ▁▁▁▁·▁▂▃▅▃█▇ beats 37/49 | 2.4% |
| DeepSWE v1.1 (resolved) lab | 62.7% ✎ | ▂····▁▁▁▆██▆ beats 9/28 | 1.1% |
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #38 of 393 * · 3.8% of its score · 1 test
Beats GPT-6 Sol, MiMo-V2.6-Flash (309B-A15B), GPT-6 Luna here, though they rank higher overall. Trails MiMo-V2.5-Pro (1T-A42B), Grok 4.20 (0309 reasoning), Claude Opus 4.5 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| LMArena (text) | 1464.3 ✎ | ▁▁▁▂▃▃▃▆▆▇█▃ beats 333/379 | 3.8% |
math▁▂▃▅▆▅▄█▄▁▁▁ #33 of 398 · 35% of its score · 4 tests
Trails GPT-5.2, Qwen3.7 Max, Gemini 3.1 Pro (Preview) here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| FrontierMath tier 4 v2 | 26.8% ✎ | ▁▂▁▂█▅▂▂▁▁▁▁ beats 32/63 | 17% |
| FrontierMath tiers 1–3 v2 | 64.6% ✎ | ▂··▁▁▃▄▄█▅▃▃ beats 50/82 | 16% |
| MathArena Apex (pass@1) lab | 65.3% ✎ | ▄····▄···▄█▄ beats 3/5 | 1.7% |
| OTIS mock AIME 2024–2025 | 98.6% ✎ | ▃▃▄▃▃▃▇▇█▃▃▅ beats 176/193 | 0.6% |
web search██·········█ #2 of 3 * · 1.3% of its score · 1 test
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Humanity's Last Exam with tools lab | 60.0% ✎ | ▂▂▂▁▄▂▃▆█▇▃▆ beats 47/54 | 1.3% |
other tests14 not in a task · 28% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| GPQA Diamond +1 | 91.7% ✎ | ▁▁▁▁▂▄▆▄▅▇█▅ beats 186/208 | 6.4% |
| Mystery Game Puzzles (Epoch) | 43.0% ✎ | █··▂▃▇▄█▃▃▁▁ beats 63/74 | 5.6% |
| Chess Puzzles (Epoch) | 47.0% ✎ | █▁▁▁▁▂▁▄▂▃▁▁ beats 125/135 | 3.4% |
| Humanity's Last Exam lab | 42.7% ✎ | ▁▁▁▃▆▆▇██▆▁▃ beats 93/104 | 2.1% |
| NL2Repo lab | 61.5% ✎ | ▂▂·▂▂▄█▆▆▂▄▆ beats 20/21 | 1.8% |
| SimpleQA Verified | 52.9% ✎ | ▁▁▃▂▃▃▆▆█▃▂▅ beats 58/78 | 1.5% |
| SEC-Bench Pro (pass@1) lab | 56.4% ✎ | ▄··▄···▄·▄·█ beats 3/5 | 1.4% |
| Icelandic LLM Leaderboard average (Miðeind, Sept 2026 suite) | 51.2% ✎ | ▁▁▃▂▂▄▁▃▄▄▄█ beats 20/38 | 1.3% |
6 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| CyberGym lab | 83.3% ✎ | ▄···▄··▄█▄█▄ beats 7/8 | 1.2% |
| ExploitGym (pass@1) lab | 5.4% ✎ | ▄···▄··▄▄··█ beats 2/5 | 1.0% |
| AutomationBench (DeepSeek V4.1 card) lab | 43.2% ✎ | █··█·······█ beats 1/2 | 0.9% |
| RobloxQA v2.0 multiple choice (Torpedo Software) | 92.6% ✎ | ▁▁▃▁█▄▃▃▆▂▂▂ beats 23/49 | 0.8% |
| AutomationBench (Public) lab | 31.8% ✎ | █··········█ beats 1/1 | 0.8% |
| ProgramBench (Almost@1) lab | 15.5% ✎ | █··········█ beats 0/1 | — |
$ where to run it
Through an API
api · Deep Infra · $1.63/M · $1.3 in / $2.6 out per 1M tokens · 1M context · deepinfra.com ↗ · price sourceStandard base token rate from models.dev. Provider-specific tiers, long-context surcharges, caching and promotions may differ.
llama.cpp · recommended
- Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.macOS / Linux
curl -LsSf https://llama.app/install.sh | shWindowsirm https://llama.app/install.ps1 | iex - Run DeepSeek V4 Pro (0813) · needs ~960.5 GB · from huggingface.co/unslothchat in the terminal
llama cli -hf unsloth/DeepSeek-V4-Pro-0813-GGUF:UD-Q4_K_XL - Or start a local server and open the address it prints (http://localhost:9931)
llama serve -hf unsloth/DeepSeek-V4-Pro-0813-GGUF:UD-Q4_K_XL
LM Studio
- Install LM Studio · Open the app once before using the lms command.
- Run DeepSeek V4 Pro (0813) · needs ~960.5 GB · from huggingface.co/unsloth
- Or download it in the terminal
lms get https://huggingface.co/unsloth/DeepSeek-V4-Pro-0813-GGUF@UD-Q4_K_XL -y - Then run lms ls to see its name, and lms chat followed by that name
Weights and documentation: huggingface.co/deepseek-ai ↗
$ how the score was worked out · Epoch AI — internal evaluatio… 46%, deepseek-ai/DeepSeek-V4.1-Fla… 24%, LMArena leaderboard dataset 18% and 5 more
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
| source | results | share of the score |
|---|---|---|
| 7 | 46% | |
| 14 | 24% | |
| 3 | 18% | |
| 2 | 3% | |
| 1 | 3% | |
| 1 | 3% | |
| 2 | 1% | |
| 1 | 1% | |
| prior · pull toward the middle | 0% | |
| weighted average | = 76.4 |
not counted (1)
| deepseek-ai/DeepSeek-V4.1-Flash model card | ProgramBench (Almost@1) [correct] | 15.5% | fewer than three models have this test yet, or this source ran it for this model alone |
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json