whatmodel.sh / DeepSeek V4 Pro (Preview, Apr 2026)
DeepSeek V4 Pro (Preview, Apr 2026)
↗ share
+ contribute
DeepSeek V4 Pro (Preview, Apr 2026) is an open-weights language model from DeepSeek, released April 2026. Its published size is 1600B parameters (49B active per token). Licence: mit.
Catalogue identity notes
Comparison-only. Arena entries 'deepseek-v4-pro' (text, webdev), 'deepseek-v4-pro-high-preview' (text, webdev). Maker repo deepseek-ai/DeepSeek-V4-Pro @b5968e9: licence tag mit. Parameters: DeepSeek: 1.6T total / 49B active (HF safetensors metadata 1,598.8B). Released 2026-04: DeepSeek-V4 Preview release; HF repo created 2026-04-22, API id deepseek-v4-pro from 2026-04-24. The April 2026 'DeepSeek-V4 Preview' Pro weights (deepseek-ai/DeepSeek-V4-Pro), served as deepseek-v4-pro until the 0813 GA (catalogued deepseek-v4-pro) replaced it under the same API id on 2026-08-13. Not the 0813 checkpoint.
$ how it compares
The LLMs ranked either side of DeepSeek V4 Pro (Preview, Apr 2026), out of 828 with a score, then more from DeepSeek.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 67 | 72±1 | api $6.00/M | |||
| 68 | 72±1 | api $1.13/M | |||
| 69 | 72±1 | local | |||
| 70 | 72±1 | api $10.00/M | |||
| 71 | 72±1 | api $0.70/M | |||
| more from DeepSeek | |||||
| 21 | 78±1 | api $0.26/M +local | |||
| 31 | 76±1 | api $1.63/M +local | |||
| 35 | 76±3 | comparison only | |||
$ what it's good at
agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #56 of 300 · 23% of its score · 11 tests
Beats Gemini 3.1 Pro (Preview), GPT-5.2, Gemini 3.6 Flash here, though they rank higher overall. Trails GLM-5.1, Claude Opus 4.5 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| SWE-bench Verified +1 | 77.6% ✎ | ▁··▁·▁▂▁▄█▄▁ beats 25/29 | 7.8% |
| Terminal-Bench 2.1 | 49.2% ✎ | █··▄█·▄····▄ beats 0/6 | 2.3% |
| SWE-bench Multilingual | 76.5% ✎ | ▄··▄▄···▄▄·█ beats 5/6 | 2.2% |
| K-BrowseComp-Verified (Korean web-browsing agent questions, pass@1) | 30.0% ✎ | ▃····█··▃█·▃ beats 5/8 | 1.8% |
| GameLogicBench solve rate (72 Godot game-logic tasks, Claude Code scaffold) | 25.0% ✎ | █▄·█·▄·██▄·▄ beats 3/11 | 1.8% |
| MCP-Atlas (public set) | 73.6% ✎ | █··█·██·████ beats 2/7 | 1.6% |
| BrowseComp | 59.4% ✎ | ▄·▄▄···▄··█▄ beats 4/6 | 1.3% |
| Humanity's Last Exam with tools | 48.2% ✎ | ▄····▄·█·▄·▄ beats 2/5 | 1.3% |
3 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| τ³-bench | 73.2% ✎ | ▄····▄·█·▄·█ beats 5/6 | 1.1% |
| Legal Research Bench (agentic, all-pass) | 23.2% ✎ | ▄█··▄▄▄██·▄█ beats 4/12 | 0.9% |
| τ³-bench telecom (tau2-bench ≥ v1.0.1) | 96.3% ✎ | ▄·▄···▄·▄·█▄ beats 2/6 | 0.6% |
coding▁▁▁▃▆██▇▆▄▃▁ #60 of 458 · 19% of its score · 6 tests
Beats DeepSeek V4 Flash Vision (Exp), Gemini 3.1 Pro (Preview), GPT-5.2 here, though they rank higher overall. Trails MiMo-V2.5-Pro (1T-A42B), MiniMax-M3, GLM-5.1 here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| SWE-bench Verified +1 | 77.6% ✎ | ▁··▁·▁▂▁▄█▄▁ beats 25/29 | 7.8% |
| Arena WebDev (Code Arena) | 1463.4 ✎ | ▁▂▄▃▅█▄▇▆▄▁▁ beats 62/119 | 4.5% |
| SWE-bench Multilingual | 76.5% ✎ | ▄··▄▄···▄▄·█ beats 5/6 | 2.2% |
| GameLogicBench solve rate (72 Godot game-logic tasks, Claude Code scaffold) | 25.0% ✎ | █▄·█·▄·██▄·▄ beats 3/11 | 1.8% |
| SciCode subproblems | 50.5% ✎ | ▃····▃··█·▃▃ beats 5/6 | 1.5% |
| LiveCodeBench v6 (window unspecified) | 92.5% ✎ | ██···█··████ beats 6/6 | 1.3% |
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #50 of 393 * · 3.2% of its score · 2 tests
Beats MiMo-V2.6-Flash (309B-A15B), GPT-6 Luna, GPT-5.6 Luna here, though they rank higher overall. Trails Claude Sonnet 4.5, Gemini 3.5 Flash-Lite, MiMo-V2.5-Pro (1T-A42B) here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| LMArena (text) | 1455.0 ✎ | ▁▁▁▂▃▃▃▆▆▇█▃ beats 321/379 | 2.5% |
| IFEval (aggregation unspecified) | 94.0% ✎ | ▁▁▃▁▂▄▄▆█▃▃▁ beats 137/141 | 0.6% |
math▁▂▃▅▆▅▄█▄▁▁▁ #58 of 398 · 41% of its score · 12 tests
Beats Qwen3.6 Max Preview, Claude Sonnet 4.6 here, though they rank higher overall. Trails INTELLECT-3, GLM-4.7, A.X K2 (688B-A33B) here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| FrontierMath tiers 1–3 v2 | 45.3% ✎ | ▂··▁▁▃▄▄█▅▃▃ beats 32/82 | 13% |
| FrontierMath tier 4 v2 | 2.4% ✎ | ▁▃▁▂█▅▂▂▁▁▁▁ beats 3/63 | 7.0% |
| MathArena ArXivMath April 2026 (40 problems) | 51.2% ✎ | ▁·····▅██▄·▁ beats 7/20 | 5.7% |
| MathArena ArXivMath February 2026 (32 problems) | 51.6% ✎ | ▁▁▁▁█▇▄▃▁▃·▃ beats 19/24 | 3.3% |
| MathArena ArXivMath March 2026 (30 problems) | 55.8% ✎ | █▃▅·█▃▃·▅·▃▃ beats 6/14 | 2.9% |
| MathArena ArXivMath January 2026 (23 problems) | 73.9% ✎ | ▂··▄▂▄█▆▆▄▄█ beats 21/23 | 2.2% |
| MathArena BrokenArXiv April 2026 (61 problems) | 22.1% ✎ | ▂▂▆█▃▃▂▂▂··▂ beats 8/18 | 1.8% |
| AIME 2026 | 95.2% ✎ | ▁▁▁▂▁▂▆█▆▂·▁ beats 38/49 | 1.6% |
4 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| IMO-AnswerBench | 93.0% ✎ | ▄····▄·▄▄·█▄ beats 6/6 | 1.1% |
| MathArena BrokenArXiv March 2026 (56 problems) | 15.2% ✎ | █·▆█▂·▂▂···▂ beats 8/14 | 1.1% |
| MathArena BrokenArXiv February 2026 (31 problems) | 13.3% ✎ | ▃▂▂▃█▃▂·▃··▂ beats 10/16 | 1.0% |
| OTIS mock AIME 2024–2025 | 96.7% ✎ | ▃▃▄▃▃▃▇▇█▃▂▅ beats 168/193 | 0.8% |
web search▂▁▂▆▄█▃▃▁▁·▁ #52 of 80 · 5.3% of its score · 4 tests
Beats Kimi K2.6, GPT-5 Pro here, though they rank higher overall. Trails GPT-4o mini (2024-07-18), Mistral Small 3.1 24B (2503), Llama 4 Scout (109B-A17B) here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| K-BrowseComp-Verified (Korean web-browsing agent questions, pass@1) | 30.0% ✎ | ▃····█··▃█·▃ beats 5/8 | 1.8% |
| BrowseComp | 59.4% ✎ | ▄·▄▄···▄··█▄ beats 4/6 | 1.3% |
| Humanity's Last Exam with tools | 48.2% ✎ | ▄····▄·█·▄·▄ beats 2/5 | 1.3% |
| Legal Research Bench (agentic, all-pass) | 23.2% ✎ | ▄█··▄▄▄██·▄█ beats 4/12 | 0.9% |
other tests16 not in a task · 25% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| GPQA (subset unspecified) | 87.8% ✎ | ▄█▄▄·▄·····▄ beats 4/6 | 3.6% |
| Humanity's Last Exam | 37.7% ✎ | ▄··█▄··▄·▄·▄ beats 6/6 | 2.8% |
| GPQA Diamond | 89.6% ✎ | ▁▁▁▁▂▄▆▄▅▇█▅ beats 170/208 | 2.5% |
| Mystery Game Puzzles (Epoch) | 17.0% ✎ | █··▂▃▇▄█▂▃▁▁ beats 25/74 | 2.3% |
| MMLU-Pro | 87.5% ✎ | ▄·····▄▄▄·▄█ beats 4/6 | 2.2% |
| Chess Puzzles (Epoch) | 20.0% ✎ | █▁▁▁▁▂▁▄▂▂▁▁ beats 76/135 | 1.7% |
| EQ-Bench 3 (emotional intelligence, judge Elo) | 1329.7 ✎ | ▁·▂▁▄▅▅▃█▄▁▁ beats 58/62 | 1.5% |
| WildClawBench | 43.7% ✎ | ▃·▅▅█·▅█▅▃▃▃ beats 12/17 | 1.4% |
8 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| LongBench v2 | 62.1% ✎ | ▂·▁·▂▂▁▃▄▁█▄ beats 26/28 | 1.4% |
| MMLU-ProX | 85.6% ✎ | ▄·····▄·▄▄█▄ beats 4/6 | 1.2% |
| IFBench prompt-level (loose) | 79.1% ✎ | ▄▄·▄··▄▄···█ beats 4/6 | 1.1% |
| MultiChallenge | 64.1% ✎ | ▁··········█ beats 6/6 | 1.0% |
| Legal Research Bench (single-shot, no tools, all-pass) | 4.1% ✎ | ▃▃█▃·▅···█▃▃ beats 7/12 | 1.0% |
| SimpleQA Verified | 47.0% ✎ | ▁▁▃▂▃▃▆▆█▃▂▅ beats 46/78 | 1.0% |
| CritPt | 14.0% ✎ | ▄····▄█···█▄ beats 6/6 | 0.7% |
| Vectara hallucination leaderboard (HHEM-2.3, factual consistency rate) | 91.4% ✎ | ▁▂▁▂▅█▃▃▄▃▁▁ beats 59/98 | 0.0% |
$ where to run it
llama.cpp · recommended
version
- Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.macOS / Linux
curl -LsSf https://llama.app/install.sh | shWindowsirm https://llama.app/install.ps1 | iex - Run DeepSeek V4 Pro (Preview, Apr 2026) · needs ~954.6 GB · from huggingface.co/teamblobfishchat in the terminal
llama cli -hf teamblobfish/DeepSeek-V4-Pro-GGUF:Q4_K_M - Or start a local server and open the address it prints (http://localhost:9931)
llama serve -hf teamblobfish/DeepSeek-V4-Pro-GGUF:Q4_K_M
LM Studio
version
- Install LM Studio · Open the app once before using the lms command.
- Run DeepSeek V4 Pro (Preview, Apr 2026) · needs ~954.6 GB · from huggingface.co/teamblobfish
- Or download it in the terminal
lms get https://huggingface.co/teamblobfish/DeepSeek-V4-Pro-GGUF@Q4_K_M -y - Then run lms ls to see its name, and lms chat followed by that name
Other ways to run it
- Run it as published · needs ~864.72 GB, NVIDIA only · from github.com/vllm-project
vllm serve deepseek-ai/DeepSeek-V4-Pro
Weights and documentation: huggingface.co/deepseek-ai ↗
$ how the score was worked out · Epoch AI — internal evaluatio… 33%, NVIDIA — Nemotron 3 Ultra tec… 30%, MathArena ArXivMath / BrokenA… 18% and 9 more
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json