whatmodel.sh / DBRX Instruct

DBRX Instruct is an open-weights language model from Databricks, released March 2024. Its published size is 132B parameters (36B active per token) and a 32k-token context window. Licence: databricks-open-model.

Catalogue identity notes

Comparison model from the Epoch AI internal-evaluation CSVs (Epoch release date 2024-03-27). DBRX Instruct (March 2024). 132B total, 36B active parameters and the Databricks Open Model License per the ollama library page/licence layer; the original Hugging Face repo databricks/dbrx-instruct is no longer publicly accessible (HTTP 401, observed 2026-09-28).

45.8±0.7#428 of 719 LLMsfrom 13 benchmark results across 9 sources

$ how it compares

The LLMs ranked either side of DBRX Instruct, out of 828 with a score, then more from Databricks.

#modelscorewhereRAMreleased
507Qwen2.5-Math 1.5B Instruct Alibaba46±2local~2.4GB2024-09
508Yi 1.5 34B Chat 01.AI46±1local~22GB2024-05
509DBRX Instruct Databricks46±1local~85GB2024-03
510Granite 34B Code Instruct (8K) IBM46±1local~22GB2024-04
511WizardCoder Python 34B V1.0 WizardLM46±1local~23GB2023-08
more from Databricks
805Dolly v2 12B Databricks17±2comparison only2023-04

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #286 of 300 * · 0.8% of its score · 1 test

Trails Granite 4.0 H 350M, ChatGLM3-6B, Qwen3 0.6B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
BFCL v339.2% ✎▁▁▁▁▃▃▅█▅▄▁▁ beats 13/114medium · avg 52%▇ 0.8%blunt · at its level
coding▁▁▁▃▆██▇▆▄▃▁ #285 of 458 · 61% of its score · 3 tests

Beats Qwen3-VL 32B Instruct, Solar Open 100B (102B-A12B), GLM-4.7-Flash here, though they rank higher overall. Trails DeepSeek LLM 67B Chat, WizardLM 70B V1.0, Yi 1.5 9B Chat here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
HumanEval75.0% ✎▁·▁▁▃▄▆▅█▃▁▁ beats 71/99easy · avg 79%▇▇▇▇▇▇▇▇▇▇▇▇▇ 31%sharp · at its level
HumanEval+70.1% ✎▁·▁▁▁▃▄▄▄█▃▁ beats 70/99easy · avg 74%▇▇▇▇▇▇▇▇▇▇ 25%sharp · at its level
MBPP+55.8% ✎▁···▁▁▂▅▇█▆▂ beats 30/75easy · avg 68%▇▇ 4.5%at its level
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #308 of 393 · 22% of its score · 4 tests

Beats Gemma 4 E4B, OpenThinker3 7B, Gemma 4 E2B here, though they rank higher overall. Trails LFM2 350M, Gemma 3 1B, Flan-T5 XXL here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
AlpacaEval 2 length-controlled25.4% ✎▁▂▂▃▆▆█▆▄▄▁▁ beats 66/122medium · avg 39%▇▇▇▇▇▇ 14%at its level
Polyrating rating (bias-aware re-fit of Chatbot Arena votes, mid-2024)1101.0 ✎▂▁▂▁▃▇█▆▇▄▂▂ beats 45/95avg 1201▇▇ 3.8%blunt
LMArena (text)1195.5 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 66/379avg 1268▇▇ 3.8%blunt
IFEval (aggregation unspecified)52.1% ✎▁▁▃▁▂▄▄▆█▃▂▁ beats 13/141easy · avg 73%▇ 0.7%at its level · small run
math▁▂▃▅▆▅▄█▄▁▁▁ #346 of 398 * · 5.5% of its score · 1 test

Trails Qwen3 0.6B, Gemma 7B (base), Qwen2.5 1.5B Instruct here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
MATH level 511.7% ✎▂▂▅▆▄█▆▃▅▂▃▄ beats 9/92hard · avg 32%▇▇ 5.5%sharp
other tests4 not in a task · 10% of its score
testresultvs the others in its rundifficultycountswhy
WildBench v2 WB-Score (task macro)32.5989 WB-Score ✎▁·▁▁·▃█▄▇▆▅▆ beats 20/52avg 45.199 WB-Score▇▇ 4.3%sharp
GPQA Diamond32.9% ✎▁▁▁▁▃▄▆▄▅▇█▅ beats 21/208hard · avg 40%▇ 3.0%sharp
BIG-Bench Hard48.5% ✎▁▁▁▁▂▄▅▅█▃▄▁ beats 42/129medium · avg 67%▇ 2.8%sharp · at its level · small run
Vectara hallucination leaderboard, 2025 dataset (HHEM-2.3, factual consistency rate)91.7% ✎▁▁▂▃▄▄█▆▃▂▂▁ beats 34/140very easy · avg 94%▇ 0.3%blunt · maxed out · noisy

$ where to run it

Ollama · recommended

version

  1. Install Ollama

    download it (macOS / Windows) ↗

    Linux
    curl -fsSL https://ollama.com/install.sh | sh
  2. Run DBRX Instruct · needs ~79.7 GB · from ollama.com
    chat in the terminal
    ollama run dbrx:132b
$ how the score was worked out · EvalPlus / EvalPerf published… 61%, AlpacaEval 1.0 and 2.0 leader… 14%, Epoch AI — internal evaluatio… 8% and 6 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json