whatmodel.sh / Mixtral 8x7B v0.1 (base)
Mixtral 8x7B v0.1 (base)
↗ share
+ contribute
Mixtral 8x7B v0.1 (base) is an open-weights language model from Mistral AI, released December 2023. Its published size is 46.7B parameters (12.9B active per token) and a 32k-token context window. Licence: apache-2.0.
Catalogue identity notes
Maker repo mistralai/Mixtral-8x7B-v0.1 @fc7ac94: licence tag apache-2.0. 46,702,792,704 parameters from the Hugging Face safetensors metadata; active 12.9B per the Mixtral paper (2 of 8 experts). Released 2023-12: month the maker's Hugging Face repo was created (createdAt 2023-12-01). Pretrained Mixtral 8x7B; not Mixtral 8x7B Instruct. 46.7B total / 12.9B active parameters (sparse MoE, 2 of 8 experts). Ollama tags mixtral:8x7b-text-v0.1-q4_K_M, mixtral:8x7b-text-v0.1-q8_0 (sizes as listed on the tags page, observed 2026-09-29).
$ how it compares
The LLMs ranked either side of Mixtral 8x7B v0.1 (base), out of 828 with a score, then more from Mistral AI.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 610 | 41±1 | local | |||
| 611 | 41±1 | local | |||
| 612 | 41±1 | local | |||
| 613 | 41±2 | local | |||
| 614 | 41±1 | local | |||
| more from Mistral AI | |||||
| 419 | 50±1 | local | |||
| 425 | 49±2 | local | |||
| 587 | 42±1 | local | |||
$ what it's good at
coding▁▁▁▃▆██▇▆▄▃▁ #391 of 458 · 49% of its score · 7 tests
Beats DeepSeek R1 Distill Qwen 7B, Qwen3.5 2B, DeepSeek R1 Distill Llama 8B here, though they rank higher overall. Trails Qwen2.5 1.5B Instruct, WizardLM 13B V1.2, Falcon3 3B Instruct here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| HumanEvalSynthesize (HumanEvalPack, 6-language average) | 43.3% ✎ | ▁·▂▁▂▆▅█▄▄▁▂ beats 22/35 | 13% |
| HumanEval lab | 40.2% ✎ | █···█·███··█ beats 5/5 | 11% |
| HumanEvalExplain (HumanEvalPack, 6-language average) | 20.7% ✎ | ▄▇█▃▄▇▄▁▇▃·▁ beats 16/35 | 8.1% |
| HumanEvalFix (HumanEvalPack, 6-language average) | 14.3% ✎ | ▁·▁▁▄██▄█▁▅▅ beats 14/35 | 7.7% |
| MBPP lab | 60.7% ✎ | ▄··▄·▄··█··▄ beats 5/5 | 3.8% |
| CRUXEval-I | 39.3% ✎ | ▁··▁▅▂█▇▁··▁ beats 10/22 | 2.7% |
| CRUXEval-O | 40.5% ✎ | ▁·▂▃▁█▁▂···▁ beats 11/22 | 2.6% |
math▁▂▃▅▆▅▄█▄▁▁▁ #250 of 398 * · 7.6% of its score · 2 tests
Beats GPT-4 Turbo (2024-04-09), Molmo 2 8B, Llama 3.3 70B Instruct here, though they rank higher overall. Trails DeepSeek R1 Distill Qwen 1.5B here, though they rank lower overall.
other tests10 not in a task · 43% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| ARC Challenge lab | 59.7% ✎ | ▄···▄···█▄·▄ beats 5/5 | 10% |
| Natural Questions (closed book) lab | 30.6% ✎ | █·····▄▄▄··▄ beats 5/5 | 6.4% |
| MMLU lab | 70.6% ✎ | ▄····▄▄·▄··█ beats 5/5 | 6.1% |
| WinoGrande lab | 77.2% ✎ | █··█·█·██··█ beats 4/5 | 5.8% |
| TriviaQA lab | 71.5% ✎ | █···██··█·██ beats 4/5 | 4.9% |
| HellaSwag lab | 84.4% ✎ | █···██···███ beats 4/5 | 3.7% |
| ARC Easy lab | 83.1% ✎ | ▄···▄···█▄·▄ beats 5/5 | 2.3% |
| PIQA lab | 83.6% ✎ | ▄····▄··█▄·▄ beats 5/5 | 1.5% |
2 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Open PT-LLM Leaderboard average (9 Portuguese tasks) | 67.9% ✎ | ▃▁▁▁▁▁▁▁▂█▅▁ beats 141/276 | 1.5% |
| EuroEval Life in the UK (English knowledge MC), test split, 5-shot, accuracy | 87.2% ✎ | ▁▁▁▁▁▁▁▂▄█▄▃ beats 105/146 | 1.0% |
$ where to run it
llama.cpp · recommended
version
- Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.macOS / Linux
curl -LsSf https://llama.app/install.sh | shWindowsirm https://llama.app/install.ps1 | iex - Run Mixtral 8x7B v0.1 (base) · needs ~26.4 GB · from huggingface.co/TheBlokechat in the terminal
llama cli -hf TheBloke/Mixtral-8x7B-v0.1-GGUF:Q4_K_M - Or start a local server and open the address it prints (http://localhost:9931)
llama serve -hf TheBloke/Mixtral-8x7B-v0.1-GGUF:Q4_K_M
LM Studio
version
- Install LM Studio · Open the app once before using the lms command.
- Run Mixtral 8x7B v0.1 (base) · needs ~26.4 GB · from huggingface.co/TheBloke
- Or download it in the terminal
lms get https://huggingface.co/TheBloke/Mixtral-8x7B-v0.1-GGUF@Q4_K_M -y - Then run lms ls to see its name, and lms chat followed by that name
Ollama
version
- Install Ollama
download it (macOS / Windows) ↗
Linuxcurl -fsSL https://ollama.com/install.sh | sh - Run Mixtral 8x7B v0.1 (base) · needs ~28 GB · from ollama.comchat in the terminal
ollama run mixtral:8x7b-text-v0.1-q4_K_M
MLX (Mac)
- Install MLX (Mac) · Apple silicon Macs only, text only.with uv
uv tool install mlx-lmorpip install mlx-lm - Run Mixtral 8x7B v0.1 (base) · needs ~26.5 GB, Mac only · from huggingface.co/mlx-communitychat in the terminal
mlx_lm.chat --model mlx-community/Mixtral-8x7B-v0.1-hf-4bit-mlx - Or start an OpenAI-compatible server at http://localhost:8080/v1
mlx_lm.server --model mlx-community/Mixtral-8x7B-v0.1-hf-4bit-mlx
Official weights and documentation: huggingface.co/mistralai ↗
$ how the score was worked out · Mixtral of Experts — base-mod… 63%, Granite Code Models: A Family… 29%, CRUXEval published evaluation… 5% and 2 more
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
| source | results | share of the score |
|---|---|---|
| 12 | 63% | |
| 3 | 29% | |
| 2 | 5% | |
| 1 | 1% | |
| 1 | 1% | |
| prior · pull toward the middle | 0% | |
| weighted average | = 40.7 |
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json