whatmodel.sh / Hermes 3 Llama 3.1 405B

Hermes 3 Llama 3.1 405B

+ contribute

Hermes 3 Llama 3.1 405B is an open-weights language model from Nous Research, released August 2024. Its published size is 405.85B parameters and a 131k-token context window. Licence: llama3.

Catalogue identity notes

NousResearch/Hermes-3-Llama-3.1-405B @b9fe8ed (created 2024-08-13, licence llama3). Nous Research Hermes 3 405B (Aug 2024), full-parameter fine-tune of Llama 3.1 405B; sibling of the catalogued hermes-3-llama-3-1-8b. Lab rows from the Hermes 3 report Table 5 (rule b; 405B evaluated under FP8); independent Aider code-editing row (OpenRouter route).

Model information sources

Release date ↗ · Weights licence ↗

HF safetensors metadata 405,853,388,800 parameters (NousResearch/Hermes-3-Llama-3.1-405B @b9fe8ed).

51.4±1.2#321 of 719 LLMsfrom 14 benchmark results across 2 sources

$ how it compares

The LLMs ranked either side of Hermes 3 Llama 3.1 405B, out of 828 with a score, then more from Nous Research.

#	model	score	where	RAM	released
387	Qwen2.5 14B Instruct Alibaba	52±1	local	~10GB	2024-09
388	Cogito v1 Preview Llama 8B Deep Cogito	51±5	local	~6.2GB	2025-03
389	Hermes 3 Llama 3.1 405B Nous Research	51±1	local	~114GB	2024-08
390	GPT-4 (0613) OpenAI	51±1	api $37.50/M		2023-06
391	OpenCoder-8B-Instruct INF (infly)	51±1	local	~6.4GB	2024-11
	more from Nous Research
447	Hermes 3 Llama 3.1 70B Nous Research	49±1	local	~44GB	2024-07
461	Hermes 2 Theta Llama-3 70B Nous Research	48±2	local	~47GB	2024-06
498	Hermes 2 Pro Llama 3 8B Nous Research	46±3	local	~6.6GB	2024-04

see all LLMs · find the ones that fit your machine

$ what it's good at

coding▁▁▁▃▆██▇▆▄▃▁ #222 of 458 * · 24% of its score · 1 test

Beats Qwen3.5 4B, Qwen3-VL 32B Instruct, Solar Open 100B (102B-A12B) here, though they rank higher overall. Trails QwQ-32B-Preview, Ministral 3 3B Reasoning 2512, GPT-4 (0613) here, though they rank lower overall.

test	result	vs the others in its run	difficulty	counts	why
Aider code editing (133 Exercism Python exercises, two attempts)	63.9% ✎	▁·▁▂▄▁▆▄█▆▂▂ beats 32/62	medium · avg 54%	▇▇▇▇▇▇▇▇▇▇ 24%	at its level

chat & writing█········█·█ #1 of 3 * · 2.2% of its score · 1 test

test	result	vs the others in its run	difficulty	counts	why
IFEval (aggregation unspecified) lab	84.9% ✎	▁▁▃▁▂▄▄▆█▃▂▁ beats 72/141	easy · avg 79%	▇ 2.2%	small run

other tests12 not in a task · 73% of its score

test	result	vs the others in its run	difficulty	counts	why
GPQA (subset unspecified) lab	44.8% ✎	▂▁▂▂▄▃▆▃▅█▄▃ beats 48/104	hard · avg 41%	▇▇▇▇▇ 12%	sharp · small run
BIG-Bench Hard lab	75.4% ✎	▁▁▁▁▂▄▅▅█▃▄▁ beats 103/129	medium · avg 72%	▇▇▇▇▇ 12%	sharp · at its level · small run
ARC Challenge lab	69.5% ✎	▆▁▁▂▂▅▇█▄▃▃▂ beats 80/97	medium · avg 73%	▇▇▇▇ 10%	sharp · at its level · small run
MMLU lab	85.0% ✎	▁▁▁▁▁▂▃▅█▃▆▃ beats 155/183	easy · avg 80%	▇▇▇ 7.0%	small run
MMLU-Pro lab	54.1% ✎	▁▁·▁▁▁▃▃▄▅█▁ beats 53/188	medium · avg 52%	▇▇▇ 6.8%	at its level · small run
WinoGrande lab	86.3% ✎	▁···▂▁▁▅█▇▃▃ beats 87/87	easy · avg 86%	▇▇▇ 6.3%	at its level · small run
OpenBookQA lab	48.8% ✎	█▁▁▁▄▃▃▇▂▁▄▂ beats 45/65	medium · avg 55%	▇▇ 5.9%	at its level · small run
BoolQ lab	88.9% ✎	▁▄▅▆▂▆▄▄█▃▄▄ beats 58/58	easy · avg 90%	▇▇ 4.8%	small run

4 more tests

test	result	vs the others in its run	difficulty	counts	why
HellaSwag lab	90.2% ✎	▁▁▁▁▂▂▃▇█▆▅▃ beats 85/85	very easy · avg 89%	▇▇ 4.3%	small run
MuSR lab	48.3% ✎	█······█···█ beats 1/2	medium · avg 53%	▇ 2.3%	blunt · at its level · small run
PIQA lab	86.0% ✎	▁▁▁▃▃▄▇█▄▃▃▁ beats 81/83	easy · avg 86%	▇ 1.8%	blunt · at its level · small run
TruthfulQA MC2 lab	65.6% ✎	█▅▇▅▁▄▁▇▅▄▁▁ beats 58/73	medium · avg 64%	▇ 1.0%	blunt · at its level · small run

$ where to run it

llama.cpp · recommended

version

Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.
macOS / Linux
curl -LsSf https://llama.app/install.sh | sh
Windows
irm https://llama.app/install.ps1 | iex
other ways to install ↗
Run Hermes 3 Llama 3.1 405B · needs ~243.1 GB · from huggingface.co/bartowski
chat in the terminal
llama cli -hf bartowski/Hermes-3-Llama-3.1-405B-GGUF:Q4_K_M
Or start a local server and open the address it prints (http://localhost:9931)
llama serve -hf bartowski/Hermes-3-Llama-3.1-405B-GGUF:Q4_K_M

LM Studio

version

Install LM Studio · Open the app once before using the lms command.
download it (macOS / Windows / Linux) ↗
Run Hermes 3 Llama 3.1 405B · needs ~243.1 GB · from huggingface.co/bartowski
open in LM Studio ↗
Or download it in the terminal
lms get https://huggingface.co/bartowski/Hermes-3-Llama-3.1-405B-GGUF@Q4_K_M -y
Then run lms ls to see its name, and lms chat followed by that name

Ollama

Install Ollama
download it (macOS / Windows) ↗
Linux
curl -fsSL https://ollama.com/install.sh | sh
Run Hermes 3 Llama 3.1 405B · needs ~229 GB · from ollama.com
chat in the terminal
ollama run hermes3:405b

Official weights and documentation: huggingface.co/NousResearch ↗

$ how the score was worked out · Nous Research vendor-reported… 75%, Aider code editing benchmark… 24%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

source	results	share of the score	licence
Nous Research vendor-reported scores for its own Hermes models (Hermes 3 Technical Report) · lab-reported	13	▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 75%	Factual vendor-reported score (not licensed content)
Aider code editing benchmark runs (old edit leaderboard)	1	▇▇▇▇▇▇▇ 24%	Apache-2.0
prior · pull toward the middle		▇ 1%
weighted average		= 51.4

$ improve this page

Update model information Add a place to run it Add a test result Propose a benchmark Correct a benchmark score Edit data on GitHub

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated 2026-10-11 02:20 UTC · sources and licences · json