Herbert v0.5

+ contribute

Herbert v0.5 is an open-weights decision model from leinenterprises. Its published size is 27.78B parameters. Licence: apache-2.0.

Catalogue identity notes

Exact Decision Index tested engine herbert-v0.5; reported model Herbert v0.5. Type: LoRA; technique: autoregressive. Comparison entry; no current run command, API price or speed inferred from the benchmark. Current repository metadata checked separately; an unpinned alias is not evidence that today’s weights reproduce this historical run.

Model information sources

· Weights licence ↗ · Parameter count ↗

Publisher parameter count; includes the served backbone, not just adapter size.

65.4±3.5#53 of 355 decision modelsfrom 12 benchmark results across 1 source

$ how it compares

The decision models ranked either side of Herbert v0.5, out of 357 with a score.

#	model	score	where	released
51	RSI-Jev v6.1 VL 27B (effort auto) shgao	66±1	model files	2026-10-08
52	KnowLine 9B Gen1 PelaAI	66±1	model files
53	Herbert v0.5 leinenterprises	65±4	model files
54	StartLux-Decision v1.1 4B StartLux	65±1	model files
55	Quyet-1.0-Large chinhnc	65±1	model files

see all decision models · find the ones that fit your machine

$ what it's good at

vision▁·▃▂▃▃▇▄▄█▄▃ #25 of 79 · 95% of its score · 12 tests

Beats StartLux-Decision v1.1 9B, RSI-Jev v6.1 VL 27B (effort auto) here, though they rank higher overall. Trails Clef-flash, Perplexity Decider Flash v1.2 (4B), Mercury Decide (free endpoint) here, though they rank lower overall.

test	result	vs the others in its run	difficulty	counts	why
Decision Index Vision 0.4 · Mind2Web (chance-corrected points) submitted	83.4200 points ✎	▁·▁▁▃▁▄▄▃▅█▂ beats 45/61	avg 63.423 points	▇▇▇▇▇ 12%	blunt
Decision Index Vision 0.4 · MMMU-Pro vision (chance-corrected points) submitted	42.1900 points ✎	▁▁▅▁▄▁▄█▄▃▇▇ beats 46/61	avg 22.797 points	▇▇▇▇ 11%	blunt
Decision Index Vision 0.4 · Winoground (chance-corrected points) submitted	83.7500 points ✎	▁·▁▁▁▁·▂▁▃▅█ beats 43/61	avg 66.987 points	▇▇▇▇ 10%	blunt
Decision Index Vision 0.4: private same skills (points)	64.3900 points ✎	▁▁▃▃▁▂▄▆▃▃▅█ beats 46/61	avg 48.067 points	▇▇▇▇ 10%	blunt
Decision Index Vision 0.4 · Moderation (Hateful Memes) (chance-corrected points) submitted	52.5100 points ✎	▆▃▃▆▄▄▇██▁▆▆ beats 54/61	avg 28.443 points	▇▇▇▇ 8.8%	blunt
Decision Index Vision 0.4 · RealWorldQA (chance-corrected points) submitted	73.6400 points ✎	▁·▂▂▁▃▃▅▅▃▂█ beats 54/61	avg 53.651 points	▇▇▇ 8.0%	blunt
Decision Index Vision 0.4 · CharXiv (chance-corrected points) submitted	77.9400 points ✎	▂▁▁▁▁▃▁▅▅▆██ beats 42/61	avg 62.137 points	▇▇▇ 7.8%	blunt
Decision Index Vision 0.4 · InfographicVQA (chance-corrected points) submitted	96.1700 points ✎	▁·▁▂▁▁▃▁▂▂▅█ beats 42/61	avg 83.859 points	▇▇ 6.2%	blunt

4 more tests

test	result	vs the others in its run	difficulty	counts	why
Decision Index Vision 0.4 · R-Bench-M (chance-corrected points) submitted	30.5200 points ✎	▂▄▇▆█▄▄▇▂··▁ beats 42/61	avg 19.676 points	▇▇ 6.2%	blunt
Decision Index Vision 0.4 · BLINK (chance-corrected points) submitted	71.8100 points ✎	▁···▁▂▂▂█▄▃▃ beats 54/61	avg 44.994 points	▇▇ 5.9%	blunt
Decision Index Vision 0.4 · CV-Bench (chance-corrected points) submitted	79.1200 points ✎	▁▁▁▁▂▁▁▁▄█▃▃ beats 55/61	avg 67.662 points	▇▇ 4.7%	blunt
Decision Index Vision 0.4 · KIE (CORD+FUNSD) (chance-corrected points) submitted	92.3200 points ✎	▁··▁▁▁▁▁▂▄█▁ beats 43/61	avg 85.184 points	▇ 3.4%	blunt

$ where to run it

Download model files ↗
Published model files verified. Includes adapters or readout weights; follow the model documentation for the required base model. This is a verified repository snapshot; the benchmark does not establish an identical weight revision. A local run command and hardware requirements have not been verified for this entry. Source · checked 2026-10-31.

Model repository and documentation: huggingface.co/leinenterprises ↗

$ how the score was worked out · Decision Index Vision 0.4 95%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

source	results	share of the score	licence
Decision Index Vision 0.4 · submitted; independent execution unverified	12	▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 95%	CC BY 4.0
prior · pull toward the middle		▇▇ 5%
weighted average		= 65.4

$ improve this page

Update model information Add a place to run it Add a test result Propose a benchmark Correct a benchmark score Edit data on GitHub

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated 2026-11-03 02:37 UTC · sources and licences · json