whatmodel.sh / decision / matilda-jev-v1.5 (27B)

matilda-jev-v1.5 (27B) is an open-weights decision model from Maincode, released 9 October 2026.

Catalogue identity notes

Exact Decision Index tested engine matilda-jev-v1.5; reported model matilda-jev-v1.5 (27B). Type: None; technique: None. Comparison entry; no current run command, API price or speed inferred from the benchmark.

Model information sources

Release date ↗

56.6±3.5#140 of 355 decision modelsfrom 12 benchmark results across 1 source

$ how it compares

The decision models ranked either side of matilda-jev-v1.5 (27B), out of 357 with a score, then more from Maincode.

#modelscorewhereRAMreleased
140Trio-Spark DI (9B) MachineFi Labs57±1request access
141openjev (DecisionBench ec4ff3df) razorback1657±2model files
142matilda-jev-v1.5 (27B) Maincode57±4model files2026-10-09
143Jebadiah 9B v2.1 (T1e) frontier-infra57±1local~25GB2026-10
144CoCo-Decision-4B 2.4 Corners57±1model files2026-10-16
more from Maincode
31Matilda Decision v1 Maincode68±2model files

see all decision models · find the ones that fit your machine

$ what it's good at

vision▁·▃▂▃▃▇▄▄█▄▃ #43 of 79 · 95% of its score · 12 tests

Beats Surogate Rune 26B-A4B v3, Clef-omni here, though they rank higher overall. Trails JPT-9B Qwen3.5-9B LoRA, Solomon v1.1 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Decision Index Vision 0.4 · Mind2Web (chance-corrected points) submitted63.8200 points ✎▁·▁▁▃▁▄▄▃▅█▂ beats 17/61avg 63.423 points▇▇▇▇▇ 12%blunt
Decision Index Vision 0.4 · MMMU-Pro vision (chance-corrected points) submitted27.2100 points ✎▁▁▅▁▄▁▄█▄▃▇▇ beats 21/61avg 22.797 points▇▇▇▇ 11%blunt
Decision Index Vision 0.4 · Winoground (chance-corrected points) submitted79.7500 points ✎▁·▁▁▁▁·▂▁▃▅█ beats 31/61avg 66.987 points▇▇▇▇ 10%blunt
Decision Index Vision 0.4: private same skills (points)58.6700 points ✎▁▁▃▃▁▂▄▆▃▃▅█ beats 36/61avg 48.067 points▇▇▇▇ 10%blunt
Decision Index Vision 0.4 · Moderation (Hateful Memes) (chance-corrected points) submitted36.8500 points ✎▆▃▃▆▄▄▇██▁▆▆ beats 30/61avg 28.443 points▇▇▇▇ 8.8%blunt
Decision Index Vision 0.4 · RealWorldQA (chance-corrected points) submitted58.9400 points ✎▁·▂▂▁▃▃▅▅▃▂█ beats 27/61avg 53.651 points▇▇▇ 8.0%blunt
Decision Index Vision 0.4 · CharXiv (chance-corrected points) submitted75.9400 points ✎▂▁▁▁▁▃▁▅▅▆██ beats 39/61avg 62.137 points▇▇▇ 7.8%blunt
Decision Index Vision 0.4 · InfographicVQA (chance-corrected points) submitted77.0500 points ✎▁·▁▂▃▁▃▁▂▂▅█ beats 9/61avg 83.859 points▇▇ 6.2%blunt
4 more tests
testresultvs the others in its rundifficultycountswhy
Decision Index Vision 0.4 · R-Bench-M (chance-corrected points) submitted37.1900 points ✎▂▄▇▆█▄▄▇▂··▁ beats 53/61avg 19.676 points▇▇ 6.2%blunt
Decision Index Vision 0.4 · BLINK (chance-corrected points) submitted53.2800 points ✎▁···▁▂▂▂█▄▂▃ beats 27/61avg 44.994 points▇▇ 5.9%blunt
Decision Index Vision 0.4 · CV-Bench (chance-corrected points) submitted76.4400 points ✎▁▁▁▁▂▁▁▁▄█▃▃ beats 43/61avg 67.662 points▇▇ 4.7%blunt
Decision Index Vision 0.4 · KIE (CORD+FUNSD) (chance-corrected points) submitted90.3800 points ✎▁··▁▁▁▁▁▂▄█▁ beats 23/61avg 85.184 points▇ 3.4%blunt

$ where to run it

Download model files ↗
Published model files verified. This is a verified repository snapshot; the benchmark does not establish an identical weight revision. A local run command and hardware requirements have not been verified for this entry. Source · checked 2026-10-31.

Model repository and documentation: huggingface.co/Maincode ↗

$ how the score was worked out · Decision Index Vision 0.4 95%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Decision Index Vision 0.4 · submitted; independent execution unverified12CC BY 4.0
prior · pull toward the middle
weighted average= 56.6

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json