whatmodel.sh / decision / Decider 35B-A3B

Decider 35B-A3B is an open-weights decision model from Mapika, released 20 September 2026. Its published size is 35.95B parameters. Licence: apache-2.0.

Catalogue identity notes

Exact Decision Index tested engine decider-35b-nvfp4; reported model Decider 35B-A3B. Type: full fine-tune; technique: autoregressive. Published checkpoint/base reference: Mapika/decider-35b-a3b-nvfp4. Comparison entry; no current run command, API price or speed inferred from the benchmark. Current repository metadata checked separately; an unpinned alias is not evidence that today’s weights reproduce this historical run.

Model information sources

Release date ↗ · Weights licence ↗ · Parameter count ↗

Publisher parameter count; includes the served backbone, not just adapter size.

55.4±1.3#154 of 355 decision modelsfrom 42 benchmark results across 1 source

$ how it compares

The decision models ranked either side of Decider 35B-A3B, out of 357 with a score, then more from Mapika.

#modelscorewhereRAMreleased
154Tev1-4B-experimental (DecisionBench 0b7becf0) Together56±2model files
155muria (Gemma 4 12B) plantwaterer55±1model files
156Decider 35B-A3B Mapika55±1model files2026-09-20
157Amber 4B MLukauskas55±1model files
158StartLux-Decision v1.1 2B StartLux55±1model files
more from Mapika
43Decider 31B (NVFP4) Mapika66±1model files2026-10
85Decider chat · Gemma-4-31B (decision readout) Mapika62±1source code
110decider-35b-a3b (DecisionBench d9783c58) Mapika60±2model files2026-09-20

see all decision models · find the ones that fit your machine

$ what it's good at

tools & automation▁▃▁▁▁▂▃▄▆██▆ #157 of 250 · 7.4% of its score · 6 tests

Beats Trio-Spark DI (9B) here, though they rank higher overall. Trails JevK5 Lite, Gevva E2B, Amber 0.4B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Decision Index 0.4.1: API-Bank (accuracy) submitted56.5% ✎▁▁▁▁▁▁▁▂▃▂█▂ beats 63/236easy · avg 70%▇ 2.3%sharp · noisy
Decision Index 0.4.1: BFCL (case exact accuracy) submitted92.2% ✎▁▂▁▁▁▂▂▄▅▆█▁ beats 93/246very easy · avg 92%▇ 1.9%sharp · maxed out · noisy
Decision Index 0.4.1: Home appliance simulator (case exact accuracy) submitted23.9% ✎█▁▁▃▄▄▆▄▁▂▁▃ beats 96/243medium · avg 37%▇ 1.2%sharp · at its level · noisy
Decision Index 0.4.1: When2Call (accuracy) submitted59.7% ✎▁▁▁▂▃▅▅▆█▇█▃ beats 66/246easy · avg 72%▇ 1.1%noisy
Decision Index 0.4.1: ToolRet (nDCG@10) submitted66.3% ✎▁▁▁▁▁·▁▁▁▄█▁ beats 170/246medium · avg 60%▇ 1.0%blunt · at its level
Decision Index 0.4.1: RouterBench (selected quality (quality objective)) submitted79.6% ✎no other model yet—failed run: Publisher excludes this protocol because its prompt reveals GPT-4 as the best route. Evidence: https://huggingface.co/spaces/multimodalart/jev-decision-index/blob/c130faf65f82e81d3bdefb01e758c712dc5c5199/data/index.json
retrieval & classification▁▁▁·▁▁▁▁▃▃█▅ #146 of 258 · 6.5% of its score · 7 tests

Beats Quyet-1.0-Large, Decider chat · Qwen3.6-27B (decision readout), Sieve 9B v2 here, though they rank higher overall. Trails Amber 0.4B, jdi-ptr14-0.8b, vLLM-SR vela3-fast (Vela 3.0, 0.4B) here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Decision Index 0.4.1: BRIGHT (nDCG@10) submitted41.7% ✎▁▁▁▁▁▁▁▂▂▄▇█ beats 113/246medium · avg 38%▇ 2.4%blunt · at its level
Decision Index 0.4.1: Amazon ESCI (macro-F1) submitted50.6% ✎▁▁▁▁▁▁▂▂▃▃█▅ beats 109/246medium · avg 47%▇ 2.3%at its level
Decision Index 0.4.1: HoVer (accuracy) submitted63.5% ✎▆▆▇▅▄▄▃▇▄█▆▄ beats 73/246easy · avg 74%▇ 0.6%blunt
Decision Index 0.4.1: PhishNChips phishing decisions (accuracy) submitted66.8% ✎█▅▅▄▃▂▁▁▁▁·▁ beats 114/245easy · avg 70%▇ 0.5%at its level · noisy
Decision Index 0.4.1: CLINC150+OOS (macro-F1) submitted94.7% ✎▁▁▁▁▁▁▁▂▃▆█▄ beats 202/238easy · avg 83%▇ 0.4%sharp · noisy
Decision Index 0.4.1: BANKING77 (macro-F1) submitted89.8% ✎▁·▁▁▁▁▁▁▂█▇█ beats 174/238easy · avg 79%▇ 0.3%noisy
Decision Index 0.4.1: SGD/SGD-X (macro-F1) submitted64.1% ✎no other model yet—failed run: Publisher reports a builder bug exposing dialogue turns after the classified turn; awaiting corrected rerun. Evidence: https://huggingface.co/spaces/multimodalart/jev-decision-index/blob/c130faf65f82e81d3bdefb01e758c712dc5c5199/data/index.json
language understanding▂▂▂▃▂▅▆▃█▆▄▃ #37 of 256 · 23% of its score · 9 tests

Beats Ainvest-Decision-27B v1.0, H2O Lightning 31B v1.1, Turion Jev 31B here, though they rank higher overall.

testresultvs the others in its rundifficultycountswhy
Decision Index 0.4.1: NLI4CT (macro-F1) submitted78.5% ✎▁▁▁▂▂▃▃▄▇▇█▄ beats 137/246easy · avg 74%▇▇ 5.4%typical
Decision Index 0.4.1: ANLI (macro-F1) submitted66.0% ✎▁▂▃▅▅█▂····▁ beats 132/246medium · avg 60%▇▇ 5.3%at its level
Decision Index 0.4.1: HellaSwag (accuracy) submitted96.7% ✎▂▄▂▂▄▇▃▇█▅▃▁ beats 218/246very easy · avg 85%▇▇ 5.1%sharp
Decision Index 0.4.1: iSarcasmEval (Sarcasm F1 · track A, English) submitted54.8% ✎▁·▁·▁▁▂▄▅█▇▄ beats 158/246medium · avg 44%▇ 2.3%at its level
Decision Index 0.4.1: ACOS (per-review F1) submitted27.2% ✎▁··▂▃▃▅▇█▇▃▃ beats 154/246hard · avg 22%▇ 1.2%at its level · noisy
Decision Index 0.4.1: ContractNLI (macro-F1) submitted75.0% ✎▁▁▁▁▁▁▁▂▂▇▇█ beats 117/246easy · avg 71%▇ 1.1%noisy
Decision Index 0.4.1: VAST (macro-F1) submitted54.5% ✎▁▁▁▂▅▄▄▂▄▆█▄ beats 90/246medium · avg 62%▇ 1.0%at its level
Decision Index 0.4.1: RAGTruth (F1 on hallucinated class) submitted63.1% ✎▁▁▁▁▁▁▁▁▁▃▆█ beats 72/246easy · avg 66%▇ 0.8%at its level · noisy
1 more test
testresultvs the others in its rundifficultycountswhy
Decision Index 0.4.1: FinEntity (macro-F1) submitted85.2% ✎▁···▁▁▁▁▃▆█▃ beats 100/246easy · avg 84%▇ 0.7%noisy
arts & human taste▁▇▄▃▅▅█▅▄▂▁▁ #119 of 247 · 9.4% of its score · 6 tests

Beats Bobcat 1.3 (31B), JEV-35B, AJev lora1 (Gemma 4 26B-A4B) here, though they rank higher overall. Trails vLLM-SR vela3-fast-vision (Vela 3.0, 0.25B), Crivo-400M, Amber 0.4B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Decision Index 0.4.1: New Yorker (accuracy) submitted64.0% ✎▁▁▂▃▃▃▇▅█▅▃▁ beats 124/246medium · avg 61%▇▇ 4.0%at its level
Decision Index 0.4.1: Humicroedit (accuracy) submitted62.0% ✎▁·▁▃▂▂▅█▄▂▁▁ beats 147/246medium · avg 60%▇ 1.9%blunt · at its level
Decision Index 0.4.1: BPoMP (accuracy) submitted89.1% ✎▁█▄▄▅█▆▅▄▁▁▁ beats 129/246easy · avg 83%▇ 1.2%sharp · noisy
Decision Index 0.4.1: cfcolor (accuracy) submitted64.9% ✎▁········▁▇█ beats 178/246medium · avg 60%▇ 1.1%blunt · at its level
Decision Index 0.4.1: POP909-CL (accuracy) submitted6.7% ✎▄▅▅▃▆▅▃▅▂▅▃█ beats 83/237hard · avg 21%▇ 0.9%sharp · at its level · noisy
Decision Index 0.4.1: Habermas Machine (accuracy) submitted46.4% ✎▁▂▄█▇▅▁▁▄▄▁▁ beats 151/246medium · avg 47%▇ 0.3%blunt · at its level
knowledge & reasoning▁▂▂▂▂▃▃▅▅▆█▂ #98 of 263 · 45% of its score · 14 tests

Beats KnowLine 4B Gen5.5, Jeffan-4B-2010, Senova-4B v2 here, though they rank higher overall.

testresultvs the others in its rundifficultycountswhy
Decision Index 0.4.1: MMLU-Pro (accuracy) submitted60.5% ✎▄▄▃▃▂▄▅▇██▅▁ beats 159/246medium · avg 46%▇▇▇▇ 10%sharp · at its level
Decision Index 0.4.1: MMLU (accuracy) submitted82.6% ✎▁▄▄▃▃▂▅▇▅█▇▁ beats 164/246easy · avg 70%▇▇▇ 7.0%sharp
Decision Index 0.4.1: BBH (accuracy) submitted71.3% ✎▄▆▄▄█▇▇▄▃▁▁▁ beats 141/246easy · avg 66%▇▇▇ 6.4%at its level
Decision Index 0.4.1: ARC-Challenge (accuracy) submitted96.3% ✎▂▂▂▂▂▂▁▃▄▆█▆ beats 171/246very easy · avg 90%▇▇ 3.9%sharp · maxed out
Decision Index 0.4.1: GSM8K (accuracy (4- and 10-choice)) submitted41.5% ✎▁··▄█▆▆▆▅▅▃▁ beats 115/246medium · avg 45%▇ 3.5%sharp · at its level
Decision Index 0.4.1: GPQA Diamond (accuracy) submitted40.8% ✎▂▆▅▅▆█▆▃▁··▁ beats 117/246medium · avg 39%▇ 3.2%blunt · at its level
Decision Index 0.4.1: WinoGrande (accuracy) submitted88.6% ✎█▅█▅▄█▆▄▃▃▁▁ beats 192/246easy · avg 78%▇ 3.1%typical
Decision Index 0.4.1: ARC-Easy (accuracy) submitted99.0% ✎▁▁▂▁▂▂▂▂▃▆█▅ beats 191/246very easy · avg 96%▇ 1.9%sharp · maxed out · noisy
6 more tests
testresultvs the others in its rundifficultycountswhy
Decision Index 0.4.1: SATA-Bench (case exact accuracy) submitted34.7% ✎▁▁▁▁▁▁▁▂▅█▂▁ beats 202/246hard · avg 22%▇ 1.4%at its level
Decision Index 0.4.1: MuSR (accuracy) submitted61.8% ✎▁▁▂█▅▄▁▁▁▁▁▁ beats 149/246medium · avg 60%▇ 1.2%blunt · at its level
Decision Index 0.4.1: CRUXEval (accuracy) submitted59.8% ✎██▄▃▃▄▁▁···▁ beats 143/246medium · avg 58%▇ 1.1%at its level · noisy
Decision Index 0.4.1: CLadder (accuracy) submitted66.7% ✎▁███▆▅▃▃▁▁▁▁ beats 107/246easy · avg 71%▇ 1.0%at its level
Decision Index 0.4.1: ChessBench (accuracy) submitted10.9% ✎▄▇▄▄▄▆▄█▄▁▁▁ beats 72/246hard · avg 16%▇ 0.7%blunt
Decision Index 0.4.1: HLE (accuracy) submitted8.8% ✎▁▁▃▃▆█▇▅▅▃▁▁ beats 10/246very hard · avg 13%▇ 0.0%blunt
other tests2 not in a task · 8.3% of its score
testresultvs the others in its rundifficultycountswhy
Decision Index 0.4.1: private same skills (equated points)44.5900 points ✎▂▂▂▃▃▃▄▅▅▇█▃ beats 121/247avg 41.206 points▇▇ 5.4%blunt
Decision Index 0.4.1: private new domains (equated points)49.7200 points ✎▃█▃▃▂▆▃▃▄▄▄▄ beats 157/247avg 38.861 points▇ 3.0%blunt

$ where to run it

Download model files ↗
Published model files verified. This is a verified repository snapshot; the benchmark does not establish an identical weight revision. A local run command and hardware requirements have not been verified for this entry. Source · checked 2026-10-31.

Model repository and documentation: huggingface.co/Mapika ↗

$ how the score was worked out · Decision Index 0.4.1 99%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Decision Index 0.4.1 · submitted; independent execution unverified42CC BY 4.0
prior · pull toward the middle
weighted average= 55.4

not counted (2)

Decision Index 0.4.1Decision Index 0.4.1: RouterBench (selected quality (quality objective)) [correct]79.6%failed run: Publisher excludes this protocol because its prompt reveals GPT-4 as the best route. Evidence: https://huggingface.co/spaces/multimodalart/jev-decision-index/blob/c130faf65f82e81d3bdefb01e758c712dc5c5199/data/index.json
Decision Index 0.4.1Decision Index 0.4.1: SGD/SGD-X (macro-F1) [correct]64.1%failed run: Publisher reports a builder bug exposing dialogue turns after the classified turn; awaiting corrected rerun. Evidence: https://huggingface.co/spaces/multimodalart/jev-decision-index/blob/c130faf65f82e81d3bdefb01e758c712dc5c5199/data/index.json

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json