whatmodel.sh / decision / Mercury Decide (paid endpoint)

Mercury Decide (paid endpoint) is a closed-weights decision model from Inception. Licence: proprietary.

Catalogue identity notes

Named hosted endpoint verified 2026-10-31. Perch records the requested model and test date; the service may change its weights. No immutable current-weight equivalence asserted. Paid endpoint inception/mercury-decide, recorded revision inception/mercury-decide-20260930; kept separate from the free endpoint.

65.2±1.4#56 of 355 decision modelsfrom 27 benchmark results across 4 sources

$ how it compares

The decision models ranked either side of Mercury Decide (paid endpoint), out of 357 with a score, then more from Inception.

#modelscorewhereRAMreleased
54StartLux-Decision v1.1 4B StartLux65±1model files
55Quyet-1.0-Large chinhnc65±1model files
56Mercury Decide (paid endpoint) Inception65±1api price unknown
57Jebadiah 27B v2.1 (T1e) frontier-infra65±1local~69GB2026-10
58OneJev1.5-27B OmniJev65±4model files2026-10-13
more from Inception
77Mercury Decide (free endpoint) Inception63±2api price unknown

see all decision models · find the ones that fit your machine

$ what it's good at

retrieval & classification▁▁▁·▁▁▁▁▃▃█▅ #83 of 258 * · 6.1% of its score · 2 tests

Beats AutoTrust-JEV-27B v1.1, oenogarum (Gemma 4 31B), Decider 31B (NVFP4) here, though they rank higher overall. Trails StartLux-Decision v1.1 0.8B, Standard One 3B SH (v4), ezjev 4B s2 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
LeanMCP · scifact rank noul74.3% ✎▂····▂···▃▅█ beats 8/11medium · avg 62%▇ 3.2%at its level
LeanMCP · nfcorpus rank noul37.5% ✎▃▃·····▃▃▅██ beats 8/11hard · avg 29%▇ 2.9%blunt · at its level
knowledge & reasoning▁▂▂▂▂▃▃▅▅▆█▂ #36 of 263 · 48% of its score · 7 tests

Beats vera-large, KnowLine 26B-A4B Gen2.5, OneJev1.6-27B here, though they rank higher overall. Trails Solar Decide, Clef-omni, GPT-6 Luna Decisions here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Etsabary · 1342 text decisions75.8% ✎▁··▂·▃▅▁▃▂▂█ beats 12/24medium · avg 47%▇▇▇▇▇▇▇ 19%sharp · at its level
LeanMCP · scienceqa text94.2% ✎▄··▄█▄█▄·█▄▄ beats 7/11very easy · avg 88%▇▇▇ 6.3%sharp · maxed out
LeanMCP · medqa usmle84.9% ✎▄▄▄·▄▄▄▄▄·██ beats 7/11easy · avg 72%▇▇ 6.1%typical
MedQA · Freyer et al. (first-valid accuracy)85.2% ✎█··▃▃·▃▃▃·▃█ beats 7/11easy · avg 72%▇▇ 4.7%typical
LeanMCP · pubmedqa65.6% ✎▂···▂·▂·▄▄▂█ beats 4/11medium · avg 54%▇▇ 4.7%at its level
LeanMCP · medmcqa72.6% ✎▃·▃··▃█▃·▅▅▃ beats 6/11medium · avg 63%▇▇ 4.5%typical
LeanMCP · mmlu pro64.5% ✎▄··▄▄████··▄ beats 3/11medium · avg 54%▇ 3.5%at its level
vision▁·▃▂▃▃▇▄▄█▄▃ #9 of 79 * · 13% of its score · 1 test

Beats Fastino GLiDE 1.2, StartLux-Decision v1.1 27B, vLLM-SR d3-ultra (Decision 3.0, 27B) here, though they rank higher overall. Trails Mercury Decide (free endpoint), Clef, Jev 1.14 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Etsabary · 200 image decisions71.0% ✎▂▂··▂▃▂·█▃▂▂ beats 7/14medium · avg 45%▇▇▇▇▇ 13%sharp · at its level
workflows▁▁▁▂▁▂▂▆█▄▃▁ #3 of 114 · 31% of its score · 22 tests

Beats baselabs mammoth-1 (27B), Nace.AI Drex Max v1 (27B), Perplexity Decider v1.2 (27B) here, though they rank higher overall.

testresultvs the others in its rundifficultycountswhy
LeanMCP · mcpbench server routing100.0% ✎█·███··▄···▄ beats 9/9easy · avg 82%▇▇ 5.7%sharp · maxed out
LeanMCP · mcpmark server routing57.1% ✎▂··▂··▄█▂·▂▄ beats 10/11medium · avg 36%▇▇ 4.5%at its level
LeanMCP · rewardbench279.3% ✎▄▄▄·▄▄▄▄█·█▄ beats 10/11medium · avg 58%▇▇ 3.9%typical
LeanMCP · aegis2 response77.2% ✎█··▃·▃·█··▅▅ beats 4/11easy · avg 70%▇ 3.3%typical
LeanMCP · helpsteer2 helpfulness0.9469 ordinal levels ✎▄▄▄▄▄·▄·█▄▄▄ beats 7/10avg 1.357 ordinal levels▇ 2.6%blunt
LeanMCP · sst50.4768 ordinal levels ✎▂·····▂▂▄█▄▃ beats 11/11avg 0.879 ordinal levels▇ 2.5%blunt
LeanMCP · atbench50068.8% ✎▃··▅▅█··▅··▅ beats 2/11medium · avg 63%▇ 2.2%sharp · noisy
LeanMCP · mcpbench tool selection100.0% ✎▂··········█ beats 2/9very easy · avg 89%▇ 2.1%sharp · maxed out · noisy
14 more tests
testresultvs the others in its rundifficultycountswhy
LeanMCP · prompt injections81.0% ✎▂▂▂▂█·▄▃···▂ beats 10/11medium · avg 62%▇ 1.7%typical
LeanMCP · mcpmark tool selection100.0% ✎▂··········█ beats 2/11very easy · avg 96%▇ 1.1%sharp · maxed out · noisy
Perch semantic lint · private (Youden J)0.7887 J ✎█····▄█▄···█ beats 7/7avg 0.380 J▇ 0.6%blunt
Perch semantic lint · public (Youden J)0.7523 J ✎█····▄█▄···█ beats 7/7avg 0.363 J▇ 0.6%blunt
Perch security detection · public (Youden J)0.0929 J ✎█···▄▄···▄▄█ beats 4/7avg 0.052 J▇ 0.1%blunt
Perch bug detection · private (Youden J)0.0436 J ✎▅··▃▃█·····▃ beats 4/7avg 0.027 J▇ 0.1%blunt
Perch bug detection · public (Youden J)0.0318 J ✎█▄·█·▄▄····▄ beats 4/7avg 0.026 J▇ 0.1%blunt
Perch security detection · private (Youden J)0.0210 J ✎█▃▃··▃·▃···▃ beats 4/7avg 0.017 J▇ 0.1%blunt
LeanMCP · jailbreak classification96.8% ✎▂·▄··▂···█▆▂ beats 6/11very easy · avg 95%▇ 0.1%blunt · maxed out · noisy
Prism-1 study · Banking2091.3% ✎█··········█ beats 1/1—not counted yet: no other model in the same run to compare it with
Prism-1 study · Newsgroups73.3% ✎█··········█ beats 0/1—not counted yet: no other model in the same run to compare it with
Prism-1 study · BEV decision mix75.1% ✎█··········█ beats 0/1—not counted yet: no other model in the same run to compare it with
Prism-1 study · Typed decisions67.3% ✎█··········█ beats 0/1—not counted yet: no other model in the same run to compare it with
Prism-1 study · JevBench held-out89.9% ✎█··········█ beats 1/1—not counted yet: no other model in the same run to compare it with

$ where to run it

Through an API

api · OpenRouter · price unknown · openrouter.ai ↗

Model repository and documentation: openrouter.ai ↗

$ how the score was worked out · LeanMCP · JevBench 61%, Etsabary · decision benchmarks 32%, Freyer et al. · MedQA 5% and 1 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
LeanMCP · JevBench18MIT
Etsabary · decision benchmarks2MIT
Freyer et al. · MedQA1CC BY 4.0
Perch benchmark results6CC BY 4.0
prior · pull toward the middle
weighted average= 65.2

not counted (5)

Prism-1: Position- and Rival-Independent Scoring for System One ModelsPrism-1 study · Banking20 [correct]91.3%fewer than three models have this test yet, or this source ran it for this model alone
Prism-1: Position- and Rival-Independent Scoring for System One ModelsPrism-1 study · Newsgroups [correct]73.3%fewer than three models have this test yet, or this source ran it for this model alone
Prism-1: Position- and Rival-Independent Scoring for System One ModelsPrism-1 study · BEV decision mix [correct]75.1%fewer than three models have this test yet, or this source ran it for this model alone
Prism-1: Position- and Rival-Independent Scoring for System One ModelsPrism-1 study · Typed decisions [correct]67.3%fewer than three models have this test yet, or this source ran it for this model alone
Prism-1: Position- and Rival-Independent Scoring for System One ModelsPrism-1 study · JevBench held-out [correct]89.9%fewer than three models have this test yet, or this source ran it for this model alone

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json