whatmodel.sh / decision / H2O Lightning 31B
H2O Lightning 31B
↗ share
+ contribute
H2O Lightning 31B is an open-weights decision model from H2O.ai. Its published size is 31.27B parameters. Licence: other.
Catalogue identity notes
Exact Decision Index tested engine h2o-lightning-31b; reported model H2O Lightning 31B. Type: full fine-tune; technique: autoregressive. Comparison entry; no current run command, API price or speed inferred from the benchmark. Current repository metadata checked separately; an unpinned alias is not evidence that today’s weights reproduce this historical run.
Model information sources
· Weights licence ↗ · Parameter count ↗
Publisher parameter count; includes the served backbone, not just adapter size.
$ how it compares
The decision models ranked either side of H2O Lightning 31B, out of 357 with a score, then more from H2O.ai.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 36 | oenogarum (Gemma 4 31B) | 67±1 | model files | ||
| 37 |  Sieve 27B v2 | 67±1 | model files | ||
| 38 | H2O Lightning 31B | 67±4 | request access | ||
| 39 |  Aleria Judge 1.1.1 (Gemma 4 31B) (decision readout) | 67±1 | source code | ||
| 40 | Cerno 27B | 67±1 | model files | ||
| more from H2O.ai | |||||
| 13 | H2O Lightning 31B v1.1 | 70±2 | request access | ||
see all decision models · find the ones that fit your machine
$ what it's good at
vision▁·▃▂▃▃▇▄▄█▄▃ #18 of 79 · 95% of its score · 12 tests
Beats StartLux-Decision v1.1 27B, Nace.AI Drex Max v1 (27B), AutoTrust-JEV-27B v1.1 here, though they rank higher overall. Trails Clef-flash, Mercury Decide (free endpoint), Clef here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Decision Index Vision 0.4 · Mind2Web (chance-corrected points) submitted | 86.1600 points ✎ | ▁·▁▁▃▁▄▄▃▅█▂ beats 56/61 | 12% |
| Decision Index Vision 0.4 · MMMU-Pro vision (chance-corrected points) submitted | 47.2900 points ✎ | ▁▁▅▁▄▁▄█▄▃▇▇ beats 59/61 | 11% |
| Decision Index Vision 0.4 · Winoground (chance-corrected points) submitted | 85.7500 points ✎ | ▁·▁▁▁▁·▂▁▃▅█ beats 51/61 | 10% |
| Decision Index Vision 0.4: private same skills (points) | 64.6000 points ✎ | ▁▁▃▃▁▂▄▆▃▃▅█ beats 47/61 | 10% |
| Decision Index Vision 0.4 · Moderation (Hateful Memes) (chance-corrected points) submitted | 55.4800 points ✎ | ▆▃▃▆▄▄▇██▁▆▆ beats 59/61 | 8.8% |
| Decision Index Vision 0.4 · RealWorldQA (chance-corrected points) submitted | 64.4900 points ✎ | ▁·▂▂▁▃▃▅▅▃▂█ beats 39/61 | 8.0% |
| Decision Index Vision 0.4 · CharXiv (chance-corrected points) submitted | 83.7100 points ✎ | ▂▁▁▁▁▃▁▅▅▆██ beats 61/61 | 7.8% |
| Decision Index Vision 0.4 · InfographicVQA (chance-corrected points) submitted | 97.8100 points ✎ | ▁·▁▂▁▁▃▁▂▂▅█ beats 51/61 | 6.2% |
4 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Decision Index Vision 0.4 · R-Bench-M (chance-corrected points) submitted | 38.8200 points ✎ | ▂▄▇▆█▄▄▇▂··▁ beats 55/61 | 6.2% |
| Decision Index Vision 0.4 · BLINK (chance-corrected points) submitted | 68.7500 points ✎ | ▁···▁▂▂▂█▄▃▃ beats 52/61 | 5.9% |
| Decision Index Vision 0.4 · CV-Bench (chance-corrected points) submitted | 81.3800 points ✎ | ▁▁▁▁▂▁▁▁▄█▃▃ beats 59/61 | 4.7% |
| Decision Index Vision 0.4 · KIE (CORD+FUNSD) (chance-corrected points) submitted | 91.2500 points ✎ | ▁··▁▁▁▁▁▂▄█▁ beats 30/61 | 3.4% |
$ where to run it
Request access to model files ↗
Gated files: the publisher requires access approval. This is a verified repository snapshot; the benchmark does not establish an identical weight revision. A local run command and hardware requirements have not been verified for this entry. Source · checked 2026-10-31.
Model repository and documentation: huggingface.co/h2oai ↗
$ how the score was worked out · Decision Index Vision 0.4 95%
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
| source | results | share of the score |
|---|---|---|
 Decision Index Vision 0.4 · submitted; independent execution unverified | 12 | 95% |
| prior · pull toward the middle | 5% | |
| weighted average | = 66.9 |
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json