whatmodel.sh / Jurassic-1 Jumbo (J1-Jumbo, 178B)

Jurassic-1 Jumbo (J1-Jumbo, 178B)

+ contribute
Update model informationAdd a place to run itAdd a test resultPropose a benchmarkCorrect a benchmark scoreEdit data on GitHub

Jurassic-1 Jumbo (J1-Jumbo, 178B) is a closed-weights language model from AI21 Labs, released August 2021. Its published size is 178B parameters. Licence: proprietary.

Catalogue identity notes

AI21 Labs' J1-Jumbo (178B, 76 layers, 256K vocabulary) as described in AI21's white paper 'Jurassic-1: Technical Details and Evaluation' (PDF created 2021-08-11; abstract: 'recently released by AI21 Labs'). Served only through AI21 Studio; weights never released; later retired. Comparison-only.

Model information sources

Release date ↗

65.0±10.7comparison only: no current run option verifiedfrom 7 benchmark results across 1 source

Score within the ARC Challenge comparison set only.

$ how it compares

Scored LLMs released closest to Jurassic-1 Jumbo (J1-Jumbo, 178B), out of 1182 with a score, then more from AI21 Labs.

#modelscorewhereRAMreleased
979T0+ (T0p) 11B BigScience38±9comparison only2021-10
1027Codex code-cushman-001 OpenAI35±5comparison only2021-08
1028T0 11B BigScience35±3comparison only2021-10
1050Codex code-davinci-001 OpenAI33±1comparison only2021-08
1121GPT-J 6B EleutherAI25±1local~14GB2021-06
more from AI21 Labs
325Jamba 1.6 Large AI21 Labs59±11local~839GB2025-02
495Jamba 1.6 Mini AI21 Labs54±10local~34GB2025-02
546Jamba 1.5 Large AI21 Labs52±1local~839GB2024-08

see all LLMs · find the ones that fit your machine

$ what it's good at

other tests7 not in a task · 38% of its score
testresultvs the others in its rundifficultycountswhy
PIQA lab81.4% ✎▁▁▁▂▂▃▅█▅▃▁▁ beats 103/123medium · avg 80%▇▇▇▇ 9.4%sharp · at its level · small run
Story Cloze Test lab83.1% ✎▃▃▃▂▅█▅▂▁··▂ beats 40/50medium · avg 82%▇▇▇ 8.4%sharp · at its level · small run
ARC Easy lab67.1% ✎▁▃▂▄▆█▅▃▁··▁ beats 52/100medium · avg 65%▇▇▇ 8.1%at its level · small run
WinoGrande lab68.9% ✎▁▁▁▁▂▁▁▅▇█▃▁ beats 82/131hard · avg 67%▇▇ 4.5%at its level · small run
ARC Challenge lab48.1% ✎▄▁▁▂▁▄█▇▃▂▃▂ beats 82/140hard · avg 45%▇▇ 3.9%at its level · small run
HellaSwag lab79.3% ✎▁▁▁▂▂▂▄▆█▇▄▂ beats 107/135easy · avg 75%▇ 3.7%at its level · small run
BoolQ lab73.5% ✎▁····▁▂█▆▅▆▄ beats 60/103medium · avg 70%▇ 0.4%blunt · at its level · small run

$ where to run it

No verified API or download recorded yet · add one

$ how the score was worked out · AI21 Labs official docs 38%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
AI21 Labs official docs · lab-reported7Factual first-party specification (not licensed content)
prior · pull toward the middle
weighted average= 65.0

$ improve this page

Update model informationAdd a place to run itAdd a test resultPropose a benchmarkCorrect a benchmark scoreEdit data on GitHub

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json