whatmodel.sh / BLOOMZ 1.1B

BLOOMZ 1.1B is an open-weights language model from BigScience, released November 2022. Its published size is 1.07B parameters. Licence: bigscience-bloom-rail-1.0.

Catalogue identity notes

BLOOM 1.1B multitask-finetuned on xP3 (arXiv 2211.01786); checkpoint bigscience/bloomz-1b1.

Model information sources

Release date ↗

17.9±3.3comparison only: no current run option verifiedfrom 5 benchmark results across 2 sources

Score within the LMArena (text) comparison set only.

$ how it compares

The LLMs ranked either side of BLOOMZ 1.1B, out of 877 with a score, then more from BigScience.

#modelscorewhereRAMreleased
840GPT-Neo 2.7B EleutherAI18±1local~13GB2021-03
841StableLM-Tuned-Alpha 7B Stability AI18±2local~6.9GB2023-04
842BLOOMZ 1.1B BigScience18±3comparison only2022-11
843T5 Large Google17±2local~4.6GB2019-10
844Gemma 3 270M IT Google16±4local~1.1GB2025-08
more from BigScience
743T0 11B BigScience35±3comparison only2021-10
759BLOOMZ 176B BigScience33±2comparison only2022-11
796BLOOMZ 7.1B BigScience29±2comparison only2022-11

see all LLMs · find the ones that fit your machine

$ what it's good at

coding█···▄·▄·▄··▄ #5 of 6 * · 71% of its score · 1 test
testresultvs the others in its rundifficultycountswhy
HumanEval lab2.6% ✎██··█··█·█·█ beats 1/5medium · avg 58%▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 71%sharp · too hard for it
other tests4 not in a task · 24% of its score
testresultvs the others in its rundifficultycountswhy
WinoGrande lab51.1% ✎█··▁▃·▁··▁·▃ beats 8/12medium · avg 68%▇▇▇▇▇ 12%too hard for it · noisy
COPA lab58.0% ✎▃··█▅▃▃▅·▃▃▃ beats 5/12easy · avg 91%▇▇▇▇ 8.9%at its level · noisy
Story Cloze Test lab59.0% ✎█·▂··▃··▂▂▂▃ beats 7/12easy · avg 88%▇ 2.1%blunt · at its level · noisy
IndoMMLU (zero-shot)22.4% ✎▅▃▅··▃···▃▃█ beats 0/10hard · avg 37%▇ 1.6%blunt · too hard for it · noisy

$ where to run it

No verified API or download recorded yet · add one

Official weights and documentation: huggingface.co/bigscience ↗

$ how the score was worked out · Crosslingual Generalization t… 94%, Large Language Models Only Pa… 2%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Crosslingual Generalization through Multitask Finetuning — authors' own runs · lab-reported4CC BY 4.0
Large Language Models Only Pass Primary School Exams in Indonesia: A Comprehensive Test on IndoMMLU — authors' own runs1CC BY 4.0
prior · pull toward the middle
weighted average= 17.9

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json