whatmodel.sh / BLOOMZ 1.1B
BLOOMZ 1.1B
↗ share
+ contribute
BLOOMZ 1.1B is an open-weights language model from BigScience, released November 2022. Its published size is 1.07B parameters. Licence: bigscience-bloom-rail-1.0.
Catalogue identity notes
BLOOM 1.1B multitask-finetuned on xP3 (arXiv 2211.01786); checkpoint bigscience/bloomz-1b1.
Model information sources
Score within the LMArena (text) comparison set only.
$ how it compares
The LLMs ranked either side of BLOOMZ 1.1B, out of 877 with a score, then more from BigScience.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 840 | 18±1 | local | |||
| 841 | 18±2 | local | |||
| 842 | 18±3 | comparison only | |||
| 843 | 17±2 | local | |||
| 844 | 16±4 | local | |||
| more from BigScience | |||||
| 743 | 35±3 | comparison only | |||
| 759 | 33±2 | comparison only | |||
| 796 | 29±2 | comparison only | |||
$ what it's good at
coding█···▄·▄·▄··▄ #5 of 6 * · 71% of its score · 1 test
other tests4 not in a task · 24% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| WinoGrande lab | 51.1% ✎ | █··▁▃·▁··▁·▃ beats 8/12 | 12% |
| COPA lab | 58.0% ✎ | ▃··█▅▃▃▅·▃▃▃ beats 5/12 | 8.9% |
| Story Cloze Test lab | 59.0% ✎ | █·▂··▃··▂▂▂▃ beats 7/12 | 2.1% |
| IndoMMLU (zero-shot) | 22.4% ✎ | ▅▃▅··▃···▃▃█ beats 0/10 | 1.6% |
$ where to run it
No verified API or download recorded yet · add one
Official weights and documentation: huggingface.co/bigscience ↗
$ how the score was worked out · Crosslingual Generalization t… 94%, Large Language Models Only Pa… 2%
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
| source | results | share of the score |
|---|---|---|
| 4 | 94% | |
| 1 | 2% | |
| prior · pull toward the middle | 5% | |
| weighted average | = 17.9 |
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json