whatmodel.sh / BLOOMZ 7.1B MT

BLOOMZ 7.1B MT is an open-weights language model from BigScience, released November 2022. Its published size is 7.07B parameters. Licence: bigscience-bloom-rail-1.0.

Catalogue identity notes

BLOOM 7.1B multitask-finetuned on xP3mt (xP3 plus machine-translated prompts; Muennighoff et al., arXiv 2211.01786); checkpoint bigscience/bloomz-7b1-mt. Not plain BLOOMZ-7b1.

Model information sources

Release date ↗

47.0±9.7comparison only: no current run option verifiedfrom 1 benchmark result across 1 source* thinly tested, treat the rank as provisional

Score within the LMArena (text) comparison set only.

$ how it compares

The LLMs ranked either side of BLOOMZ 7.1B MT, out of 1182 with a score, then more from BigScience.

#modelscorewhereRAMreleased
732Jais Family 30B 8K Chat Inception (G42)47±3local~131GB2024-08
733internlm2-chat-20b-ExPO Chujie Zheng (ExPO)47±2local~14GB2024-05
734BLOOMZ 7.1B MT BigScience47±10comparison only2022-11
735Qwen2-VL 7B Instruct Alibaba47±1local~5.8GB2024-08
736DeepSeek R1 Distill Llama 8B DeepSeek47±1local~6.2GB2025-01
more from BigScience
979T0+ (T0p) 11B BigScience38±9comparison only2021-10
1028T0 11B BigScience35±3comparison only2021-10
1049BLOOMZ 176B BigScience33±2comparison only2022-11

see all LLMs · find the ones that fit your machine

$ what it's good at

other tests1 not in a task · 58% of its score
testresultvs the others in its rundifficultycountswhy
CAIL charge prediction, zero-shot open question (accuracy)49.8% ✎█···█··█···█ beats 2/3medium · avg 54%▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 58%blunt · at its level

$ where to run it

No verified API or download recorded yet · add one

Official weights and documentation: huggingface.co/bigscience ↗

$ how the score was worked out · A Comprehensive Evaluation of… 58%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
A Comprehensive Evaluation of Large Language Models on Legal Judgment Prediction — authors' own runs1CC BY 4.0
prior · pull toward the middle
weighted average= 47.0

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json