whatmodel.sh / U-PaLM 62B
U-PaLM 62B
↗ share
+ contribute
U-PaLM 62B is a closed-weights language model from Google, released October 2022. Its published size is 62.5B parameters. Licence: proprietary.
Catalogue identity notes
Google's PaLM 62B continued with the UL2R objective (Tay et al., arXiv:2210.11399, Tables 2-3). Never released. Comparison-only.
Model information sources
Score within the LMArena (text) comparison set only.
$ how it compares
The LLMs ranked either side of U-PaLM 62B, out of 877 with a score, then more from Google.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 628 | 42±0 | local | |||
| 629 | 42±3 | local | |||
| 630 | 42±2 | never released | |||
| 631 | 42±1 | local | |||
| 632 | OpenHermes-2.5-Code-290k-13B | 42±1 | local | ||
| more from Google | |||||
| 11 | 80±1 | api $4.00/M | |||
| 26 | 76±1 | api $1.50/M | |||
| 34 | 75±1 | api $1.50/M | |||
$ what it's good at
other tests7 not in a task · 98% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| WinoGrande lab | 76.2% ✎ | ▁▁▁▁▂▁▁▅▇█▃▁ beats 115/131 | 20% |
| TriviaQA lab | 68.3% ✎ | ▁▁▂▂▄▄▃▆▅█▅▂ beats 65/80 | 17% |
| HellaSwag lab | 79.7% ✎ | ▁▁▁▂▂▂▄▆█▇▄▂ beats 108/135 | 16% |
| BoolQ lab | 85.4% ✎ | ▁····▁▂█▆▅▆▄ beats 94/103 | 16% |
| Natural Questions (closed book) lab | 18.7% ✎ | ▂▁▁▁▂▄▄▃▅█▅▁ beats 41/68 | 16% |
| LAMBADA (OpenAI version), last-word accuracy lab | 79.7% ✎ | ▁·····▁▁▃▃██ beats 85/86 | 7.2% |
| PIQA lab | 81.4% ✎ | ▁▁▁▂▂▃▅█▅▃▁▁ beats 104/123 | 5.6% |
$ where to run it
No verified API or download recorded yet · add one
$ how the score was worked out · Transcending Scaling Laws wit… 98%
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
| source | results | share of the score |
|---|---|---|
| 7 | 98% | |
| prior · pull toward the middle | 2% | |
| weighted average | = 42.3 |
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json