whatmodel.sh / GPT-3.5 Turbo 16K (0613)

GPT-3.5 Turbo 16K (0613) is a closed-weights language model from OpenAI, released June 2023. Licence: proprietary.

Catalogue identity notes

Comparison-only: retired or no longer listed API model, kept so its independent runs can be scored. Dated OpenAI API snapshot gpt-3.5-turbo-16k-0613 (16K-context variant of the June 2023 GPT-3.5 Turbo). OpenAI deprecations page: deprecated with the November 6, 2023 GPT-3.5 Turbo update, shutdown date 2024-09-13. Distinct from the catalogued gpt-3.5-turbo-0613/1106/0125 snapshots.

43.3±1.8comparison only: no current run option verifiedfrom 2 benchmark results across 1 source* thinly tested, treat the rank as provisional

$ how it compares

The LLMs ranked either side of GPT-3.5 Turbo 16K (0613), out of 1132 with a score, then more from OpenAI.

#modelscorewhereRAMreleased
791Phi-3.5-mini-instruct Microsoft43±1local~3.7GB2024-08
792Hermes 2 Theta Llama 3 8B Nous Research43±2local~6.6GB2024-05
793GPT-3.5 Turbo 16K (0613) OpenAI43±2comparison only2023-06
794Yi 34B Chat 01.AI43±1local~23GB2023-11
795internlm2-chat-7b-ExPO Chujie Zheng (ExPO)43±2local~6.4GB2024-05
more from OpenAI
1GPT-6 Astra OpenAI87±1api $20.00/M2026-09
3GPT-6.1 Sol OpenAI85±1api $4.00/M2026-09
7GPT-6 Sol OpenAI83±1api $4.00/M2026-09

see all LLMs · find the ones that fit your machine

$ what it's good at

chat & writing▁▁▁▃▅▅▆█▆▆▆▂ #448 of 579 * · 99% of its score · 2 tests

Beats Ministral 3 14B Reasoning 2512, Gemma 4 E4B, OpenThinker3 7B here, though they rank higher overall. Trails LFM2 350M, Gemma 3 1B, Flan-T5 XXL here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
AlpacaEval 2 length-controlled22.7% ✎▁▂▂▃▆▆█▆▄▄▁▁ beats 59/122medium · avg 39%▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 92%typical
AlpacaEval 1.0 win rate (vs text-davinci-003, GPT-4 judge)93.4% ✎▂▂·▆·▇▃▆█▆▄▂ beats 37/45very easy · avg 96%▇▇ 6.1%sharp · noisy

$ where to run it

No verified API or download recorded yet · add one

$ how the score was worked out · AlpacaEval 1.0 and 2.0 leader… 99%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
AlpacaEval 1.0 and 2.0 leaderboards (tatsu-lab/alpaca_eval repository)2▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 99%Apache-2.0
prior · pull toward the middle▇ 1%
weighted average= 43.3

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json