whatmodel.sh / GPT-3.5 Turbo (1106)

GPT-3.5 Turbo (1106) is a closed-weights language model from OpenAI, released November 2023. Licence: proprietary.

Catalogue identity notes

Comparison model from the Epoch AI internal-evaluation CSVs (Epoch release date 2023-11-06). Dated API snapshot gpt-3.5-turbo-1106. OpenAI deprecations page: shutdown date 2026-09-28, so treated as retired.

46.2±0.6comparison only: no current run option verifiedfrom 12 benchmark results across 8 sources

$ how it compares

The LLMs ranked either side of GPT-3.5 Turbo (1106), out of 828 with a score, then more from OpenAI.

#modelscorewhereRAMreleased
493OLMo 2 13B Instruct (1124) Allen Institute for AI46±1local~9.6GB2024-12
494Falcon-H1 7B Instruct TII46±3local~6GB2025-05
495GPT-3.5 Turbo (1106) OpenAI46±1comparison only2023-11
496Cogito v1 Preview Llama 3B Deep Cogito46±4local~3.4GB2025-03
497Code Llama 70B Instruct Meta46±1local~28GB2024-01
more from OpenAI
1GPT-6 Astra OpenAI87±1api $20.00/M2026-09
3GPT-6.1 Sol OpenAI85±1api $4.00/M2026-09
7GPT-6 Sol OpenAI83±1api $4.00/M2026-09

see all LLMs · find the ones that fit your machine

$ what it's good at

coding▁▁▁▃▅▇█▇▅▄▃▁ #323 of 524 · 50% of its score · 3 tests

Beats Qwen3-VL 32B Instruct, Solar Open 100B (102B-A12B), GLM-4.7-Flash here, though they rank higher overall. Trails DeepSeek LLM 67B Chat, Mistral NeMo Instruct (2407), QwQ-32B-Preview here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
HumanEval76.8% ✎▁·▁▁▃▄▆▅█▃▁▁ beats 77/99easy · avg 79%▇▇▇▇▇▇▇▇▇▇ 26%sharp · at its level
HumanEval+70.7% ✎▁·▁▁▁▃▄▄▄█▃▁ beats 72/99easy · avg 74%▇▇▇▇▇▇▇▇ 21%sharp · at its level
MBPP+69.7% ✎▁···▁▁▂▅▇█▆▂ beats 64/75easy · avg 68%▇▇ 3.8%at its level
chat & writing▁▁▁▃▅▄▆█▇▇▇▃ #367 of 463 · 30% of its score · 6 tests

Beats Gemma 4 E4B, OpenThinker3 7B, Gemma 4 E2B here, though they rank higher overall. Trails LFM2 350M, Gemma 3 1B, Flan-T5 XXL here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
AlpacaEval 2 length-controlled19.3% ✎▁▂▂▃▆▆█▆▄▄▁▁ beats 51/122medium · avg 39%▇▇▇▇▇ 12%at its level
Arena-Hard (v0.1, GPT-4-1106 judge)18.9% ✎▂▁▁▅█▅▄▃▃▅▃▁ beats 13/60medium · avg 52%▇▇▇ 8.2%sharp · at its level
Polyrating rating (bias-aware re-fit of Chatbot Arena votes, mid-2024)1106.0 ✎▂▁▂▁▃▇█▆▇▄▂▂ beats 50/95avg 1201▇ 3.2%blunt
LMArena (text)1204.2 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 71/379avg 1268▇ 3.2%blunt
MT-Bench (GPT-4 single-answer grading, LMSYS runs)8.3200 MT-Bench score (1-10) ✎▆▂▂▆▆▄██▂▄▄▆ beats 24/28avg 8.819 MT-Bench score (1-10)▇ 2.8%sharp · noisy
AlpacaEval 1.0 win rate (vs text-davinci-003, GPT-4 judge)86.3% ✎▂▂·▆·▇▃▆█▆▄▂ beats 24/45very easy · avg 96%▇ 0.5%sharp · maxed out · noisy
math▁▂▃▅▇▅▅█▄▁▁▁ #383 of 462 * · 4.8% of its score · 1 test

Beats GPT-3.5 Turbo (0125) here, though they rank higher overall. Trails Qwen3 0.6B, Gemma 7B (base), DeepSeek R1 Distill Qwen 1.5B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
MATH level 515.9% ✎▂▂▅▆▄█▆▃▅▂▃▄ beats 14/92hard · avg 32%▇▇ 4.8%sharp
other tests2 not in a task · 15% of its score
testresultvs the others in its rundifficultycountswhy
LiveBench 2024-07-2634.1% ✎▁▁▁▂▂▃▂█▆▃▅▃ beats 34/61medium · avg 41%▇▇▇▇▇ 13%at its level
GPQA Diamond28.0% ✎▁▁▁▃▂▄▆▄▅▇█▅ beats 13/208hard · avg 40%▇ 2.6%sharp

$ where to run it

No verified API or download recorded yet · add one

$ how the score was worked out · EvalPlus / EvalPerf published… 50%, LiveBench model judgments (HF… 13%, AlpacaEval 1.0 and 2.0 leader… 12% and 5 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json