whatmodel.sh / ChatGPT-4o (2025-03-26)

ChatGPT-4o (2025-03-26) is a closed-weights language model from OpenAI, released March 2025.

Catalogue identity notes

Comparison-only. Arena entry 'chatgpt-4o-latest-20250326' (text, vision). LMArena's leaderboard table (arena-leaderboard space @6f2eeeb) labels 'chatgpt-4o-latest-20250326' as 'ChatGPT-4o-latest (2025-03-26)' (OpenAI, Proprietary), linking https://x.com/OpenAI/status/1905331956856050135. Released 2025-03: OpenAI model release notes: 'Improvements to GPT-4o (March 27, 2025) ... available in ChatGPT and in the API as the newest snapshot of chatgpt-4o-latest'. The Arena entry pins the 2025-03-26 state of the chatgpt-4o-latest alias. OpenAI deprecations page: chatgpt-4o-latest removed 2026-02-17.

64.8±1.6comparison only: no current run option verifiedfrom 3 benchmark results across 2 sources

$ how it compares

The LLMs ranked either side of ChatGPT-4o (2025-03-26), out of 828 with a score, then more from OpenAI.

#modelscorewhereRAMreleased
164EXAONE 4.5 33B LG AI Research65±2local~24GB2026-04
165Qwen3.5 Flash Alibaba65±1api $0.17/M2026-02
166ChatGPT-4o (2025-03-26) OpenAI65±2comparison only2025-03
167INTELLECT-3 Prime Intellect65±1local~48GB2025-11
168Nemotron 3 Super 120B-A12B NVIDIA65±1api $0.28/M +local~73GB2026-03
more from OpenAI
1GPT-6 Astra OpenAI87±1api $20.00/M2026-09
3GPT-6.1 Sol OpenAI85±1api $4.00/M2026-09
7GPT-6 Sol OpenAI83±1api $4.00/M2026-09

see all LLMs · find the ones that fit your machine

$ what it's good at

coding▁▁▁▃▅▇█▇▅▄▃▁ #179 of 524 * · 62% of its score · 1 test

Beats Gemini 2.5 Pro, Gemini 3.1 Flash-Lite, Qwen3-Coder-Next (80B-A3B) here, though they rank higher overall. Trails QwQ-32B-Preview, Ministral 3 8B Reasoning 2512, Phi-4-reasoning 14B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Aider polyglot (225 exercises, two attempts)45.3% ✎▂·▂▃▅▂▃█▆▄▂▂ beats 23/49very hard · avg 8.5%▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 62%sharp · at its level
chat & writing▁▁▁▃▅▄▆█▇▇▇▃ #68 of 463 * · 22% of its score · 1 test

Beats GPT-5.2, Qwen3.8 27B, LongCat 2.0 (1.6T-A48B) here, though they rank higher overall.

testresultvs the others in its rundifficultycountswhy
LMArena (text)1442.9 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 305/379avg 1268▇▇▇▇▇▇▇▇▇ 22%blunt
vision & documents▁▁▃▃▂▃▅▄▇▇█▃ #63 of 182 * · 15% of its score · 1 test

Beats DeepSeek V4 Flash Vision (Exp), GPT-5, MiniMax-M3 here, though they rank higher overall. Trails Gemma 4 26B-A4B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Arena vision (style controlled)1238.8 ✎▁▁▂▂▂▂▄▅▅▆██ beats 93/145avg 1068▇▇▇▇▇▇ 15%blunt

$ where to run it

No verified API or download recorded yet · add one

$ how the score was worked out · Aider polyglot benchmark runs 62%, LMArena leaderboard dataset 37%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Aider polyglot benchmark runs1▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 62%Apache-2.0
LMArena leaderboard dataset2▇▇▇▇▇▇▇▇▇▇▇ 37%CC BY 4.0
prior · pull toward the middle▇ 1%
weighted average= 64.8

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json