whatmodel.sh / EXAONE 4.0 32B
EXAONE 4.0 32B
↗ share
+ contribute
EXAONE 4.0 32B is an open-weights language model from LG AI Research, released July 2025. Its published size is 32B parameters and a 131k-token context window. Licence: exaone.
$ how it compares
The LLMs ranked either side of EXAONE 4.0 32B, out of 828 with a score, then more from LG AI Research.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 249 | 59±2 | local | |||
| 250 | 59±1 | api $0.0000/M +local | |||
| 251 | 59±1 | local | |||
| 252 | 59±1 | local | |||
| 253 | 59±1 | local | |||
| more from LG AI Research | |||||
| 127 | 67±1 | local | |||
| 162 | 65±1 | local | |||
| 164 | 65±2 | local | |||
$ what it's good at
agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #181 of 300 · 32% of its score · 7 tests
Beats o1 (2024-12-17), o3-mini, DeepSeek R1 0528 here, though they rank higher overall. Trails SmolLM3 3B, Jamba 1.5 Mini, Mellum2 12B-A2.5B Instruct here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| τ²-bench Telecom +1 | 26.1% ✎ | ▁·▅█▆▅▂▃▃▂▃▁ beats 16/89 | 8.9% |
| τ²-bench Retail +1 | 59.5% ✎ | ▁····▂▁▃▆█▃▁ beats 22/44 | 6.8% |
| τ²-bench Airline +1 | 45.6% ✎ | ▁▁·▂▁▃▂▃█▅▂▃ beats 14/42 | 5.2% |
| Terminal-Bench Hard | 3.6% ✎ | ▂▅▆▂▂▆▂▂█▅▅▂ beats 6/27 | 4.6% |
| τ-bench Retail lab | 62.8% ✎ | ▁····▃·▂▇█▂▆ beats 13/28 | 3.6% |
| τ-bench Airline lab | 51.5% ✎ | ▁▁▁·▅▄▁█▇▃▁▇ beats 22/28 | 2.6% |
| BFCL v3 lab | 63.9% ✎ | ▁▁▁▁▁▃▅█▆▅▄▁ beats 117/170 | 0.9% |
coding▁▁▁▃▆██▇▆▄▃▁ #229 of 458 * · 7.4% of its score · 2 tests
Beats Qwen3.5 4B, Qwen3-VL 32B Instruct, Solar Open 100B (102B-A12B) here, though they rank higher overall. Trails QwQ-32B-Preview, Ministral 3 3B Reasoning 2512, GPT-4 (0613) here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| LiveCodeBench v6 (window unspecified) lab | 66.7% ✎ | ▂▃▄▄▅██▅▄▇▃▆ beats 31/65 | 3.8% |
| LiveCodeBench Pro 2025Q2 (Medium) lab | 4.8% ✎ | █··▄▂▂██▄·▄▆ beats 8/22 | 3.5% |
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #194 of 393 * · 1.6% of its score · 1 test
Beats Granite 4.2 8B, Qwen3-VL 30B-A3B Thinking, Mistral Small 4 (119B-A6.5B) here, though they rank higher overall. Trails LFM2.5 1.2B Instruct, LFM2.5 1.2B Thinking, Gemma 3 12B here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| IFEval (aggregation unspecified) lab | 83.7% ✎ | ▄·▄·▄·▄▄···█ beats 4/6 | 1.6% |
math▁▂▃▅▆▅▄█▄▁▁▁ #151 of 398 · 18% of its score · 4 tests
Beats MiMo-V2.5 (310B-A15B), MiniMax-M2.7, MiniMax-M2.1 here, though they rank higher overall. Trails Nemotron 3 Nano 30B-A3B, Qwen3-VL 8B Thinking, Olmo 3 32B Think here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| AIME 2025 lab | 85.3% ✎ | █·▄▄····▄··█ beats 4/6 | 7.8% |
| IMO-AnswerBench lab | 66.1% ✎ | ▁▁·▁▁▃▄▅█▄▂▃ beats 6/42 | 4.2% |
| HMMT February 2025 lab | 72.9% ✎ | ▁▁▁▃▁▅▅▃██▁▄ beats 10/31 | 3.3% |
| HMMT November 2025 lab | 78.1% ✎ | ▁▁····▁▅▃█▇▁ beats 5/23 | 2.7% |
other tests13 not in a task · 40% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| GPQA Diamond lab | 75.4% ✎ | █···▄▄···▄·█ beats 4/6 | 11% |
| KCL-Essay vanilla | 32.6% ✎ | ▁···▁▃▂█▂▃▃▂ beats 11/23 | 5.0% |
| MMLU-Pro lab | 81.8% ✎ | ▁▁·▁▁▁▃▂▄▅█▁ beats 136/188 | 4.5% |
| EuroEval Life in the UK (English knowledge MC), validation split, 5-shot, accuracy | 86.6% ✎ | ▂·▂▂·▂·▃▃·█▃ beats 5/14 | 4.3% |
| EuroEval HellaSwag (English), validation split, 5-shot generative MC, accuracy | 79.7% ✎ | ▂··▂▂·▂▆▆█·▄ beats 11/15 | 3.0% |
| Humanity's Last Exam lab | 10.6% ✎ | ▁▁▁▃▆▆▇██▆▁▃ beats 18/104 | 2.7% |
| KCL-MCQA vanilla | 36.4% ✎ | ▂···█▂▆▆██▆▂ beats 8/23 | 2.4% |
| HellaSwag | 65.7% ✎ | ▁▁▁▁▂▂▃▇█▆▅▃ beats 31/85 | 2.3% |
5 more tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| MMLU-Redux lab | 92.3% ✎ | ▁▁▃▁▂▃▄▅▇▅█▄ beats 46/63 | 1.9% |
| IFBench (aggregation unspecified) lab | 36.0% ✎ | ▃▇▂▄▅▅▂▄▄▆█▇ beats 23/80 | 1.6% |
| MMLU | 89.9% ✎ | ▁▁▁▁▁▂▃▅█▃▆▃ beats 177/183 | 1.5% |
| PIQA | 75.7% ✎ | ▁▁▁▃▃▄▇█▄▃▁▁ beats 38/83 | 0.6% |
| Thunder-KoNUBench symbol 0-shot | 81.5% ✎ | █··········█ beats 1/1 | — |
$ where to run it
llama.cpp · recommended
version
- Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.macOS / Linux
curl -LsSf https://llama.app/install.sh | shWindowsirm https://llama.app/install.ps1 | iex - Run EXAONE 4.0 32B · needs ~19.7 GB · from huggingface.co/LGAI-EXAONEchat in the terminal
llama cli -hf LGAI-EXAONE/EXAONE-4.0-32B-GGUF:Q4_K_M - Or start a local server and open the address it prints (http://localhost:9931)
llama serve -hf LGAI-EXAONE/EXAONE-4.0-32B-GGUF:Q4_K_M
LM Studio
version
- Install LM Studio · Open the app once before using the lms command.
- Run EXAONE 4.0 32B · needs ~19.7 GB · from huggingface.co/LGAI-EXAONE
- Or download it in the terminal
lms get https://huggingface.co/LGAI-EXAONE/EXAONE-4.0-32B-GGUF@Q4_K_M -y - Then run lms ls to see its name, and lms chat followed by that name
Ollama
version
- Install Ollama
download it (macOS / Windows) ↗
Linuxcurl -fsSL https://ollama.com/install.sh | sh - Run EXAONE 4.0 32B · needs ~19.7 GB · from huggingface.co/LGAI-EXAONEchat in the terminal
ollama run hf.co/LGAI-EXAONE/EXAONE-4.0-32B-GGUF:Q4_K_M
MLX (Mac)
version
- Install MLX (Mac) · Apple silicon Macs only, text only.with uv
uv tool install mlx-lmorpip install mlx-lm - Run EXAONE 4.0 32B · needs ~18 GB, Mac only · from huggingface.co/lmstudio-communitychat in the terminal
mlx_lm.chat --model lmstudio-community/EXAONE-4.0-32B-MLX-4bit - Or start an OpenAI-compatible server at http://localhost:8080/v1
mlx_lm.server --model lmstudio-community/EXAONE-4.0-32B-MLX-4bit
Weights and documentation: huggingface.co/LGAI-EXAONE ↗
$ how the score was worked out · LG AI Research vendor-reporte… 65%, HyperCLOVA X 32B Think (NAVER… 20%, Korean Canonical Legal Benchm… 7% and 1 more
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
| source | results | share of the score |
|---|---|---|
| 18 | 65% | |
| 7 | 20% | |
| 2 | 7% | |
| 2 | 7% | |
| prior · pull toward the middle | 0% | |
| weighted average | = 58.7 |
not counted (1)
| Thunder-KoNUBench: A Corpus-Aligned Benchmark for Korean Negation Understanding | Thunder-KoNUBench symbol 0-shot [correct] | 81.5% | fewer than three models have this test yet, or this source ran it for this model alone |
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json