whatmodel.sh / Pixtral Large (2411)

Pixtral Large (2411) is an open-weights language model from Mistral, released November 2024. Its published size is 124B parameters. Licence: mistral-research.

Catalogue identity notes

Comparison-only. Arena entry 'pixtral-large-2411' (vision). LMArena's leaderboard table (arena-leaderboard space @6f2eeeb) labels 'pixtral-large-2411' as 'Pixtral-Large-2411' (Mistral, MRL), linking https://huggingface.co/mistralai/Pixtral-Large-Instruct-2411. Maker repo mistralai/Pixtral-Large-Instruct-2411 @c1e51f6: licence tag other (mrl). Parameters: card: 'Pixtral-Large-Instruct-2411 is a 124B multimodal model' ('123B multimodal decoder, 1B parameter vision encoder'). Released 2024-11: month the maker's Hugging Face repo was created (createdAt 2024-11-14).

54.3±2.7#283 of 719 LLMsfrom 4 benchmark results across 2 sources

$ how it compares

The LLMs ranked either side of Pixtral Large (2411), out of 828 with a score, then more from Mistral.

#modelscorewhereRAMreleased
335Nemotron 3 Nano 4B NVIDIA54±1local~3.8GB2026-03
336Granite 4.1 8B IBM54±1api $0.11/M +local~7GB2026-04
337Pixtral Large (2411) Mistral54±3local~51GB2024-11
338Bielik 11B v2.6 Instruct SpeakLeash54±3local~8.1GB2025-06
339Nova Premier Amazon54±2api $5.00/M2025-04
more from Mistral
79Mistral Large 4 (public preview) Mistral71±2api $2.06/M2026-10
174Mistral Medium 3.5 (128B) Mistral65±1api $3.00/M +local~42GB2026-04
180Mistral Medium 3.1 (2508) Mistral64±2comparison only2025-08

see all LLMs · find the ones that fit your machine

$ what it's good at

math▁▂▃▅▆▅▄█▄▁▁▁ #217 of 398 * · 22% of its score · 1 test

Beats DeepSeek V3 (Dec '24), GPT-4o (2024-08-06), Command A (03-2025) here, though they rank higher overall. Trails Olmo 3 7B Instruct, DeepSeek R1 Distill Llama 8B, Phi-4-mini-reasoning 3.8B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
MathVista (testmini) lab69.4% ✎▁··▁▄▄▇█▅▆█▄ beats 25/47medium · avg 63%▇▇▇▇▇▇▇▇▇ 22%at its level · small run
vision & documents▁▁▃▂▁▃▄▂▆▇█▄ #112 of 147 · 97% of its score · 4 tests

Beats DeepSeek V4 Flash Vision (Exp), GPT-4 Turbo (2024-04-09) here, though they rank higher overall. Trails Gemma 4 E4B, Gemma 3 27B, Qwen2.5-VL 32B Instruct here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Arena vision (style controlled)1095.2 ✎▁▁▂▂▂▂▄▅▅▆██ beats 29/145avg 1068▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 46%blunt
MathVista (testmini) lab69.4% ✎▁··▁▄▄▇█▅▆█▄ beats 25/47medium · avg 63%▇▇▇▇▇▇▇▇▇ 22%at its level · small run
MMMU (val) lab64.0% ✎▁····▁▁▄█▇▆▆ beats 25/52medium · avg 57%▇▇▇▇▇▇▇▇▇ 22%at its level · small run
ChartQA lab88.1% ✎▁··▁▁▁▁▁▂▅▅█ beats 34/44easy · avg 82%▇▇▇ 6.8%blunt · small run

$ where to run it

llama.cpp · recommended

  1. Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.
    macOS / Linux
    curl -LsSf https://llama.app/install.sh | sh
    Windows
    irm https://llama.app/install.ps1 | iex

    other ways to install ↗

  2. Run Pixtral Large (2411) · needs ~46.7 GB · from huggingface.co/EnlistedGhost
    chat in the terminal
    llama cli -hf EnlistedGhost/Pixtral-Large-Instruct-2411-GGUF:Q2_K
  3. Or start a local server and open the address it prints (http://localhost:9931)
    llama serve -hf EnlistedGhost/Pixtral-Large-Instruct-2411-GGUF:Q2_K

LM Studio

  1. Install LM Studio · Open the app once before using the lms command.

    download it (macOS / Windows / Linux) ↗

  2. Run Pixtral Large (2411) · needs ~46.7 GB · from huggingface.co/EnlistedGhost

    open in LM Studio ↗

  3. Or download it in the terminal
    lms get https://huggingface.co/EnlistedGhost/Pixtral-Large-Instruct-2411-GGUF@Q2_K -y
  4. Then run lms ls to see its name, and lms chat followed by that name

Other ways to run it

  1. Run it as published · needs ~248.27 GB, NVIDIA only · from huggingface.co/mistralai
    pip install --upgrade vllm mistral_common && vllm serve mistralai/Pixtral-Large-Instruct-2411 --config-format mistral --load-format mistral --tokenizer_mode mistral --limit_mm_per_prompt 'image=10' --tensor-parallel-size 8

Weights and documentation: huggingface.co/mistralai ↗

$ how the score was worked out · Mistral AI vendor-reported be… 50%, LMArena leaderboard dataset 46%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Mistral AI vendor-reported benchmark scores for its own models (Hugging Face model cards) · lab-reported3▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 50%Factual vendor-reported score (not licensed content)
LMArena leaderboard dataset1▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 46%CC BY 4.0
prior · pull toward the middle▇ 3%
weighted average= 54.3

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json