whatmodel.sh / LongCat-Flash-Chat (560B-A27B)

LongCat-Flash-Chat (560B-A27B) is an open-weights language model from Meituan, released August 2025. Its published size is 560B parameters (27B active per token) and a 128k-token context window. Licence: mit.

Catalogue identity notes

Meituan LongCat team, meituan-longcat/LongCat-Flash-Chat @f0b8e8d (created 2025-08-29, MIT). Comparison-only for now: weights are public (about 1.12 TB BF16, 75 safetensors files) but the card points to an external SGLang/vLLM deployment guide rather than giving a command, so no run option is recorded. Its own columns sit in the card runs that already hold six catalogued comparators. Arena entry 'longcat-flash-chat' (MIT). Non-thinking chat model. Not LongCat 2.0 or the 2602-exp chat preview (separate entries).

Model information sources

Release date ↗ · Weights licence ↗

Card: '560 billion total parameters ... activates 18.6B∼31.3B parameters (averaging∼27B) based on contextual demands'; safetensors metadata 561,862,880,256.

65.5±1.0#138 of 719 LLMsfrom 23 benchmark results across 2 sources

$ how it compares

The LLMs ranked either side of LongCat-Flash-Chat (560B-A27B), out of 828 with a score, then more from Meituan.

#modelscorewhereRAMreleased
155Nemotron Cascade 2 30B-A3B NVIDIA66±1local~20GB2026-03
156Laguna XS 2.1 (33B-A3B) Poolside66±2local~21GB2026-06
157LongCat-Flash-Chat (560B-A27B) Meituan66±1local~333GB2025-08
158o3-mini OpenAI65±1api $1.93/M2025-01
159Claude 3.7 Sonnet Anthropic65±1comparison only2025-02
more from Meituan
63LongCat 2.0 (1.6T-A48B) Meituan73±2api $1.30/M +local~2155GB2026-06
114LongCat-Flash-Thinking (560B-A27B) Meituan69±1comparison only2025-09

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #102 of 300 · 21% of its score · 5 tests

Beats Grok 4.20 (0309 reasoning), Grok 4.3, o3-pro here, though they rank higher overall. Trails SmolLM3 3B, Nova 2 Pro (Preview) here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
SWE-bench Verified lab60.4% ✎▁▁▁▁▁▁▂▄█▆▁▁ beats 55/131hard · avg 18%▇▇▇ 7.1%sharp · at its level
τ²-bench Retail lab71.3% ✎▅···█·▃····▃ beats 4/6medium · avg 41%▇▇ 4.7%at its level
τ²-bench Telecom lab73.7% ✎██··███···██ beats 6/6very hard · avg 9.6%▇▇ 4.3%sharp · at its level · noisy
τ²-bench Airline lab58.0% ✎▄·▄··▄···█▄▄ beats 5/6hard · avg 26%▇ 3.0%at its level
Terminal-Bench (pre-2.0 release) lab39.5% ✎▄·▄···▄▄···█ beats 4/5very hard · avg 12%▇ 2.1%at its level
coding▁▁▁▃▆██▇▆▄▃▁ #159 of 458 · 22% of its score · 4 tests

Beats Gemini 2.5 Pro, Qwen3-Coder-Next (80B-A3B), Grok 4.1 Fast (Reasoning) here, though they rank higher overall. Trails QwQ-32B-Preview, Ministral 3 8B Reasoning 2512, Phi-4-reasoning 14B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
SWE-bench Verified lab60.4% ✎▁▁▁▁▁▁▂▄█▆▁▁ beats 55/131hard · avg 18%▇▇▇ 7.1%sharp · at its level
LiveCodeBench (version unspecified) lab48.0% ✎█·······▄▄▄▄ beats 5/5hard · avg 21%▇▇▇ 6.7%at its level
MBPP+ lab79.6% ✎▃·····▃█▃··▃ beats 2/6medium · avg 61%▇▇ 4.3%typical
HumanEval+ lab88.4% ✎▄▄▄·····▄▄·█ beats 2/6easy · avg 67%▇▇ 4.0%sharp · maxed out
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #107 of 393 * · 11% of its score · 2 tests

Beats LongCat 2.0 (1.6T-A48B), GPT-5.4 nano, Step 3.5 Flash (196B-A11B) here, though they rank higher overall. Trails Gemini 2.5 Flash, Mistral Large 3 (675B-A41B), GPT-4.1 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
LMArena (text)1401.2 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 245/379avg 1268▇▇▇ 8.2%blunt
IFEval (aggregation unspecified) lab89.6% ✎█··█·█··████ beats 6/6easy · avg 75%▇ 3.3%typical
math▁▂▃▅▆▅▄█▄▁▁▁ #129 of 398 · 7.7% of its score · 3 tests

Beats Claude Sonnet 4.6, MiniMax-M3, MiMo-V2.5 (310B-A15B) here, though they rank higher overall. Trails Olmo 3.1 32B Think, Qwen3-VL 30B-A3B Thinking, Granite 4.2 8B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
AIME 2025 lab61.3% ✎▄▄···▄▄··▄·█ beats 4/6hard · avg 19%▇▇ 3.8%sharp · at its level · noisy
AIME 2024 lab70.4% ✎▁▁▁▂▁▃▁▅███▃ beats 38/85hard · avg 32%▇ 2.1%sharp · noisy
MATH-500 lab96.4% ✎▄·▄··█··▄·▄▄ beats 3/6very easy · avg 86%▇ 1.7%maxed out · noisy
other tests10 not in a task · 44% of its score
testresultvs the others in its rundifficultycountswhy
MMLU lab89.7% ✎▄·····█▄▄▄·▄ beats 2/6medium · avg 71%▇▇▇ 8.5%typical
GPQA Diamond lab73.2% ✎█·█·█··██··█ beats 2/5hard · avg 42%▇▇▇ 8.1%sharp · at its level
MMLU-Pro lab82.7% ✎█▄·▄···▄··▄▄ beats 3/6medium · avg 59%▇▇▇ 6.9%typical
CMMLU lab84.3% ✎█····▄··▄▄▄▄ beats 2/6medium · avg 67%▇▇ 4.3%typical
C-Eval lab90.4% ✎█····▄·▄·▄▄▄ beats 4/6medium · avg 68%▇▇ 3.9%typical
VitaBench lab24.3% ✎█·······▄█·█ beats 6/6very hard · avg 6.4%▇ 3.7%typical
COLLIE (constrained text generation) lab57.1% ✎▄···▄█▄····█ beats 6/6hard · avg 30%▇ 3.4%at its level
DROP lab79.1% ✎▄···▄·▄█·▄·▄ beats 4/6medium · avg 41%▇ 3.0%noisy
2 more tests
testresultvs the others in its rundifficultycountswhy
ZebraLogic lab89.3% ✎█···█··███·█ beats 4/5medium · avg 53%▇ 1.4%noisy
BeyondAIME lab43.0% ✎█····█·▄▄··▄ beats 4/6hard · avg 25%▇ 1.2%at its level

$ where to run it

LM Studio · recommended

  1. Install LM Studio · Open the app once before using the lms command.

    download it (macOS / Windows / Linux) ↗

  2. Run LongCat-Flash-Chat (560B-A27B) · needs ~315.4 GB, Mac only · from huggingface.co/mlx-community

    open in LM Studio ↗

  3. Or download it in the terminal
    lms get https://huggingface.co/mlx-community/LongCat-Flash-Chat-4bit -y
  4. Then run lms ls to see its name, and lms chat followed by that name

MLX (Mac)

  1. Install MLX (Mac) · Apple silicon Macs only, text only.
    with uv
    uv tool install mlx-lm
    or
    pip install mlx-lm
  2. Run LongCat-Flash-Chat (560B-A27B) · needs ~315.4 GB, Mac only · from huggingface.co/mlx-community
    chat in the terminal
    mlx_lm.chat --model mlx-community/LongCat-Flash-Chat-4bit
  3. Or start an OpenAI-compatible server at http://localhost:8080/v1
    mlx_lm.server --model mlx-community/LongCat-Flash-Chat-4bit

Weights and documentation: huggingface.co/meituan-longcat ↗

$ how the score was worked out · Meituan LongCat-Flash-Chat mo… 91%, LMArena leaderboard dataset 8%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Meituan LongCat-Flash-Chat model card (evaluation table) · lab-reported22▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 91%MIT
LMArena leaderboard dataset1▇▇ 8%CC BY 4.0
prior · pull toward the middle▇ 0%
weighted average= 65.5

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json