whatmodel.sh / LFM2.5 8B-A1B

LFM2.5 8B-A1B is an open-weights language model from Liquid AI, released May 2026. Its published size is 8.47B parameters (1.5B active per token) and a 128k-token context window. Licence: lfm1.0.

52.2±1.0#312 of 719 LLMsfrom 29 benchmark results across 2 sources

$ how it compares

The LLMs ranked either side of LFM2.5 8B-A1B, out of 828 with a score, then more from Liquid AI.

#modelscorewhereRAMreleased
373Yi-Large Preview 01.AI52±1comparison only2024-05
374Qwen2.5-Math 7B Instruct Alibaba52±2local~6GB2024-09
375LFM2.5 8B-A1B Liquid AI52±1local~6.5GB2026-05
376GPT-4 (0314) OpenAI52±1comparison only2023-03
377GLM-4 (0520) Z.ai52±1comparison only2024-05
more from Liquid AI
370LFM2.5 2.6B Liquid AI53±1local~3.2GB2026-07
398LFM2 24B-A2B Liquid AI51±1local~16GB2026-02
433LFM2.5 1.2B Thinking Liquid AI49±2local~2.2GB2026-01

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #213 of 300 · 17% of its score · 8 tests

Beats o1 (2024-12-17), o3-mini, DeepSeek R1 (Jan '25) here, though they rank higher overall. Trails SmolLM3 3B, Jamba 1.5 Mini, Granite 4.1 3B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
BFCL V4 (December 2025 archive) +149.2% ✎▄·█·▄▄▄▄·▄·▄ beats 4/8medium · avg 43%▇▇ 4.8%at its level · several runs
BrowseComp-ZH13.2% ✎▄▄·▄▄▄·█···█ beats 4/8very hard · avg 13%▇ 2.5%typical
SWE-bench Verified0.4% ✎▄··▄▄█··▄·▄█ beats 0/8very hard · avg 12%▇ 2.4%sharp · noisy
τ²-bench Retail lab39.8% ✎▁····▃▁▃▆█▃▁ beats 3/44hard · avg 31%▇ 2.0%at its level · small run
SWE-bench Pro (split unspecified)0.4% ✎█▂···▂···▄·▂ beats 0/8very hard · avg 4.3%▇ 1.6%sharp · too hard for it · noisy
τ³-bench Banking3.4% ✎▂▂·▅█▂▂▃▂▅▂▃ beats 2/20very hard · avg 3.7%▇ 1.4%blunt · too hard for it
τ²-bench Telecom lab88.1% ✎▄█▄········█ beats 5/5hard · avg 24%▇ 1.3%sharp · at its level · noisy
BFCL v3 lab64.4% ✎▁▁▁▁▁▃▅█▆▅▄▁ beats 120/170medium · avg 57%▇ 0.9%blunt · at its level · small run
coding▁▁▁▃▆██▇▆▄▃▁ #381 of 458 · 18% of its score · 5 tests

Trails Qwen2.5 1.5B Instruct, WizardLM 13B V1.2, Falcon3 3B Instruct here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
LiveCodeBench v6 (window unspecified)39.8% ✎▃····█·▃▅▃·▃ beats 1/8medium · avg 39%▇▇ 6.2%at its level
LiveCodeBench Pro 2025Q2 (Easy)27.8% ✎▄···█▄··▄█▄▄ beats 2/8hard · avg 33%▇▇ 5.0%at its level
LiveCodeBench Pro 2025Q2 (Medium)0.0% ✎█···▂··▄▂··▂ beats 0/8very hard · avg 2.0%▇ 2.9%sharp · too hard for it · noisy
SWE-bench Verified0.4% ✎▄··▄▄█··▄·▄█ beats 0/8very hard · avg 12%▇ 2.4%sharp · noisy
SWE-bench Pro (split unspecified)0.4% ✎█▂···▂···▄·▂ beats 0/8very hard · avg 4.3%▇ 1.6%sharp · too hard for it · noisy
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #126 of 393 * · 1.7% of its score · 1 test

Beats LongCat 2.0 (1.6T-A48B), o3-mini, K-EXAONE (236B-A23B) here, though they rank higher overall.

testresultvs the others in its rundifficultycountswhy
IFEval (aggregation unspecified) +190.8% ✎▄▄····▄··███ beats 6/8easy · avg 82%▇ 1.7%small run · several runs
math▁▂▃▅▆▅▄█▄▁▁▁ #212 of 398 · 42% of its score · 4 tests

Beats DeepSeek V3 (Dec '24), GPT-4o (2024-08-06), Command A (03-2025) here, though they rank higher overall. Trails Olmo 3 7B Instruct, DeepSeek R1 Distill Llama 8B, Phi-4-mini-reasoning 3.8B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
AIME 2025 +146.0% ✎█▄▄▄▄····█·▄ beats 4/8medium · avg 42%▇▇▇▇▇▇ 15%sharp · at its level · several runs
HMMT February 202638.5% ✎▅··▃▃·▃··▃·█ beats 4/8hard · avg 30%▇▇▇▇ 11%sharp · at its level
AIME 2026 +156.7% ✎▄·▄█·▄▄···█▄ beats 4/8medium · avg 48%▇▇▇ 8.3%sharp · at its level
MATH-500 +193.2% ✎██▄▄▄··▄···▄ beats 5/8very easy · avg 89%▇▇▇ 8.1%several runs
web search█·█▄██·▄▄·▄▄ #9 of 13 * · 2.5% of its score · 1 test

Beats Nemotron 3 Nano 4B, Gemma 4 E4B, LFM2.5 2.6B here, though they rank higher overall. Trails Qwen3.5 2B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
BrowseComp-ZH13.2% ✎▄▄·▄▄▄·█···█ beats 4/8very hard · avg 13%▇ 2.5%typical
other tests7 not in a task · 25% of its score
testresultvs the others in its rundifficultycountswhy
MMLU-Pro63.1% ✎▂··▃█·▂▂···▂ beats 1/8medium · avg 59%▇▇ 5.1%at its level
MMLU-Redux80.0% ✎▂···█··▂▂··▂ beats 3/8easy · avg 77%▇▇ 4.7%at its level
IFBench (aggregation unspecified) +151.0% ✎▅····▃▃·█·▃▃ beats 3/8medium · avg 43%▇▇ 3.8%at its level · several runs
OJBench8.2% ✎▃····▃▅··█▃▃ beats 1/8very hard · avg 12%▇ 3.1%typical
SuperGPQA34.5% ✎▃·▃·▃▅█····▃ beats 2/8hard · avg 32%▇ 2.9%at its level
Multi-IF (aggregation unspecified) +171.4% ✎▄▄···▄·▄·▄██ beats 4/8medium · avg 60%▇ 2.8%blunt · at its level · several runs
LongBench v230.4% ✎▃······▅▅▃·█ beats 2/8very hard · avg 32%▇ 2.4%typical

$ where to run it

llama.cpp · recommended

version

  1. Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.
    macOS / Linux
    curl -LsSf https://llama.app/install.sh | sh
    Windows
    irm https://llama.app/install.ps1 | iex

    other ways to install ↗

  2. Run LFM2.5 8B-A1B · needs ~5.2 GB · from huggingface.co/LiquidAI (official)
    chat in the terminal
    llama cli -hf LiquidAI/LFM2.5-8B-A1B-GGUF:Q4_K_M
  3. Or start a local server and open the address it prints (http://localhost:9931)
    llama serve -hf LiquidAI/LFM2.5-8B-A1B-GGUF:Q4_K_M

LM Studio

version

  1. Install LM Studio · Open the app once before using the lms command.

    download it (macOS / Windows / Linux) ↗

  2. Run LFM2.5 8B-A1B · needs ~5.2 GB · from huggingface.co/LiquidAI (official)

    open in LM Studio ↗

  3. Or download it in the terminal
    lms get https://huggingface.co/LiquidAI/LFM2.5-8B-A1B-GGUF@Q4_K_M -y
  4. Then run lms ls to see its name, and lms chat followed by that name

Ollama

version

  1. Install Ollama

    download it (macOS / Windows) ↗

    Linux
    curl -fsSL https://ollama.com/install.sh | sh
  2. Run LFM2.5 8B-A1B · needs ~5.58 GB · from ollama.com
    chat in the terminal
    ollama run lfm2.5:8b

MLX (Mac)

version

  1. Install MLX (Mac) · Apple silicon Macs only, text only.
    with uv
    uv tool install mlx-lm
    or
    pip install mlx-lm
  2. Run LFM2.5 8B-A1B · needs ~4.8 GB, Mac only · from huggingface.co/LiquidAI (official)
    chat in the terminal
    mlx_lm.chat --model LiquidAI/LFM2.5-8B-A1B-MLX-4bit
  3. Or start an OpenAI-compatible server at http://localhost:8080/v1
    mlx_lm.server --model LiquidAI/LFM2.5-8B-A1B-MLX-4bit

Official weights and documentation: huggingface.co/LiquidAI ↗

$ how the score was worked out · openbmb/MiniCPM5-2B model card 81%, LiquidAI/LFM2.5-8B-A1B model… 19%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
openbmb/MiniCPM5-2B model card20▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 81%Apache-2.0
LiquidAI/LFM2.5-8B-A1B model card · lab-reported9▇▇▇▇▇▇ 19%LFM Open License v1.0
prior · pull toward the middle▇ 0%
weighted average= 52.2

not counted (1)

LiquidAI/LFM2.5-8B-A1B model cardAIME 2026 [correct]50.0%the only model in this source's run of the test, so there is nothing to compare it with there; another run of the test counts
$ published speed measurements · 3

Reference results for the hardware, engine and settings below. They aren't verified speeds of the downloads above or predictions for your machine.

AMD Ryzen AI Max+ 395 (Strix Halo), Radeon 8060S iGPU; Beelink GTR9 Pro 128GBQ4_K_M171.17 tok/sllama.cpp ac4cddeb0 (build_number 9592 as recorded), Vulkan (RADV) · llama-bench; tg128; 128 generated tokens; context depth 0; n_prompt=0 row; n_batch=2048; n_ubatch=512; flash_attn=1; type_k=f16; type_v=f16; n_gpu_layers=999; threads=16; one sequence; file label r10 repetitions

Author's own llama-bench CSV row (avg_ts mean over repetitions, stddev_ts retained). GPU string as recorded: Radeon 8060S Graphics (RADV STRIX_HALO). Unified memory; the guide reports ~124GiB OS-visible. Kernel/Mesa/power profile per the run folder notes. Not prompt processing or multi-request throughput. Curated in the guide's data/benchmarks.csv line 30 (2026-06-11, measured-local): Latest upstream Vulkan/RADV control for the current small-MoE speed route; remains a small active-parameter MoE speed result, not a 30B-class capability replacement.

source ↗
AMD Ryzen AI Max+ 395 (Strix Halo), Radeon 8060S iGPU; Beelink GTR9 Pro 128GBQ4_K_M168.96 tok/sllama.cpp 2016bf2 (build_number 1 as recorded), Vulkan (RADV) · llama-bench; tg128; 128 generated tokens; context depth 0; n_prompt=0 row; n_batch=2048; n_ubatch=512; flash_attn=-1; type_k=f16; type_v=f16; n_gpu_layers=-1; threads=16; one sequence; file label r5 repetitions

Author's own llama-bench CSV row (avg_ts mean over repetitions, stddev_ts retained). GPU string as recorded: Radeon 8060S Graphics (RADV STRIX_HALO). Unified memory; the guide reports ~124GiB OS-visible. Kernel/Mesa/power profile per the run folder notes. Not prompt processing or multi-request throughput. Curated in the guide's data/benchmarks.csv line 35 (2026-06-05, measured-local): Latest/int-dot practical workstation scout; generation-only p0/n128 r20 measured 170.02 t/s. Fastest current small-MoE scout here; not a 30B-class capability replacement.

source ↗
AMD Ryzen AI Max+ 395 (Strix Halo), Radeon 8060S iGPU; Beelink GTR9 Pro 128GBQ4_K_M176.48 tok/sllama.cpp 98d5e8ba8 (build_number 9544 as recorded), Vulkan (RADV) · llama-bench; tg128; 128 generated tokens; context depth 0; n_prompt=0 row; n_batch=2048; n_ubatch=512; flash_attn=1; type_k=f16; type_v=f16; n_gpu_layers=999; threads=16; one sequence; file label r10 repetitions

Author's own llama-bench CSV row (avg_ts mean over repetitions, stddev_ts retained). GPU string as recorded: Radeon 8060S Graphics (RADV STRIX_HALO). Unified memory; the guide reports ~124GiB OS-visible. Kernel/Mesa/power profile per the run folder notes. Not prompt processing or multi-request throughput. Curated in the guide's data/benchmarks.csv line 101 (2026-06-07, measured-local): Latest llama.cpp b9544 Vulkan/RADV small-MoE speed control with explicit -dev Vulkan0; r10; latest build did not regress the LFM2.5 speed route.

source ↗

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json