whatmodel.sh / LFM2.5 24B-A2B
LFM2.5 24B-A2B
↗ share
+ contribute
LFM2.5 24B-A2B is an open-weights language model from Liquid AI, released October 2026. Its published size is 24B parameters (2.45B active per token) and a 131k-token context window. Licence: lfm1.0.
Model information sources
$ how it compares
Scored LLMs released closest to LFM2.5 24B-A2B, out of 1188 with a score, then more from Liquid AI.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 5 | 82±2 | Muse Code only | |||
| 15 | 79±1 | api $0.26/M | |||
| 16 | 79±1 | api $8.00/M | |||
| 28 | 76±1 | api $0.20/M | |||
| 32 | 75±2 | api $0.26/M | |||
| more from Liquid AI | |||||
| 521 | 53±1 | local | |||
| 534 | 53±1 | local | |||
| 566 | 51±1 | local | |||
$ what it's good at
agent tasksnot ranked on this task yet · 4 tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| SWE-bench Verified lab | 51.0% ✎ | ▁▁▁▁▁▁▂▅█▆▁▁ beats 42/134 | — |
| BFCL V4 (December 2025 archive) lab | 65.0% ✎ | ▁▁▁▂▇▆▆▆█▂▄▂ beats 97/112 | — |
| τ³-bench Banking lab | 8.0% ✎ | ▂▂·▅█▂▃▃▃▆▂▅ beats 11/24 | — |
| WebArena-Verified lab | 26.8% ✎ | █······█·█·█ beats 0/3 | — |
codingnot ranked on this task yet · 2 tests
| test | result | vs the others in its run | counts |
|---|---|---|---|
| SWE-bench Verified lab | 51.0% ✎ | ▁▁▁▁▁▁▂▅█▆▁▁ beats 42/134 | — |
| SciCode (level unspecified) lab | 32.7% ✎ | ▁····▃▄▄▅█▇▃ beats 14/37 | — |
chat & writingnot ranked on this task yet · 1 test
| test | result | vs the others in its run | counts |
|---|---|---|---|
| IFEval (aggregation unspecified) lab | 96.8% ✎ | ▁▂▄▂▂▄▆█▇▄▂▃ beats 142/142 | — |
mathnot ranked on this task yet · 1 test
other tests3 not in a task · 0.0% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| GPQA Diamond lab | 74.4% ✎ | ▁▁▁▁▂▄▅▅█▇█▄ beats 170/315 | — |
| Humanity's Last Exam lab | 7.4% ✎ | ▁▁▁▄▅▆▆██▆▁▃ beats 9/108 | — |
| IFBench (aggregation unspecified) lab | 74.7% ✎ | ▃▇▂▄▅▅▂▄▄▆█▇ beats 63/83 | — |
$ where to run it
llama.cpp · recommended
- Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.macOS / Linux
curl -LsSf https://llama.app/install.sh | shWindowsirm https://llama.app/install.ps1 | iex - Run LFM2.5 24B-A2B · needs ~14.4 GB · from huggingface.co/LiquidAI (official)chat in the terminal
llama cli -hf LiquidAI/LFM2.5-24B-A2B-GGUF - Or start a local server and open the address it prints (http://localhost:9931)
llama serve -hf LiquidAI/LFM2.5-24B-A2B-GGUF
LM Studio
- Install LM Studio · Open the app once before using the lms command.
- Run LFM2.5 24B-A2B · needs ~14.4 GB · from huggingface.co/LiquidAI (official)
- Or download it in the terminal
lms get https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-GGUF -y - Then run lms ls to see its name, and lms chat followed by that name
Ollama
- Install Ollama
download it (macOS / Windows) ↗
Linuxcurl -fsSL https://ollama.com/install.sh | sh - Run LFM2.5 24B-A2B · needs ~14.4 GB · from huggingface.co/LiquidAI (official)chat in the terminal
ollama run hf.co/LiquidAI/LFM2.5-24B-A2B-GGUF
Official weights and documentation: huggingface.co/LiquidAI ↗
$ published results · 10 results, not enough overlap for a score
| test | result | source and conditions |
|---|---|---|
| BFCL V4 (December 2025 archive) | 65.0% | Liquid AI own-model benchmark facts · lab-reported Individual Liquid own purple-column figures read from pinned benchmark image; vLLM evaluation, precision not specified. SWE Verified uses OpenCode; IFEval aggregation not stated. Benchmark-specific sampling settings in card. No competitor columns or AA metrics. |
| τ³-bench Banking | 8.0% | Liquid AI own-model benchmark facts · lab-reported Individual Liquid own purple-column figures read from pinned benchmark image; vLLM evaluation, precision not specified. SWE Verified uses OpenCode; IFEval aggregation not stated. Benchmark-specific sampling settings in card. No competitor columns or AA metrics. |
| WebArena-Verified | 26.8% | Liquid AI own-model benchmark facts · lab-reported Individual Liquid own purple-column figures read from pinned benchmark image; vLLM evaluation, precision not specified. SWE Verified uses OpenCode; IFEval aggregation not stated. Benchmark-specific sampling settings in card. No competitor columns or AA metrics. |
| GPQA Diamond | 74.4% | Liquid AI own-model benchmark facts · lab-reported Individual Liquid own purple-column figures read from pinned benchmark image; vLLM evaluation, precision not specified. SWE Verified uses OpenCode; IFEval aggregation not stated. Benchmark-specific sampling settings in card. No competitor columns or AA metrics. |
| Humanity's Last Exam | 7.4% | Liquid AI own-model benchmark facts · lab-reported Individual Liquid own purple-column figures read from pinned benchmark image; vLLM evaluation, precision not specified. SWE Verified uses OpenCode; IFEval aggregation not stated. Benchmark-specific sampling settings in card. No competitor columns or AA metrics. |
| IFEval (aggregation unspecified) | 96.8% | Liquid AI own-model benchmark facts · lab-reported Individual Liquid own purple-column figures read from pinned benchmark image; vLLM evaluation, precision not specified. SWE Verified uses OpenCode; IFEval aggregation not stated. Benchmark-specific sampling settings in card. No competitor columns or AA metrics. |
| IFBench (aggregation unspecified) | 74.7% | Liquid AI own-model benchmark facts · lab-reported Individual Liquid own purple-column figures read from pinned benchmark image; vLLM evaluation, precision not specified. SWE Verified uses OpenCode; IFEval aggregation not stated. Benchmark-specific sampling settings in card. No competitor columns or AA metrics. |
| MATH-500 | 96.0% | Liquid AI own-model benchmark facts · lab-reported Individual Liquid own purple-column figures read from pinned benchmark image; vLLM evaluation, precision not specified. SWE Verified uses OpenCode; IFEval aggregation not stated. Benchmark-specific sampling settings in card. No competitor columns or AA metrics. |
| SWE-bench Verified | 51.0% | Liquid AI own-model benchmark facts · lab-reported Individual Liquid own purple-column figures read from pinned benchmark image; vLLM evaluation, precision not specified. SWE Verified uses OpenCode; IFEval aggregation not stated. Benchmark-specific sampling settings in card. No competitor columns or AA metrics. |
| SciCode (level unspecified) | 32.7% | Liquid AI own-model benchmark facts · lab-reported Individual Liquid own purple-column figures read from pinned benchmark image; vLLM evaluation, precision not specified. SWE Verified uses OpenCode; IFEval aggregation not stated. Benchmark-specific sampling settings in card. No competitor columns or AA metrics. |
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json