whatmodel.sh / Jamba 1.5 Mini

Jamba 1.5 Mini is an open-weights language model from AI21 Labs, released August 2024. Its published size is 52B parameters (12B active per token). Licence: jamba-open-model-license.

Catalogue identity notes

Comparison-only. Arena entry 'jamba-1.5-mini' (text). LMArena's leaderboard table (arena-leaderboard space @6f2eeeb) labels 'jamba-1.5-mini' as 'Jamba-1.5-Mini' (AI21 Labs, Jamba Open), linking https://www.ai21.com/jamba. Maker repo ai21labs/AI21-Jamba-Mini-1.5 @5a844bb: licence tag other (jamba-open-model-license). Parameters: AI21 docs: Jamba Mini '52B parameters (12B active)' (HF safetensors metadata 51.6B). Released 2024-08: month the maker's Hugging Face repo was created (createdAt 2024-08-19). AI21 API snapshot jamba-mini-1.5-2024-08, deprecated 2025-05-06.

46.4±1.3#412 of 719 LLMsfrom 14 benchmark results across 4 sources

$ how it compares

The LLMs ranked either side of Jamba 1.5 Mini, out of 828 with a score, then more from AI21 Labs.

#modelscorewhereRAMreleased
489GPT-3.5 Turbo (0125) OpenAI46±1api $0.75/M2024-01
490Mistral Large (2402) Mistral46±1comparison only2024-02
491Jamba 1.5 Mini AI21 Labs46±1local~34GB2024-08
492MedGemma 4B IT Google46±3local~4.1GB2025-05
493OLMo 2 13B Instruct (1124) Allen Institute for AI46±1local~9.6GB2024-12
more from AI21 Labs
406Jamba 1.5 Large AI21 Labs50±1local~839GB2024-08

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #141 of 300 * · 3.0% of its score · 1 test

Beats Qwen3 235B-A22B Thinking 2507, o4-mini, o1 (2024-12-17) here, though they rank higher overall. Trails SmolLM3 3B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
BFCL (version not stated) lab80.7% ✎▄▆▄▂·█▆·▄··▂ beats 8/17easy · avg 81%▇ 3.0%blunt · small run
coding█··········█ #2 of 2 * · 11% of its score · 1 test
testresultvs the others in its rundifficultycountswhy
HumanEval lab62.8% ✎▁▁▁▁▁▃▅▅█▃▂▁ beats 104/190easy · avg 74%▇▇▇▇ 11%sharp · at its level · small run
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #281 of 393 · 23% of its score · 3 tests

Beats Ministral 3 14B Reasoning 2512, Gemma 4 E4B, Ministral 3 8B here, though they rank higher overall. Trails Flan-T5 XXL, LFM2 700M, EXAONE 3.5 2.4B Instruct here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
LMArena (text)1239.7 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 89/379avg 1268▇▇▇▇▇▇ 14%blunt
Arena-Hard (version/judge unspecified) lab46.1% ✎▃▃▂▅▃▆▅█▅▅▂▃ beats 7/30medium · avg 58%▇▇ 5.2%at its level · small run
IFEval (aggregation unspecified) lab75.8% ✎▁▁▃▁▂▄▄▆█▃▂▁ beats 46/141easy · avg 80%▇▇ 3.8%small run
math▁▂▃▅▆▅▄█▄▁▁▁ #311 of 398 * · 13% of its score · 1 test

Beats Athene-70B, OLMo 2 32B Instruct (0325), Hermes 2 Theta Llama-3 70B here, though they rank higher overall. Trails Gemma 7B (base), DeepSeek R1 Distill Qwen 1.5B, Tulu 2 DPO 13B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
GSM8K lab75.8% ✎▂▂▂▅▅▆▅▇█▇▄▃ beats 82/146easy · avg 85%▇▇▇▇▇ 13%sharp · small run
other tests8 not in a task · 49% of its score
testresultvs the others in its rundifficultycountswhy
BIG-Bench Hard lab53.4% ✎▁▁▁▁▂▄▅▅█▃▄▁ beats 56/129medium · avg 65%▇▇▇▇▇ 13%sharp · at its level · small run
GPQA (subset unspecified) lab32.3% ✎▂▁▂▂▄▃▆▃▅█▄▃ beats 28/104hard · avg 37%▇▇▇▇ 10%sharp · small run
MMLU lab69.7% ✎▁▁▁▁▁▂▃▅█▃▆▃ beats 111/183easy · avg 77%▇▇▇▇ 10%at its level · small run
MMLU-Pro lab39.8% ✎▁▁·▁▁▁▃▂▄▅█▁ beats 25/188medium · avg 50%▇▇▇ 7.3%at its level · small run
RULER 64k92.8% ✎▁▁·▁·▂▃▄█▂·▃ beats 22/22easy · avg 83%▇ 3.6%typical
ARC Challenge lab85.7% ✎▆▁▁▂▂▅▇█▄▃▃▂ beats 93/97easy · avg 81%▇ 2.7%sharp · at its level · noisy · small run
RULER 128k90.0% ✎▄··▂▄▂▆██▄▄▃ beats 21/21easy · avg 68%▇ 1.3%at its level · noisy
Vectara hallucination leaderboard, 2025 dataset (HHEM-2.3, factual consistency rate)97.1% ✎▁▁▂▃▄▄█▆▃▂▂▁ beats 106/140very easy · avg 94%▇ 1.0%blunt · maxed out · noisy

$ where to run it

llama.cpp · recommended

  1. Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.
    macOS / Linux
    curl -LsSf https://llama.app/install.sh | sh
    Windows
    irm https://llama.app/install.ps1 | iex

    other ways to install ↗

  2. Run Jamba 1.5 Mini · needs ~31.2 GB · from huggingface.co/mradermacher
    chat in the terminal
    llama cli -hf mradermacher/AI21-Jamba-Mini-1.5-GGUF:Q4_K_M
  3. Or start a local server and open the address it prints (http://localhost:9931)
    llama serve -hf mradermacher/AI21-Jamba-Mini-1.5-GGUF:Q4_K_M

LM Studio

  1. Install LM Studio · Open the app once before using the lms command.

    download it (macOS / Windows / Linux) ↗

  2. Run Jamba 1.5 Mini · needs ~31.2 GB · from huggingface.co/mradermacher

    open in LM Studio ↗

  3. Or download it in the terminal
    lms get https://huggingface.co/mradermacher/AI21-Jamba-Mini-1.5-GGUF@Q4_K_M -y
  4. Then run lms ls to see its name, and lms chat followed by that name

Ollama

  1. Install Ollama

    download it (macOS / Windows) ↗

    Linux
    curl -fsSL https://ollama.com/install.sh | sh
  2. Run Jamba 1.5 Mini · needs ~31.2 GB · from huggingface.co/mradermacher
    chat in the terminal
    ollama run hf.co/mradermacher/AI21-Jamba-Mini-1.5-GGUF:Q4_K_M

Other ways to run it

  1. Run it as published · needs ~103.14 GB, NVIDIA only · from github.com/vllm-project
    vllm serve ai21labs/AI21-Jamba-Mini-1.5

Official weights and documentation: huggingface.co/ai21labs ↗

$ how the score was worked out · Jamba-1.5: Hybrid Transformer… 79%, LMArena leaderboard dataset 14%, NVIDIA RULER repository READM… 5% and 1 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Jamba-1.5: Hybrid Transformer-Mamba Models at Scale (AI21, arXiv 2408.12570v1) · lab-reported10▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 79%CC BY-SA 4.0
LMArena leaderboard dataset1▇▇▇▇ 14%CC BY 4.0
NVIDIA RULER repository README results table2▇ 5%Apache-2.0
Vectara hallucination leaderboard (vectara/hallucination-leaderboard repository)1▇ 1%Apache-2.0
prior · pull toward the middle▇ 1%
weighted average= 46.4

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json