whatmodel.sh / Command R Plus (08-2024)

Command R Plus (08-2024) is an open-weights language model from Cohere, released August 2024. Its published size is 104B parameters and a 128k-token context window. Licence: cc-by-nc-4.0.

Catalogue identity notes

Arena entry 'command-r-plus-08-2024' (text). LMArena's leaderboard table (arena-leaderboard space @6f2eeeb) labels 'command-r-plus-08-2024' as 'Command R+ (08-2024)' (Cohere, CC-BY-NC-4.0), linking https://docs.cohere.com/docs/command-r-plus#model-details. Maker repo CohereLabs/c4ai-command-r-plus-08-2024 @e808c1a: licence tag cc-by-nc-4.0. 103,810,674,688 parameters from the Hugging Face safetensors metadata (dense, so active = total). Released 2024-08: month the maker's Hugging Face repo was created (createdAt 2024-08-21). Cohere models page lists command-r-plus-08-2024 as Live.

47.2±1.0#394 of 719 LLMsfrom 17 benchmark results across 7 sources

$ how it compares

The LLMs ranked either side of Command R Plus (08-2024), out of 828 with a score, then more from Cohere.

#modelscorewhereRAMreleased
469Qwen3.5 2B Alibaba47±1local~2.9GB2026-03
470Gemma 2 9B IT Google47±1local~7GB2024-06
471Command R Plus (08-2024) Cohere47±1api $4.38/M +local~63GB2024-08
472GLM-4 9B Chat Zhipu AI (Z.ai)47±2local~7.9GB2024-06
473Yi-1.5 34B (base) 01.AI47±3local~22GB2024-05
more from Cohere
76North Small Translate 1.0 Cohere71±6api price unknown2026-08
175Command A+ (05-2026) Cohere64±1api price unknown +local~71GB2026-05
277Command A (03-2025) Cohere57±1api $4.38/M +local~37GB2025-03

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #265 of 300 * · 6.0% of its score · 1 test

Beats Magistral Small 1.0 (2506), Llama 4 Scout (109B-A17B), Bielik 11B v2.3 Instruct here, though they rank higher overall. Trails Qwen2.5 1.5B Instruct, Granite 4.0 H 1B, Granite 4.0 1B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
SWE-bench Verified lab17.0% ✎▃···▃·▃·▃█·▃ beats 2/7hard · avg 19%▇▇ 6.0%sharp
coding▁▁▁▃▆██▇▆▄▃▁ #327 of 458 · 37% of its score · 6 tests

Beats GLM-4.7-Flash, Qwen3-VL 4B Instruct, LFM2.5 2.6B here, though they rank higher overall. Trails Phi-3-mini-128k-instruct (Apr 2024), DeepSeek LLM 67B Chat, WizardLM 70B V1.0 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Aider code editing (133 Exercism Python exercises, two attempts)38.3% ✎▁·▁▂▄▁▆▄█▆▂▂ beats 10/62medium · avg 54%▇▇▇▇▇▇ 16%at its level
SWE-bench Verified lab17.0% ✎▃···▃·▃·▃█·▃ beats 2/7hard · avg 19%▇▇ 6.0%sharp
MBPP+ lab78.8% ✎██·██···████ beats 2/7easy · avg 79%▇▇ 4.9%typical
LiveCodeBench v5 (Oct 2024–Feb 2025) lab14.4% ✎▄▄·▄·····█▄█ beats 2/7hard · avg 19%▇▇ 4.3%typical
Aider polyglot (225 exercises, two attempts) lab2.2% ✎█▄··█·█····▄ beats 1/7very hard · avg 6.7%▇ 3.0%sharp · too hard for it · noisy
BIRD-SQL (dev) lab52.7% ✎▄··▄·▄·█··▄█ beats 3/7medium · avg 49%▇ 3.0%at its level
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #249 of 393 * · 8.1% of its score · 1 test

Beats Mistral Small 4 (119B-A6.5B), Ministral 3 14B Reasoning 2512, Qwen2.5 Coder 32B Instruct here, though they rank higher overall. Trails Flan-T5 XXL, Granite 4.0 H 1B, Granite 4.0 1B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
LMArena (text)1276.3 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 108/379avg 1268▇▇▇ 8.1%blunt
other tests9 not in a task · 55% of its score
testresultvs the others in its rundifficultycountswhy
LiveBench 2024-07-2634.5% ✎▁▁▁▂▂▃▂█▆▃▅▃ beats 36/61medium · avg 41%▇▇▇▇▇▇▇▇▇▇▇▇▇ 33%at its level
RepoQA (32K, threshold 0.8) lab77.0% ✎▄▄▄··▄▄··▄·█ beats 2/7easy · avg 81%▇▇▇ 7.4%typical
BigCodeBench (Instruct) lab25.8% ✎▄··▄▄···▄▄█▄ beats 0/7medium · avg 36%▇ 3.6%at its level
Open Persian LLM Leaderboard v2 average (21 tasks)63.0% ✎▂▄▂▃█▄▃▆▃▅▂▂ beats 60/81medium · avg 58%▇ 3.5%blunt · at its level
RULER 128k +164.6% ✎▄··▂▄▂▆██▄▄▂ beats 7/21easy · avg 70%▇ 2.8%at its level · small run · several runs
LongBench v2 lab27.8% ✎▂·▃·▂▂▁▃▄▁█▄ beats 2/28very hard · avg 34%▇ 2.1%small run
RULER 64k85.4% ✎▁▁·▁·▂▃▄█▂·▁ beats 16/22easy · avg 83%▇ 1.9%typical
Vectara hallucination leaderboard, 2025 dataset (HHEM-2.3, factual consistency rate)94.6% ✎▁▁▂▃▄▄█▆▃▂▂▁ beats 56/140very easy · avg 94%▇ 0.6%blunt · maxed out · noisy
1 more test
testresultvs the others in its rundifficultycountswhy
Vectara hallucination leaderboard (HHEM-2.3, factual consistency rate)93.1% ✎▁▂▁▂▅█▂▃▄▃▁▁ beats 72/98very easy · avg 90%▇ 0.0%blunt

$ where to run it

Through an API

api · $4.38/M · $2.5 in / $10 out per 1M tokens · 128k context · docs.cohere.com ↗ · price sourceUSD per 1M text tokens, standard input and output (LiteLLM @c19ce71 row 'command-r-plus-08-2024', litellm_provider cohere_chat). Product: Cohere Chat API. API model: command-r-plus-08-2024 (Cohere models page: Live). Currency: USD.

llama.cpp · recommended

  1. Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.
    macOS / Linux
    curl -LsSf https://llama.app/install.sh | sh
    Windows
    irm https://llama.app/install.ps1 | iex

    other ways to install ↗

  2. Run Command R Plus (08-2024) · needs ~62.8 GB · from huggingface.co/lmstudio-community
    chat in the terminal
    llama cli -hf lmstudio-community/c4ai-command-r-plus-08-2024-GGUF:Q4_K_M
  3. Or start a local server and open the address it prints (http://localhost:9931)
    llama serve -hf lmstudio-community/c4ai-command-r-plus-08-2024-GGUF:Q4_K_M

LM Studio

version

  1. Install LM Studio · Open the app once before using the lms command.

    download it (macOS / Windows / Linux) ↗

  2. Run Command R Plus (08-2024) · needs ~62.8 GB · from huggingface.co/lmstudio-community

    open in LM Studio ↗

  3. Or download it in the terminal
    lms get https://huggingface.co/lmstudio-community/c4ai-command-r-plus-08-2024-GGUF@Q4_K_M -y
  4. Then run lms ls to see its name, and lms chat followed by that name

Ollama

version

  1. Install Ollama

    download it (macOS / Windows) ↗

    Linux
    curl -fsSL https://ollama.com/install.sh | sh
  2. Run Command R Plus (08-2024) · needs ~62.9 GB · from ollama.com
    chat in the terminal
    ollama run command-r-plus:104b-08-2024-q4_K_M

MLX (Mac)

version

  1. Install MLX (Mac) · Apple silicon Macs only, text only.
    with uv
    uv tool install mlx-lm
    or
    pip install mlx-lm
  2. Run Command R Plus (08-2024) · needs ~58.4 GB, Mac only · from huggingface.co/mlx-community
    chat in the terminal
    mlx_lm.chat --model mlx-community/c4ai-command-r-plus-08-2024-4bit
  3. Or start an OpenAI-compatible server at http://localhost:8080/v1
    mlx_lm.server --model mlx-community/c4ai-command-r-plus-08-2024-4bit

Weights and documentation: huggingface.co/CohereLabs ↗

$ how the score was worked out · Cohere — Command A technical… 36%, LiveBench model judgments (HF… 33%, Aider code editing benchmark… 16% and 4 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json