whatmodel.sh / Qwen-14B-Chat

Qwen-14B-Chat is an open-weights language model from Alibaba, released September 2023. Its published size is 14.2B parameters. Licence: tongyi-qianwen.

Catalogue identity notes

Comparison-only. Arena entry 'qwen-14b-chat' (text). LMArena's leaderboard table (arena-leaderboard space @6f2eeeb) labels 'qwen-14b-chat' as 'Qwen-14B-Chat' (Alibaba, Qianwen LICENSE), linking https://huggingface.co/Qwen/Qwen-14B-Chat. Maker repo Qwen/Qwen-14B-Chat @cdaff79: licence tag none tagged. 14,167,290,880 parameters from the Hugging Face safetensors metadata (dense, so active = total). Released 2023-09: month the maker's Hugging Face repo was created (createdAt 2023-09-24).

38.4±0.9#557 of 719 LLMsfrom 6 benchmark results across 5 sources

$ how it compares

The LLMs ranked either side of Qwen-14B-Chat, out of 828 with a score, then more from Alibaba.

#modelscorewhereRAMreleased
647Llama-3-Instruct-8B-SimPO-v0.2 Princeton NLP39±1local~6.6GB2024-07
648Llama 3.2 3B Instruct Meta38±1api $0.12/M +local~3.4GB2024-09
649Qwen-14B-Chat Alibaba38±1local~11GB2023-09
650Falcon-180B-Chat TII38±2local~115GB2023-09
651CodeGemma 7B (v1.0) Google38±1local~7.1GB2024-03
more from Alibaba
18Qwen3.8 Max (2.4T-A95B) Alibaba78±1api $3.00/M +local~380GB2026-08
34Qwen3.8 Max (0902) Alibaba76±1api $3.00/M2026-09
37Qwen3.8-Flash-Next Alibaba75±1local~59GB2026-08

see all LLMs · find the ones that fit your machine

$ what it's good at

coding▁▁▁▃▆██▇▆▄▃▁ #378 of 458 * · 41% of its score · 1 test

Beats LFM2.5 8B-A1B, DeepSeek R1 Distill Qwen 7B, Qwen3.5 2B here, though they rank higher overall. Trails Qwen2.5 1.5B Instruct, WizardLM 13B V1.2, Falcon3 3B Instruct here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
HumanEval46.3% ✎▁█▄▅▇█·▄▇▅▄▄ beats 18/42easy · avg 78%▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 41%sharp · at its level
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #355 of 393 · 34% of its score · 3 tests

Beats Gemma 4 E2B, Code Llama 70B Instruct, Phi-3-mini-4k-instruct (June 2024 update) here, though they rank higher overall. Trails Gemma 3 270M IT, SmolLM2 360M Instruct, Qwen2.5 0.5B Instruct here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
AlpacaEval 2 length-controlled12.4% ✎▁▂▂▃▆▆█▆▄▄▁▁ beats 30/122medium · avg 39%▇▇▇▇▇▇▇ 18%typical
Polyrating rating (bias-aware re-fit of Chatbot Arena votes, mid-2024)1081.0 ✎▂▁▂▁▃▇█▆▇▄▂▂ beats 37/95avg 1201▇▇▇ 8.0%blunt
LMArena (text)1139.3 ✎▁▁▁▃▃▃▃▆▆▇█▃ beats 32/379avg 1268▇▇▇ 7.9%blunt
other tests2 not in a task · 24% of its score
testresultvs the others in its rundifficultycountswhy
EvoEval (overall)32.1% ✎▂▂▃▄▄█▁▄▅▃▁▃ beats 17/42medium · avg 55%▇▇▇▇▇▇▇▇ 21%at its level
EQ-Bench v1 (60 questions, paper run)43.8% ✎▂··▄·▂▆▄▂█·▂ beats 8/14medium · avg 57%▇ 3.5%at its level

$ where to run it

llama.cpp · recommended

version

  1. Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.
    macOS / Linux
    curl -LsSf https://llama.app/install.sh | sh
    Windows
    irm https://llama.app/install.ps1 | iex

    other ways to install ↗

  2. Run Qwen-14B-Chat · needs ~9.4 GB · from huggingface.co/mradermacher
    chat in the terminal
    llama cli -hf mradermacher/Qwen-14B-Chat-GGUF:Q4_K_M
  3. Or start a local server and open the address it prints (http://localhost:9931)
    llama serve -hf mradermacher/Qwen-14B-Chat-GGUF:Q4_K_M

LM Studio

version

  1. Install LM Studio · Open the app once before using the lms command.

    download it (macOS / Windows / Linux) ↗

  2. Run Qwen-14B-Chat · needs ~9.4 GB · from huggingface.co/mradermacher

    open in LM Studio ↗

  3. Or download it in the terminal
    lms get https://huggingface.co/mradermacher/Qwen-14B-Chat-GGUF@Q4_K_M -y
  4. Then run lms ls to see its name, and lms chat followed by that name

Ollama

version

  1. Install Ollama

    download it (macOS / Windows) ↗

    Linux
    curl -fsSL https://ollama.com/install.sh | sh
  2. Run Qwen-14B-Chat · needs ~9.4 GB · from huggingface.co/mradermacher
    chat in the terminal
    ollama run hf.co/mradermacher/Qwen-14B-Chat-GGUF:Q4_K_M

Other ways to run it

  1. Run it as published · needs ~28.33 GB · from huggingface.co/Qwen (official)
    pip install torch transformers==4.32.0 accelerate tiktoken einops scipy transformers_stream_generator==0.0.4 && python -c "from transformers import AutoModelForCausalLM, AutoTokenizer; t=AutoTokenizer.from_pretrained('Qwen/Qwen-14B-Chat', trust_remote_code=True); m=AutoModelForCausalLM.from_pretrained('Qwen/Qwen-14B-Chat', device_map='auto', trust_remote_code=True).eval(); print(m.chat(t, '你好', history=None)[0])"

Official weights and documentation: huggingface.co/Qwen ↗

$ how the score was worked out · Top Leaderboard Ranking = Top… 62%, AlpacaEval 1.0 and 2.0 leader… 18%, Polyrating: A Cost-Effective… 8% and 2 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json