whatmodel.sh / Qwen-14B-Chat
Qwen-14B-Chat
↗ share
+ contribute
Qwen-14B-Chat is an open-weights language model from Alibaba, released September 2023. Its published size is 14.2B parameters. Licence: tongyi-qianwen.
Catalogue identity notes
Comparison-only. Arena entry 'qwen-14b-chat' (text). LMArena's leaderboard table (arena-leaderboard space @6f2eeeb) labels 'qwen-14b-chat' as 'Qwen-14B-Chat' (Alibaba, Qianwen LICENSE), linking https://huggingface.co/Qwen/Qwen-14B-Chat. Maker repo Qwen/Qwen-14B-Chat @cdaff79: licence tag none tagged. 14,167,290,880 parameters from the Hugging Face safetensors metadata (dense, so active = total). Released 2023-09: month the maker's Hugging Face repo was created (createdAt 2023-09-24).
$ how it compares
The LLMs ranked either side of Qwen-14B-Chat, out of 828 with a score, then more from Alibaba.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 647 | 39±1 | local | |||
| 648 | 38±1 | api $0.12/M +local | |||
| 649 | 38±1 | local | |||
| 650 | 38±2 | local | |||
| 651 | 38±1 | local | |||
| more from Alibaba | |||||
| 18 | 78±1 | api $3.00/M +local | |||
| 34 | 76±1 | api $3.00/M | |||
| 37 | 75±1 | local | |||
$ what it's good at
coding▁▁▁▃▆██▇▆▄▃▁ #378 of 458 * · 41% of its score · 1 test
Beats LFM2.5 8B-A1B, DeepSeek R1 Distill Qwen 7B, Qwen3.5 2B here, though they rank higher overall. Trails Qwen2.5 1.5B Instruct, WizardLM 13B V1.2, Falcon3 3B Instruct here, though they rank lower overall.
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #355 of 393 · 34% of its score · 3 tests
Beats Gemma 4 E2B, Code Llama 70B Instruct, Phi-3-mini-4k-instruct (June 2024 update) here, though they rank higher overall. Trails Gemma 3 270M IT, SmolLM2 360M Instruct, Qwen2.5 0.5B Instruct here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| AlpacaEval 2 length-controlled | 12.4% ✎ | ▁▂▂▃▆▆█▆▄▄▁▁ beats 30/122 | 18% |
| Polyrating rating (bias-aware re-fit of Chatbot Arena votes, mid-2024) | 1081.0 ✎ | ▂▁▂▁▃▇█▆▇▄▂▂ beats 37/95 | 8.0% |
| LMArena (text) | 1139.3 ✎ | ▁▁▁▃▃▃▃▆▆▇█▃ beats 32/379 | 7.9% |
other tests2 not in a task · 24% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| EvoEval (overall) | 32.1% ✎ | ▂▂▃▄▄█▁▄▅▃▁▃ beats 17/42 | 21% |
| EQ-Bench v1 (60 questions, paper run) | 43.8% ✎ | ▂··▄·▂▆▄▂█·▂ beats 8/14 | 3.5% |
$ where to run it
llama.cpp · recommended
version
- Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.macOS / Linux
curl -LsSf https://llama.app/install.sh | shWindowsirm https://llama.app/install.ps1 | iex - Run Qwen-14B-Chat · needs ~9.4 GB · from huggingface.co/mradermacherchat in the terminal
llama cli -hf mradermacher/Qwen-14B-Chat-GGUF:Q4_K_M - Or start a local server and open the address it prints (http://localhost:9931)
llama serve -hf mradermacher/Qwen-14B-Chat-GGUF:Q4_K_M
LM Studio
version
- Install LM Studio · Open the app once before using the lms command.
- Run Qwen-14B-Chat · needs ~9.4 GB · from huggingface.co/mradermacher
- Or download it in the terminal
lms get https://huggingface.co/mradermacher/Qwen-14B-Chat-GGUF@Q4_K_M -y - Then run lms ls to see its name, and lms chat followed by that name
Ollama
version
- Install Ollama
download it (macOS / Windows) ↗
Linuxcurl -fsSL https://ollama.com/install.sh | sh - Run Qwen-14B-Chat · needs ~9.4 GB · from huggingface.co/mradermacherchat in the terminal
ollama run hf.co/mradermacher/Qwen-14B-Chat-GGUF:Q4_K_M
Other ways to run it
- Run it as published · needs ~28.33 GB · from huggingface.co/Qwen (official)
pip install torch transformers==4.32.0 accelerate tiktoken einops scipy transformers_stream_generator==0.0.4 && python -c "from transformers import AutoModelForCausalLM, AutoTokenizer; t=AutoTokenizer.from_pretrained('Qwen/Qwen-14B-Chat', trust_remote_code=True); m=AutoModelForCausalLM.from_pretrained('Qwen/Qwen-14B-Chat', device_map='auto', trust_remote_code=True).eval(); print(m.chat(t, '你好', history=None)[0])"
Official weights and documentation: huggingface.co/Qwen ↗
$ how the score was worked out · Top Leaderboard Ranking = Top… 62%, AlpacaEval 1.0 and 2.0 leader… 18%, Polyrating: A Cost-Effective… 8% and 2 more
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
| source | results | share of the score |
|---|---|---|
| 2 | 62% | |
| 1 | 18% | |
| 1 | 8% | |
| 1 | 8% | |
| 1 | 3% | |
| prior · pull toward the middle | 0% | |
| weighted average | = 38.4 |
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json