whatmodel.sh / Hy4 preview (770B-A49B)

Hy4 preview (770B-A49B) is an open-weights language model from Tencent, released August 2026. Its published size is 770B parameters (49B active per token) and a 1M-token context window. Licence: apache-2.0.

Catalogue identity notes

Arena entry 'hy4-preview' (webdev). Maker repo tencent/Hy4-preview @705d81e: licence tag apache-2.0. Parameters: card: '770B total parameters, of which 49B are activated per token' (backbone, excluding the 10B MTP layer). Released 2026-08: Tencent TokenHub changelog: 2026-08-28 'added Hy4 preview'. Arena name equals the API id hy4-preview; the card's own serving examples use served-model-name 'hy4-preview'.

79.1±1.1#16 of 719 LLMsfrom 15 benchmark results across 2 sources

$ how it compares

The LLMs ranked either side of Hy4 preview (770B-A49B), out of 828 with a score, then more from Tencent.

#modelscorewhereRAMreleased
14GPT-5.5 OpenAI80±1api $11.25/M2026-04
15MiMo-V2.6-Pro Xiaomi79±1api $0.54/M +local~443GB2026-09
16Hy4 preview (770B-A49B) Tencent79±1api $1.25/M +local~248GB2026-08
17GPT-5.6 Terra OpenAI79±1api $4.50/M2026-07
18Qwen3.8 Max (2.4T-A95B) Alibaba78±1api $3.00/M +local~380GB2026-08
more from Tencent
55Hunyuan Hy3 (295B-A21B) Tencent74±1api $0.23/M +local~96GB2026-07
123Hy3 preview (295B-A21B) Tencent68±1local~629GB2026-04

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #21 of 300 · 55% of its score · 8 tests

Beats GPT-5.5 here, though they rank higher overall. Trails Grok 4.7, GLM-5.3, Claude Haiku 5.5 here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Arena Agent (October 2026 aggregate IPS)0.0395 IPS ✎▁▁▁▄▂▃▇█▂▂▁▃ beats 32/49avg -0.312 IPS▇▇▇▇▇▇▇▇▇ 23%sharp
SWE-bench Pro (split unspecified) lab65.7% ✎▃·▁▁▁▂▂▃█▇▃▁ beats 48/55very hard · avg 6.8%▇▇▇ 7.0%sharp · at its level · small run
Terminal-Bench 2.1 lab85.4% ✎▁·▁·▁▁▄▃▄█▃▇ beats 47/56hard · avg 17%▇▇ 5.7%small run
APEX-Agents (pass@1) lab37.1% ✎▃▃··▃··█▃·▃▃ beats 8/8very hard · avg 2.8%▇▇ 5.4%at its level · small run
SWE-bench Multilingual lab82.9% ✎▁··▁▃▂▅▇█▃▃▁ beats 52/60hard · avg 27%▇▇ 4.2%small run
MCP-Atlas (public set) lab83.7% ✎▂·▁▂▁·▁▃█▆▆▃ beats 37/37hard · avg 29%▇ 3.7%small run
Humanity's Last Exam with tools lab55.4% ✎▂▂▂▁▄▂▃▆█▇▂▆ beats 40/54very hard · avg 15%▇ 3.1%at its level · small run
WideSearch lab83.9% ✎█·▂▆··▂···▂▃ beats 10/10medium · avg 40%▇ 2.5%small run
coding▁▁▁▃▆██▇▆▄▃▁ #18 of 458 · 32% of its score · 3 tests

Beats GPT-5.6 Sol, GPT-5.5, MiMo-V2.6-Pro here, though they rank higher overall. Trails Grok 4.7, Qwen3.8-Flash-Next, Qwen3.8 Max (0902) here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Arena WebDev (Code Arena)1633.2 ✎▁▂▄▃▅█▄▇▆▄▁▁ beats 104/119avg 981▇▇▇▇▇▇▇▇ 21%sharp
SWE-bench Pro (split unspecified) lab65.7% ✎▃·▁▁▁▂▂▃█▇▃▁ beats 48/55very hard · avg 6.8%▇▇▇ 7.0%sharp · at its level · small run
SWE-bench Multilingual lab82.9% ✎▁··▁▃▂▅▇█▃▃▁ beats 52/60hard · avg 27%▇▇ 4.2%small run
math█····█·····█ #1 of 3 * · 2.5% of its score · 1 test
testresultvs the others in its rundifficultycountswhy
MathArena Apex (pass@1) lab74.2% ✎▄····▄···▄█▄ beats 5/5very hard · avg 12%▇ 2.5%at its level · small run
web search█·······█··█ #1 of 3 * · 5.6% of its score · 2 tests
testresultvs the others in its rundifficultycountswhy
Humanity's Last Exam with tools lab55.4% ✎▂▂▂▁▄▂▃▆█▇▂▆ beats 40/54very hard · avg 15%▇ 3.1%at its level · small run
WideSearch lab83.9% ✎█·▂▆··▂···▂▃ beats 10/10medium · avg 40%▇ 2.5%small run
other tests5 not in a task · 22% of its score
testresultvs the others in its rundifficultycountswhy
GPQA Diamond lab92.3% ✎▁▁▁▁▂▄▅▅███▄ beats 287/310hard · avg 40%▇▇▇ 6.8%sharp · maxed out · small run
Humanity's Last Exam lab43.4% ✎▁▁▁▃▆▆▇██▆▁▃ beats 96/104very hard · avg 4.9%▇▇ 5.3%at its level · small run
NL2Repo lab58.9% ✎▂▂·▂▂▄█▆▆▂▄▆ beats 19/21very hard · avg 10%▇▇ 4.3%at its level · small run
SkillsBench 79-task text-only (Claude Code, avg of 3) lab62.9% ✎█··········█ beats 1/1hard · avg 16%▇ 2.8%at its level · small run
SuperChem lab66.4% ✎█··········█ beats 1/1hard · avg 20%▇ 2.4%at its level · small run

$ where to run it

Through an API

api · Tencent Cloud TokenHub · $1.25/M · $0.834 in / $2.501 out per 1M tokens · 1M context · cloud.tencent.com ↗ · price sourceUSD per 1M tokens, Tencent Cloud TokenHub (international site) model pricing, Hy4 preview, Singapore region tab: input $0.834, output $2.501; cache $0.042 excluded. The same rate appears under the other region tabs. The China site (cloud.tencent.com/document/product/1823/130055) lists CNY 6/18. Currency: USD. Tencent Cloud official pricing page (last updated 2026-10-03), observed 2026-10-07.

llama.cpp · recommended

version

  1. Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.
    macOS / Linux
    curl -LsSf https://llama.app/install.sh | sh
    Windows
    irm https://llama.app/install.ps1 | iex

    other ways to install ↗

  2. Run Hy4 preview (770B-A49B) · needs ~417 GB · from huggingface.co/6block
    chat in the terminal
    llama cli -hf 6block/Hy4-preview-GGUF:IQ4_XS
  3. Or start a local server and open the address it prints (http://localhost:9931)
    llama serve -hf 6block/Hy4-preview-GGUF:IQ4_XS

LM Studio

version

  1. Install LM Studio · Open the app once before using the lms command.

    download it (macOS / Windows / Linux) ↗

  2. Run Hy4 preview (770B-A49B) · needs ~417 GB · from huggingface.co/6block

    open in LM Studio ↗

  3. Or download it in the terminal
    lms get https://huggingface.co/6block/Hy4-preview-GGUF@IQ4_XS -y
  4. Then run lms ls to see its name, and lms chat followed by that name

Other ways to run it

version

  1. Run it as published · needs ~813.77 GB, NVIDIA only · from huggingface.co/tencent (official)
    docker run --gpus all -p 8000:8000 --ipc=host -v ~/.cache/huggingface:/root/.cache/huggingface vllm/vllm-openai:hy4-preview tencent/Hy4-preview-FP8 --tensor-parallel-size 8 --speculative-config '{"num_speculative_tokens":3,"method":"mtp"}' --attention-backend FLASHMLA_SPARSE --tool-call-parser hy_v4 --reasoning-parser hy_v4 --enable-auto-tool-choice --port 8000 --served-model-name hy4-preview

Official weights and documentation: huggingface.co/tencent ↗

$ how the score was worked out · Tencent Hy4 preview model card 56%, LMArena leaderboard dataset 44%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Tencent Hy4 preview model card · lab-reported13▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 56%Apache-2.0
LMArena leaderboard dataset2▇▇▇▇▇▇▇▇▇▇▇▇▇ 44%CC BY 4.0
prior · pull toward the middle▇ 1%
weighted average= 79.1

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json