whatmodel.sh / Step 3.7 Flash (198B-A11B)

Step 3.7 Flash (198B-A11B) is an open-weights language model from StepFun, released May 2026. Its published size is 198B parameters (11B active per token) and a 256k-token context window. Licence: apache-2.0.

Catalogue identity notes

Comparison-only. Official model card (huggingface.co/stepfun-ai/Step-3.7-Flash @ 5f6244077ac62e04eec3f320501ff8c2b293373a, created 2026-05-23, Apache-2.0): 198B-parameter sparse MoE vision-language model (196B language backbone + 1.8B vision encoder), about 11B active per token, reasoning levels low/medium/high, 256k context (context not recorded here: no approved context source). MathArena config stepfun/3.7-flash: API model 'step-3.7-flash', reasoning_effort high, date 2026-05-29. Distinct from step-3-5-flash.

67.0±1.0#115 of 719 LLMsfrom 13 benchmark results across 2 sources

$ how it compares

The LLMs ranked either side of Step 3.7 Flash (198B-A11B), out of 828 with a score, then more from StepFun.

#modelscorewhereRAMreleased
130Laguna M.1 Poolside67±2api price unknown +local~135GB2026-04
131Qwen3.7 Flash Alibaba67±1api $0.055/M2026-07
132Step 3.7 Flash (198B-A11B) StepFun67±1api $0.44/M +local~104GB2026-05
133Gemma 4 31B Google67±1api $0.19/M +local~21GB2026-04
134Gemini 3.1 Flash-Lite Google67±1api $0.56/M2026-03
more from StepFun
45Step 5 Preview StepFun75±1comparison only
115Step 3.5 Flash (196B-A11B) StepFun68±1api $0.15/M +local~118GB2026-02

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasksnot ranked on this task yet · 3 tests
testresultvs the others in its rundifficultycountswhy
Terminal-Bench 2.1 lab59.5% ✎▁·▁·▁▁▄▃▄█▃▇ beats 23/56very hard · avg 7.1%—not counted yet: no other model in the same run to compare it with
SWE-bench Pro (split unspecified) lab56.3% ✎▃·▁▁▁▂▂▃█▇▃▁ beats 33/55very hard · avg 4.3%—not counted yet: no other model in the same run to compare it with
Toolathlon (Tool Decathlon) lab49.5% ✎▂▂▄▂▄▄▆▂█▆██ beats 16/27—not counted yet: no other model in the same run to compare it with
codingnot ranked on this task yet · 1 test
testresultvs the others in its rundifficultycountswhy
SWE-bench Pro (split unspecified) lab56.3% ✎▃·▁▁▁▂▂▃█▇▃▁ beats 33/55very hard · avg 4.3%—not counted yet: no other model in the same run to compare it with
math▁▂▃▅▆▅▄█▄▁▁▁ #102 of 398 · 93% of its score · 11 tests

Beats Claude Sonnet 4.6, MiniMax-M3, Nemotron 3 Ultra 550B-A55B here, though they rank higher overall. Trails Gemini 2.5 Flash, GLM-4.5-Air, Granite 4.2 30B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
MathArena ArXivMath June 2026 (48 problems)30.6% ✎▂···▄·██▆▆▄▂ beats 2/19very hard · avg 4.6%▇▇▇▇▇▇▇▇▇▇ 25%sharp · at its level
MathArena ArXivMath April 2026 (40 problems)35.8% ✎▁·····▅██▄·▁ beats 3/20very hard · avg 7.2%▇▇▇▇▇▇▇▇ 20%sharp · at its level
MathArena ArXivMath February 2026 (32 problems)32.0% ✎▁▁▁▁█▇▄▃▁▃·▃ beats 7/24very hard · avg 9.1%▇▇▇▇▇ 11%at its level
MathArena ArXivMath March 2026 (30 problems)45.0% ✎█▃▅·█▃▃·▅·▃▃ beats 1/14very hard · avg 15%▇▇▇▇ 11%at its level
MathArena ArXivMath May 2026 (40 problems)46.7% ✎▁··▁▄█▄▁·▃·▁ beats 3/17very hard · avg 10%▇▇▇ 7.9%at its level
MathArena BrokenArXiv April 2026 (61 problems)18.9% ✎▂▂▆█▃▃▂▂▂··▂ beats 5/18very hard · avg 0.7%▇▇ 3.9%sharp · noisy
MathArena BrokenArXiv June 2026 (54 problems)15.7% ✎▄··█▂▂▂▆▄··▂ beats 5/14very hard · avg 1.1%▇ 3.2%sharp · noisy
MathArena BrokenArXiv May 2026 (50 problems)8.5% ✎██·▄▄▄····▄▄ beats 0/8very hard · avg 1.6%▇ 3.1%sharp
3 more tests
testresultvs the others in its rundifficultycountswhy
MathArena ArXivLean June 2026 (46 problems)0.0% ✎▄····▄▄███·▄ beats 0/9very hard · avg 0.7%▇ 2.7%sharp · too hard for it
MathArena BrokenArXiv March 2026 (56 problems)10.7% ✎█·▆█▂·▂▂···▂ beats 4/14very hard · avg 0.8%▇ 2.4%sharp · noisy
MathArena BrokenArXiv February 2026 (31 problems)12.1% ✎▃▂▂▃█▃▂·▃··▂ beats 9/16very hard · avg 0.7%▇ 2.3%sharp · too hard for it · noisy
other tests5 not in a task · 6.7% of its score
testresultvs the others in its rundifficultycountswhy
WideSearch corrected dataset56.8% ✎▃······▃▃▃█▃ beats 1/7hard · avg 20%▇ 3.5%at its level · noisy
SkillsBench 87-task subset24.9% ✎▄··▄▄▄···█·█ beats 2/7very hard · avg 8.2%▇ 3.2%at its level
SimpleVQA with tools (search) lab79.2% ✎no other model yet—not counted yet: no other model in the same run to compare it with
V* Bench with Python tool lab95.3% ✎no other model yet—not counted yet: no other model in the same run to compare it with
ClawEval 1.1 (metric unspecified) lab67.1% ✎no other model yet—not counted yet: no other model in the same run to compare it with

$ where to run it

Through an API

api · $0.44/M · $0.2 in / $1.15 out per 1M tokens · 256k context · platform.stepfun.ai ↗ · price sourceUSD per 1M tokens, StepFun Open Platform (international), step-3.7-flash (Multimodal Reasoning Models table): input on cache miss $0.20, output $1.15 (output includes reasoning). Cache-hit input ($0.04/1M) excluded. Currency: USD. StepFun official pricing page, observed 2026-09-26.

llama.cpp · recommended

version

  1. Install llama.cpp · Homebrew and winget installs name the commands llama-cli and llama-server instead.
    macOS / Linux
    curl -LsSf https://llama.app/install.sh | sh
    Windows
    irm https://llama.app/install.ps1 | iex

    other ways to install ↗

  2. Run Step 3.7 Flash (198B-A11B) · needs ~115.47 GB · from huggingface.co/stepfun-ai
    chat in the terminal
    llama cli -hf stepfun-ai/Step-3.7-Flash-GGUF:Q4_K_S
  3. Or start a local server and open the address it prints (http://localhost:9931)
    llama serve -hf stepfun-ai/Step-3.7-Flash-GGUF:Q4_K_S

LM Studio

version

  1. Install LM Studio · Open the app once before using the lms command.

    download it (macOS / Windows / Linux) ↗

  2. Run Step 3.7 Flash (198B-A11B) · needs ~115.47 GB · from huggingface.co/stepfun-ai

    open in LM Studio ↗

  3. Or download it in the terminal
    lms get https://huggingface.co/stepfun-ai/Step-3.7-Flash-GGUF@Q4_K_S -y
  4. Then run lms ls to see its name, and lms chat followed by that name

Weights and documentation: huggingface.co/stepfun-ai ↗

$ how the score was worked out · MathArena ArXivMath / BrokenA… 93%, inclusionAI/Ling-3.0-flash mo… 7%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
MathArena ArXivMath / BrokenArXiv / ArXivLean model-output datasets11▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 93%CC BY-SA 4.0
inclusionAI/Ling-3.0-flash model card2▇▇ 7%MIT
prior · pull toward the middle▇ 0%
weighted average= 67.0

not counted (6)

stepfun-ai/Step-3.7-Flash model cardSWE-bench Pro (split unspecified) [correct]56.3%fewer than three models have this test yet, or this source ran it for this model alone
stepfun-ai/Step-3.7-Flash model cardTerminal-Bench 2.1 [correct]59.5%fewer than three models have this test yet, or this source ran it for this model alone
stepfun-ai/Step-3.7-Flash model cardToolathlon (Tool Decathlon) [correct]49.5%fewer than three models have this test yet, or this source ran it for this model alone
stepfun-ai/Step-3.7-Flash model cardSimpleVQA with tools (search) [correct]79.2%fewer than three models have this test yet, or this source ran it for this model alone
stepfun-ai/Step-3.7-Flash model cardV* Bench with Python tool [correct]95.3%fewer than three models have this test yet, or this source ran it for this model alone
stepfun-ai/Step-3.7-Flash model cardClawEval 1.1 (metric unspecified) [correct]67.1%fewer than three models have this test yet, or this source ran it for this model alone

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json