whatmodel.sh / image / FLUX.2 [dev]

FLUX.2 [dev] is an open-weights image model from Black Forest Labs, released November 2025. Its published size is 32B parameters. Licence: flux-dev-nc.

58.3±1.0#53 of 144 image modelsfrom 18 benchmark results across 14 sources

Score within the LMArena text-to-image comparison set only.

$ how it compares

The image models ranked either side of FLUX.2 [dev], out of 197 with a score, then more from Black Forest Labs.

#modelscorewhereRAMreleased
59Qwen-Image-Edit-2509 Alibaba59±3api $0.030/image +local~26GB2025-09
60HiDream-O1-Image HiDream58±2api $0.010/image +local~5.3GB2026-05
61FLUX.2 [dev] Black Forest Labs58±1api $0.046/image +local~20GB2025-11
62Reve V1 Reve58±4comparison only
63Z-Image (Base) Alibaba (Tongyi-MAI)58±2api $0.010/image +local~10GB2026-01
more from Black Forest Labs
32FLUX.2 [max] Black Forest Labs64±1api $0.070/image2025-12
36FLUX.2 [pro] Black Forest Labs63±2api $0.030/image2025-11
37FLUX.2 [flex] Black Forest Labs62±2api $0.050/image2025-11

see all image models · find the ones that fit your machine

$ what it's good at

text to image▂▅▅▃▄▄█▃▁▂▁▁ #42 of 126 · 56% of its score · 9 tests

Beats Wan 2.7 Image, Wan 2.5 Text-to-Image Preview, Recraft V4 here, though they rank higher overall.

testresultvs the others in its rundifficultycountswhy
GenExam (relaxed overall, GPT-5 judge)42.3% ✎▄█▂▂▂▃▆▄·▂·▂ beats 9/16hard · avg 26%▇▇▇▇▇▇▇▇▇▇ 24%sharp · at its level
LMArena text-to-image1145.8 ✎▂▂▃▄▇█▄▂▄▂·▂ beats 41/75avg 1027▇▇▇▇▇▇ 15%typical
QC-T2I-Bench (English, HCQ total)89.5% ✎▄····▄█▄▄█▄█ beats 10/10easy · avg 82%▇▇ 4.8%typical
TIIF-Bench v3 (short prompts, TIIF-Evaluator)87.2% ✎▂█····▄▄▄··▂ beats 8/11easy · avg 79%▇▇ 4.4%typical
UltraText Bench (Composite, bilingual dense text rendering)41.0% ✎▁▂▂█▃▁▂▃·▁·▁ beats 7/22hard · avg 28%▇▇ 4.3%sharp · at its level · noisy
FEPBench instruction faithfulness53.1% ✎▄·█···▄▄▄▄▄▄ beats 4/8medium · avg 36%▇ 2.0%blunt · at its level
HPSv3 score of Cosmos 3 report text-to-image evaluation images11.3800 ✎▄···█··▄·▄·▄ beats 2/5avg 11.076▇ 1.0%blunt
CVTG-102ch PNED (Chinese character rendering, Cosmos 3 report)68.7% ✎▄·······▄█▄▄ beats 1/5medium · avg 60%▇ 0.3%blunt · at its level · noisy
1 more test
testresultvs the others in its rundifficultycountswhy
CVTG-500L PNED (English long-prompt text rendering, Cosmos 3 report)85.0% ✎█······█████ beats 1/5easy · avg 85%▇ 0.0%blunt
image to image / editing▁▁·▃▂▃█▃▃▄▁▁ #40 of 62 · 20% of its score · 3 tests

Beats GPT Image 1 Mini here, though they rank higher overall. Trails FLUX.2 [klein] 9B, Qwen-Image-Edit, LongCat-Image-Edit here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Edit-Compass (EN, overall)52.2% ✎▃▃▂·▃▆▂█·▃·▃ beats 13/20hard · avg 45%▇▇▇▇▇ 12%at its level
Arena image edit1224.6 ✎▂▁▁▂▆▇█▄▆▅▁▂ beats 14/53avg 1153▇▇ 5.9%typical
GEditBench v2 (overall Elo)1006.0 ✎▃▂····▂█▂▃▂▃ beats 6/14avg 956▇ 2.3%blunt
other tests6 not in a task · 23% of its score
testresultvs the others in its rundifficultycountswhy
VVRBench accuracy (10,000 verifiable synthetic-scene tasks)19.1% ✎▃·█▅▃·▅▃···▃ beats 8/10very hard · avg 7.6%▇▇▇▇▇▇ 16%sharp
Rapidata Benchmark.ai image benchmark (overall Elo)945.7 ✎▁▁▁▄▃█▂▁▁▂▁▁ beats 9/34avg 875▇ 2.4%typical
UniGenBench + Physical-AI prompts, All 1,170 (Cosmos 3 report)87.6% ✎▄···█··▄···█ beats 3/5easy · avg 78%▇ 2.1%typical
PaintBench precise editing (mIoU, 20-task average)4.6% ✎▃·····█▅▃·▃▅ beats 4/9very hard · avg 4.3%▇ 1.3%too hard for it
ViGoR-Bench zero-shot visual reasoning, image models (Result Avg)29.9% ✎▂···▂·▂█▆▅·▂ beats 7/15hard · avg 31%▇ 0.9%at its level
Knowledge Visualization T2I (Brief Caption, English overall)36.9% ✎▅·▃·▃··▃·█▃▃ beats 8/9hard · avg 28%▇ 0.5%blunt · at its level

$ where to run it

Through an API

api · Cloudflare · $0.046/image · developers.cloudflare.com ↗ · price sourceCloudflare Workers AI; 4 output tiles × 28 steps × USD0.00041/output tile/step; zero input-image tiles. Workers plan fee excluded; published USD equivalent is rounded, service bills Neurons. Product: Workers AI text-to-image. API model: @cf/black-forest-labs/flux-2-dev. Settings: width=1024, height=1024, steps=28, input images=0, output tiles=4. Price basis: derived fixed-setting output cost using published rounded USD rates. Additional/excluded charges: Workers Paid plan base fee, input images and usage beyond this setting. Currency: USD.

Other ways to run it

version

  1. Run it as published · needs ~19.7 GB, NVIDIA only · from huggingface.co/blog
    uv run --with diffusers --with transformers --with accelerate --with torch --with sentencepiece --with bitsandbytes python -c "import torch; from diffusers import Flux2Pipeline; p=Flux2Pipeline.from_pretrained('diffusers/FLUX.2-dev-bnb-4bit', torch_dtype=torch.bfloat16); p.enable_model_cpu_offload(); p('a cat holding a sign', num_inference_steps=28, guidance_scale=4).images[0].save('out.png')"

Official weights and documentation: huggingface.co/black-forest-labs ↗

$ how the score was worked out · GenExam: A Multidisciplinary… 24%, LMArena leaderboard dataset 21%, Verifiable Visual Rewards Tra… 16% and 11 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
GenExam: A Multidisciplinary Text-to-Image Exam (arXiv v5)1▇▇▇▇▇▇▇ 24%CC-BY-4.0
LMArena leaderboard dataset2▇▇▇▇▇▇ 21%CC BY 4.0
Verifiable Visual Rewards Transfer from Synthetic Scenes to Natural Prompts (VVRBench), arXiv:2609.35641v11▇▇▇▇▇ 16%CC-BY-4.0
Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modeling1▇▇▇▇ 12%CC-BY-4.0
QC-T2I-Bench: Scalable Question-Centric Text-to-Image Evaluation (Reliable Ranking, Fine-Grained Diagnosis, and Cost-Aware Routing)1▇ 5%CC-BY-4.0
TIIF-Bench: How Does Your T2I Model Follow Your Instructions? (arXiv v3)1▇ 4%CC-BY-4.0
UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generation (arXiv:2610.09823v1)1▇ 4%CC-BY-4.0
Cosmos 3: Omnimodal World Models for Physical AI (arXiv:2606.02800v4)4▇ 3%CC-BY-4.0
Rapidata/text-to-image-human-preference-6M (Benchmark.ai Image Benchmark) published dataset-card rankings1▇ 2%CC-BY-4.0
GEditBench v2: A Human-Aligned Benchmark for General Image Editing1▇ 2%CC-BY-4.0
Faithful, Enriched, and Precise: Benchmarking Natural-Science Illustration Generation by T2I models (FEPBench)1▇ 2%CC0-1.0
PaintBench: Deterministic Evaluation of Precise Visual Editing (arXiv:2606.00188v1)1▇ 1%CC-BY-4.0
ViGoR-Bench: How Far Are Visual Generative Models From Zero-Shot Visual Reasoners? (arXiv:2603.25823v1)1▇ 1%CC-BY-4.0
Knowledge Visualization: A Benchmark and Method for Knowledge-Intensive Text-to-Image Generation (arXiv:2604.22302v1)1▇ 1%CC-BY-4.0
prior · pull toward the middle▇ 0%
weighted average= 58.3

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json