whatmodel.sh / image / UltraEdit (SD3, with mask)

UltraEdit (SD3, with mask) is an open-weights image model from Peking University / BIGAI (UltraEdit), released June 2024.

Catalogue identity notes

UltraEdit (Zhao et al., NeurIPS 2024 D&B) SD3-based editing checkpoint BleachNick/SD3_UltraEdit_w_mask (pinned e5beecb, created 2024-06-30). EdiVal: 'UltraEdit: settings from https://github.com/HaozheZhao/UltraEdit; we apply a black mask since no explicit mask is provided', i.e. the mask-conditioned SD3 checkpoint used mask-free (the repo README's free-form recipe). Licence: the card says 'More Information Needed', so licence is left unset. WEAVE 'UltraEdit(SD3)' and Edit-Compass 'UltraEdit' do not say which SD3 checkpoint (w_mask vs freeform) and are held. Comparison-only.

Model information sources

Release date ↗

32.4±6.9comparison only: no current run option verifiedfrom 1 benchmark result across 1 source* thinly tested, treat the rank as provisional

Score within the LMArena text-to-image comparison set only.

$ how it compares

The image models ranked either side of UltraEdit (SD3, with mask), out of 197 with a score.

#modelscorewhereRAMreleased
171IF-L DeepFloyd33±3local~14GB2023-04
172Lumina-DiMOO Alpha-VLLM (Shanghai AI Lab)32±4local~39GB2025-09
173UltraEdit (SD3, with mask) Peking University / BIGAI (UltraEdit)32±7comparison only2024-06
174VILA-U 7B (256px) MIT Han Lab / NVIDIA32±7local~20GB2024-10
175LCM-SSD-1B latent-consistency32±4local~3.6GB2023-11

see all image models · find the ones that fit your machine

$ what it's good at

other tests1 not in a task · 80% of its score
testresultvs the others in its rundifficultycountswhy
EdiVal multi-turn editing overall (EdiVal-O after turn 3)22.9% ✎▂·▂▃·▂·▃▂·▃█ beats 3/14medium · avg 42%▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 80%blunt · at its level

$ where to run it

No verified API or download recorded yet · add one

Weights and documentation: huggingface.co/BleachNick ↗

$ how the score was worked out · EdiVal-Agent: An Object-Centr… 80%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
EdiVal-Agent: An Object-Centric Framework for Automated, Fine-Grained Evaluation of Multi-Turn Editing (arXiv:2509.13399v3)1▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 80%CC-BY-4.0
prior · pull toward the middle▇▇▇▇▇▇ 20%
weighted average= 32.4

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json