whatmodel.sh / image / MagicBrush (InstructPix2Pix fine-tune, jul7)

MagicBrush (InstructPix2Pix fine-tune, jul7) is an open-weights image model from Ohio State University (OSU NLP), released July 2023. Licence: creativeml-openrail-m.

Catalogue identity notes

MagicBrush (Zhang et al., NeurIPS 2023 Datasets & Benchmarks): InstructPix2Pix fine-tuned on the MagicBrush dataset. EdiVal Appendix pins 'Magicbrush: same settings as IP2P; model weights from https://huggingface.co/vinesmsuic/magicbrush-jul7' (pinned d75a9f1, created 2023-07-08; card licence creativeml-openrail-m). Only the EdiVal row is mapped; Edit-Compass, UnicBench, WEAVE and ImagenHub print 'MagicBrush' without naming the checkpoint (the same uploader also has magicbrush-paper), so those rows are held. Comparison-only: no local command verified.

Model information sources

Release date ↗ · Weights licence ↗

28.7±7.2comparison only: no current run option verifiedfrom 1 benchmark result across 1 source* thinly tested, treat the rank as provisional

Score within the LMArena text-to-image comparison set only.

$ how it compares

The image models ranked either side of MagicBrush (InstructPix2Pix fine-tune, jul7), out of 197 with a score.

#modelscorewhereRAMreleased
182Versatile Diffusion v1.0 SHI Labs29±4local~7.2GB2022-11
183DALL·E Mega (minDALL-E) DALL·E Mini / minDALL-E29±4local~8GB2022-07
184MagicBrush (InstructPix2Pix fine-tune, jul7) Ohio State University (OSU NLP)29±7comparison only2023-07
185Openjourney PromptHero28±2local~2.1GB2022-11
186Stable Diffusion v1.4 CompVis27±2local~2.1GB2022-08

see all image models · find the ones that fit your machine

$ what it's good at

other tests1 not in a task · 78% of its score
testresultvs the others in its rundifficultycountswhy
EdiVal multi-turn editing overall (EdiVal-O after turn 3)19.4% ✎▂·▃▃·▂·▃▂·▃█ beats 1/14medium · avg 42%▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 78%blunt

$ where to run it

No verified API or download recorded yet · add one

Weights and documentation: huggingface.co/vinesmsuic ↗

$ how the score was worked out · EdiVal-Agent: An Object-Centr… 78%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
EdiVal-Agent: An Object-Centric Framework for Automated, Fine-Grained Evaluation of Multi-Turn Editing (arXiv:2509.13399v3)1▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 78%CC-BY-4.0
prior · pull toward the middle▇▇▇▇▇▇▇ 22%
weighted average= 28.7

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json