whatmodel.sh / video / Open-Sora Plan v1.3 (T2V)
Open-Sora Plan v1.3 (T2V)
↗ share
+ contribute
Open-Sora Plan v1.3 (T2V) is an open-weights video model from Peking University (PKU-YuanGroup), released October 2024. Its published size is 2.7B parameters. Licence: mit.
$ how it compares
The video models ranked either side of Open-Sora Plan v1.3 (T2V), out of 139 with a score, then more from Peking University (PKU-YuanGroup).
| # | model | score | where | ||
|---|---|---|---|---|---|
| 69 |  Veo 2 | 50±2 | comparison only | ||
| 70 |  LTX-2 | 49±2 | local | ||
| 71 | Open-Sora Plan v1.3 (T2V) | 49±7 | local | ||
| 72 |  Cosmos-1.0-Diffusion-7B-Video2World | 49±5 | comparison only | ||
| 73 |  Seedance 1.0 Lite | 48±2 | comparison only | ||
| more from Peking University (PKU-YuanGroup) | |||||
| 102 | Open-Sora Plan v1.3 (I2V) | 39±7 | local | ||
$ what it's good at
other tests1 not in a task · 78% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| WorldModelBench (human total) | 7.61 / 10 ✎ | ▅··▅▃···▃··█ beats 6/8 | 78% |
$ where to run it
Other ways to run it
- Run it as published · needs ~24 GB, NVIDIA only · from github.com/PKU-YuanGroup (official)
git clone https://github.com/PKU-YuanGroup/Open-Sora-Plan && cd Open-Sora-Plan && git checkout v1.3.1 && pip install -e . && hf download LanguageBind/Open-Sora-Plan-v1.3.0 --include 'any93x640x640/*' 'vae/*' --local-dir osp13 && hf download google/mt5-xxl --local-dir mt5-xxl && torchrun --nnodes=1 --nproc_per_node 1 -m opensora.sample.sample --model_path osp13/any93x640x640 --version v1_3 --num_frames 93 --height 352 --width 640 --text_encoder_name_1 mt5-xxl --text_prompt examples/sora.txt --ae WFVAEModel_D8_4x8x8 --ae_path osp13/vae --save_img_path ./samples --fps 18 --guidance_scale 7.5 --num_sampling_steps 100 --max_sequence_length 512 --sample_method EulerAncestralDiscrete --seed 1234 --num_samples_per_prompt 1 --rescale_betas_zero_snr --prediction_type v_prediction --save_memory
Weights and documentation: huggingface.co/LanguageBind ↗
$ how the score was worked out · WorldModelBench: Judging Vide… 78%
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
| source | results | share of the score |
|---|---|---|
 WorldModelBench: Judging Video Generation Models As World Models | 1 | 78% |
| prior · pull toward the middle | 22% | |
| weighted average | = 48.8 |
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json