File size: 2,782 Bytes
e5d0d5e f410c07 e5d0d5e d112c4a e5d0d5e f410c07 e5d0d5e d112c4a b5c8f75 d112c4a b5c8f75 d112c4a b5c8f75 d112c4a b5c8f75 d112c4a e5d0d5e cbdbc3f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 |
---
license: apache-2.0
language:
- en
base_model:
- Wan-AI/Wan2.1-T2V-14B
tags:
- text-to-video
- lora
- diffusers
- template:diffusion-lora
widget:
- text: >-
[malone] a man with a beard and mustache, wearing a dark green baseball cap, singing and dancing, with a few blurred lights visible..
output:
url: videos/1742519489362__000000750_0.webp
- text: >-
[malone] a man singing while holding a cigarette in his hand and dancing.
output:
url: videos/1742520256525__000000750_1.webp
- text: >-
[malone] a man with a beard and mustache, wearing a dark green baseball cap, singing and dancing, with a few blurred lights visible..
output:
url: videos/1742522116718__000001000_0.mp4
- text: >-
[malone] a man singing while holding a cigarette in his hand and dancing.
output:
url: videos/1742522882787__000001000_1.mp4
- text: >-
[malone] a man with a beard and mustache, wearing a dark green baseball cap, singing and dancing, with a few blurred lights visible..
output:
url: videos/1742524740417__000001250_0.webp
- text: >-
[malone] a man singing while holding a cigarette in his hand and dancing.
output:
url: videos/1742525503397__000001250_1.webp
---
# PostMalone Lora for WanVideo2.1
<Gallery />
- First 2 videos are from [750 steps trained]
- Middle 2 videos are from [1000 steps trained] which is available for download
- Last 2 videos are from [1250 steps trained]
## Trigger words
You should use `malone` to trigger the video generation.
## Using with Diffusers
```py
pip install git+https://github.com/huggingface/diffusers.git
```
```py
import torch
from diffusers.utils import export_to_video
from diffusers import AutoencoderKLWan, WanPipeline
from diffusers.schedulers.scheduling_unipc_multistep import UniPCMultistepScheduler
# Available models: Wan-AI/Wan2.1-T2V-14B-Diffusers, Wan-AI/Wan2.1-T2V-1.3B-Diffusers
model_id = "Wan-AI/Wan2.1-T2V-14B-Diffusers"
vae = AutoencoderKLWan.from_pretrained(model_id, subfolder="vae", torch_dtype=torch.float32)
pipe = WanPipeline.from_pretrained(model_id, vae=vae, torch_dtype=torch.bfloat16)
flow_shift = 5.0 # 5.0 for 720P, 3.0 for 480P
pipe.scheduler = UniPCMultistepScheduler.from_config(pipe.scheduler.config, flow_shift=flow_shift)
pipe.to("cuda")
pipe.load_lora_weights("shauray/PostMalone_WanLora")
pipe.enable_model_cpu_offload() #for low-vram environments
prompt = "malone a man walking through texas"
output = pipe(
prompt=prompt,
height=480,
width=720,
num_frames=81,
guidance_scale=5.0,
).frames[0]
export_to_video(output, "output.mp4", fps=16)
```
## Download model
Weights for this model are available in Safetensors format.
[Download](/shauray/PostMalone_WanLora/tree/main) them in the Files & versions tab.
|