Remade commited on
Commit
f0e61f5
·
verified ·
1 Parent(s): 65b79ae

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +121 -0
README.md ADDED
@@ -0,0 +1,121 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ base_model:
6
+ - Wan-AI/Wan2.1-T2V-14B
7
+ pipeline_tag: text-to-video
8
+ tags:
9
+ - text-to-video
10
+ - text-to-image
11
+ - lora
12
+ - diffusers
13
+ - template:diffusion-lora
14
+ widget:
15
+ - text: >-
16
+ p1x4r_5ty13 Pixar animation style A small brown puppy with floppy ears sits on a grassy hill, tilting its head curiously at a floating dandelion seed drifting past. Its big, round eyes shine in the soft golden light of the setting sun. The background features rolling hills and a wooden fence.
17
+ output:
18
+ url: example_videos/pixar1.mp4
19
+ - text: >-
20
+ p1x4r_5ty13 Pixar animation style A robot is standing on a platform in space, looking at planet Earth. The planet is blue and green, with fluffy white clouds.
21
+ output:
22
+ url: example_videos/pixar2.mp4
23
+ - text: >-
24
+ p1x4r_5ty13 Pixar animation style A large, muscular, humanoid figure stands in front of a large wall of flowing lava. The figure is silhouetted against the bright orange and yellow glow of the lava. On each side of the lava wall, two tall, dark figures stand in a similar stance to the figure in the middle. The wall of lava is made of swirling, orange and yellow fluid that moves in a similar way to water.
25
+ output:
26
+ url: example_videos/pixar3.mp4
27
+ - text: >-
28
+ p1x4r_5ty13 Pixar animation style A young boy wearing a spacesuit stands on a small moon, staring in wonder at the massive planet hanging in the sky above. His helmet reflects the twinkling stars around him. Nearby, his tiny rover beeps softly as it scans a glowing rock.
29
+ output:
30
+ url: example_videos/pixar4.mp4
31
+ ---
32
+
33
+ <div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
34
+ <h1 style="color: #24292e; margin-top: 0;">Pixar Animation Style LoRA for Wan2.1 14B T2V</h1>
35
+
36
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
37
+ <h2 style="color: #24292e; margin-top: 0;">Overview</h2>
38
+ <p>This LoRA is trained on the Wan2.1 14B T2V model and allows you to generate videos in Pixar animation style!</p>
39
+ </div>
40
+
41
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
42
+ <h2 style="color: #24292e; margin-top: 0;">Features</h2>
43
+ <ul style="margin-bottom: 0;">
44
+ <li>Trained on the Wan2.1 14B T2V base model</li>
45
+ <li>Consistent results across different object types</li>
46
+ <li>Simple prompt structure that's easy to adapt</li>
47
+ </ul>
48
+ </div>
49
+
50
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
51
+ <h2 style="color: #24292e; margin-top: 0;">Community</h2>
52
+ <ul style="margin-bottom: 0;">
53
+ <li><b>Discord:</b> <a href="https://discord.com/invite/7tsKMCbNFC" style="color: #0366d6; text-decoration: none;">Join our community</a> to generate videos with this LoRA for free</li>
54
+ <li><b>Request LoRAs:</b> We're training and open-sourcing Wan2.1 LoRAs for free - join our Discord to make requests!</li>
55
+ </ul>
56
+ </div>
57
+ </div>
58
+
59
+ <Gallery />
60
+
61
+ # Model File and Inference Workflow
62
+
63
+ ## 📥 Download Links:
64
+
65
+ - [pixar_10_epochs.safetensors](./pixar_10_epochs.safetensors) - LoRA Model File
66
+ - [wan_txt2vid_lora_workflow.json](./workflow/wan_txt2vid_lora_workflow.json) - Wan T2V with LoRA Workflow for ComfyUI
67
+
68
+ ---
69
+ <div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
70
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
71
+ <h2 style="color: #24292e; margin-top: 0;">Recommended Settings</h2>
72
+ <ul style="margin-bottom: 0;">
73
+ <li><b>LoRA Strength:</b> 1.0</li>
74
+ <li><b>Embedded Guidance Scale:</b> 6.0</li>
75
+ <li><b>Flow Shift:</b> 5.0</li>
76
+ </ul>
77
+ </div>
78
+
79
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
80
+ <h2 style="color: #24292e; margin-top: 0;">Trigger Words</h2>
81
+ <p>The key trigger phrase is: <code style="background-color: #f0f0f0; padding: 3px 6px; border-radius: 4px;">[z00m_ca11]</code></p>
82
+ </div>
83
+
84
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
85
+ <h2 style="color: #24292e; margin-top: 0;">Prompt Template</h2>
86
+ <p>For prompting, check out the example prompts; this way of prompting seems to work very well.</p>
87
+
88
+
89
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
90
+ <h2 style="color: #24292e; margin-top: 0;">ComfyUI Workflow</h2>
91
+ <p>This LoRA works with a modified version of <a href="https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/example_workflows/wanvideo_T2V_example_02.json" style="color: #0366d6; text-decoration: none;">Kijai's Wan Video Wrapper workflow</a>. The main modification is adding a Wan LoRA node connected to the base model.</p>
92
+ <img src="./workflow/workflow_screenshot.png" style="width: 100%; border-radius: 8px; margin: 15px 0; box-shadow: 0 4px 8px rgba(0,0,0,0.1);">
93
+ <p>See the Downloads section above for the modified workflow.</p>
94
+ </div>
95
+ </div>
96
+
97
+ <div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
98
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
99
+ <h2 style="color: #24292e; margin-top: 0;">Model Information</h2>
100
+ <p>The model weights are available in Safetensors format. See the Downloads section above.</p>
101
+ </div>
102
+
103
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
104
+ <h2 style="color: #24292e; margin-top: 0;">Training Details</h2>
105
+ <ul style="margin-bottom: 0;">
106
+ <li><b>Base Model:</b> Wan2.1 14B T2V</li>
107
+ <li><b>Training Data:</b> Trained on 4 minutes of video comprised of 47 short clips (each clip captioned separately) of various videos in Pixar animation style.</li>
108
+ <li><b> Epochs:</b> 10</li>
109
+ </ul>
110
+ </div>
111
+
112
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
113
+ <h2 style="color: #24292e; margin-top: 0;">Additional Information</h2>
114
+ <p>Training was done using <a href="https://github.com/tdrussell/diffusion-pipe" style="color: #0366d6; text-decoration: none;">Diffusion Pipe for Training</a></p>
115
+ </div>
116
+
117
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
118
+ <h2 style="color: #24292e; margin-top: 0;">Acknowledgments</h2>
119
+ <p style="margin-bottom: 0;">Special thanks to Kijai for the ComfyUI Wan Video Wrapper and tdrussell for the training scripts!</p>
120
+ </div>
121
+ </div>