readme upload
Browse files
README.md
ADDED
@@ -0,0 +1,57 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
base_model:
|
3 |
+
- Wan-AI/Wan2.2-T2V-A14B
|
4 |
+
tags:
|
5 |
+
- text-to-video
|
6 |
+
- lora
|
7 |
+
widget:
|
8 |
+
- text: >-
|
9 |
+
"[APPEARANCE] Nfj1nx wears a deep-cut, form-fitting black evening gown with
|
10 |
+
a high slit, allowing ease of movement and a striking silhouette. Her long
|
11 |
+
midnight-blue hair flows over one shoulder in polished waves. [ENVIRONMENT]
|
12 |
+
A dimly lit, smoky salon draped in shadows and flickering amber light.
|
13 |
+
Velvet armchairs, dark wooden décor, and heavy curtains define the
|
14 |
+
atmosphere. Smoke curls through the air, catching beams of light from
|
15 |
+
scattered wall lamps. Faint silhouettes shift in the background, hidden
|
16 |
+
behind haze and shadow. [CUT 1] Action: Nfj1nx stands still in the middle of
|
17 |
+
the salon, her pistol lowered at her side. Camera: Rapid arc shot circling
|
18 |
+
from her front-left to back-right at waist level. [CUT 2] Action: She raises
|
19 |
+
the pistol with a smooth, deliberate motion, arm fully extended and steady.
|
20 |
+
Camera: Fast dolly-in from floor level toward the gun, then tilting up to
|
21 |
+
catch her eyes."
|
22 |
+
output:
|
23 |
+
url: assets/test_00043.mp4
|
24 |
+
---
|
25 |
+
|
26 |
+
# wan 2.2 (14b T2V) HIGH noise LoRA
|
27 |
+
|
28 |
+
This LoRA is very sensitive to the prompt structure. There are certain phrases that I strongly recommend including in your prompt. Like:
|
29 |
+
- "Sequence of quick scene transitions of"
|
30 |
+
- "The sequence of changes includes the transitions"
|
31 |
+
|
32 |
+
You can find prompt examples in the attached videos.
|
33 |
+
|
34 |
+
<Gallery />
|
35 |
+
|
36 |
+
## Inference
|
37 |
+
For inference I used ComfyUI.
|
38 |
+
|
39 |
+
**Trigger words**: Banostasis concept, (and the phrases above)
|
40 |
+
|
41 |
+
**Strength**: 0.8-1.2
|
42 |
+
|
43 |
+
## Trainig details
|
44 |
+
Trained only on videos.
|
45 |
+
|
46 |
+
### HIGH noise LoRA
|
47 |
+
- dataset: 33 videos 480x270 25,33,65,81 frame videos
|
48 |
+
- steps: 15147
|
49 |
+
- LR: 5e-5
|
50 |
+
- optimizer: AdamW Optimi
|
51 |
+
- rank: 32
|
52 |
+
- batch size: 1
|
53 |
+
- gradient accumulation steps: 1
|
54 |
+
- min_t = 0.875
|
55 |
+
- max_t = 1
|
56 |
+
|
57 |
+
For training I used the diffusion-pipe repo.
|