s2v lite lora adds 1st frame flashing

#2
by darksidewalker - opened

The s2v lite lora adds 1st frame flashing, any way to prevent this?

Owner

not the lora's problem; if you don't use lora, run 20 steps, it happens still

Oh okay. I asume it was the lora, because running the gguf q8 without it does not flash that way. Do you know the problem?

Owner

tested with q4

with lora (8-step)
with_lora.webp

without lora (20-step)
without_lora.webp

I see, so must be a limitation of the model, but why are the samples from Wan-team not flashing that way... :-/

Owner

seems random but it happens with high probability

with_lora_no_flashing.webp

with_lora_no_flashing_too.webp

longer video clips less chance; see can tune the parameters to control it or not

I was experimenting with sigma 5-8 and frame count from 81-129 and resolutions between 480p and 720p even trimmed the sound files to match the video length, but it almost happen every time.
I was thinking to trim the first frames, but that cuts some audio...

Sign up or log in to comment