Wan 2.2 Lightning LoRAs

Details

Model description

Extreme speed-up of Wan 2.2 T2V and I2V with just 4 steps

https://huggingface.co/lightx2v/Wan2.2-Lightning/tree/main/

Update: 25/10/23

  • Added new release 1022 of Lighx2V LoRAs

  • Quality seems improved

  • Possible no ghosting anymore

  • Compatible to other LoRAs

Update: 25/10/15

  • MoE-Distill is the latest speed-up LoRA

  • Patched version from KJ (HIGH)

  • Restores some motions compared to other speed-up's

  • Quality seems high

Needs more testing. Some situations are still slow motion.

Use: Euler+simple, Sigma-Shift 5, CFG 1

⚠️ Attention

  • Some configurations seems to blur/ghost

  • It seems incompatible with some LoRAs (e.g. NSFW)

  • It seems incompatible some checkpoints

Update: 25/08/21

  • More Sampler+Scheduler info

  • ATM: The LoRAs cause a bit slowdown compared to native sampling without

Update: 25/08/08

  • The I2V Lora-Upload seem to be broken, re-uploaded it again

  • Changed some Usage descriptions

  • Mentioned scheduler/sampler combo

Update: 25/08/07

  • Added I2V LoRAs

Update: 25/08/05

  • Added more Infos and LoRAs fix1

Usage

SwarmUI

  1. CFG: 1

  2. Steps: 4

  • For T2V Use with this at the end of your prompt: <base> <lora:Wan2.2-Lightning_T2V-A14B-4steps-lora_HIGH_fp16> <refiner> <lora:Wan2.2-Lightning_T2V-A14B-4steps-lora_LOW_fp16> (adapt the lora filenames to whatever specific filenames you have locally)

  • For I2V, use <video> <lora:...i2v-high> <videoswap> <lora:...i2v-low> and of course use the i2v loras

  • the I2V Lightning LoRA appears to target 16 fps

General:

  • 1 strength on both

  • 2+2 steps (total 4)

  • switch at 2 (50%)

  • Sigma Shift: 5

  • Sampler + Scheduler combinations:

    • Euler + Beta

    • LCM + LTX

    • Euler + Simple

  • You need to be very descriptive, short prompts leading to much more random things.

  • work best at 81x480x832, 81x832x480, 81x720x1280, 81x1280x720

usage tip first loras (outdated):

  • 0.125 strength on both

  • 4 steps

  • switch at 2

Did not figured out optimal settings for comfyui or swarmui ... still testing. Let me know! :)

Generation times <3 minutes


YOU are responsible for outputs as always! If you make ToS violating content and I get aware I WILL report this.

Images made by this model

No Images Found.