Video upscale/refine with Wan2.2

Details

Download Files

Model description

It's basically video to video. But instead of denoise we just skipped steps (so its refine).

Of course its using Lightx2v lora - Wan2.2-T2V-A14B-4steps-lora-250928 but any lightx2v lora will work good since the movement issue it not problem here.

You can use 1 or 2 steps, depending how much stuff you want to fix. Final step also affects changes - bigger step from 4, smaller changes (checkout the horses example).

- step 3,4: big changes
- step 5: some changes
- step 9,10 small changes
- step 10: very small changes
etc

Of course with 2 steps KSampler works 2x longer

  • examples: upscaled on left, at top left there's info about steps used

  • examples (2 videos at once) are downscaled because of ram problems with rendering both

  • if there's some stuff normal T2V cant do (like a dick) add some T2V lora

  • prompt is optional, but its nice to add very brief tags what's in the video

  • at the final sharpening stage video is downscaled to make sure upscaler don't upscale blur

  • mine 4090 24gb can upscale video up to 1megapixel 120 frames in ~300 sec

  • workflow is using ⚡ Rife Tensorrt, super highly recommended, it's incredibly fast compared to regular (like 10x) frames interpolation, I'm attaching bat script I've used inside to run tensor file creation (for comfy portable). Place it in ComfyUI-Rife-Tensorrt folder (download rife49_ensemble_True_scale_1_sim.onnx to "ComfyUI-Rife-Tensorrt/models" folder first)

  • monitor memory, if anything leaks into shared vram, close comfy, change resolution to smaller and try again

upscaler link - 2x-NomosUni_span_multijpg - OpenModelDB

Images made by this model

No Images Found.