Tik Tok Dance - Real to Anime + Background Style Transfer

This workflow is a vid-2-vid workflow, which implements differential diffusion for a lower denoise on the character to maintain consistency and IPAdapter for style transfer onto the background.

Ideas from here: https://www.reddit.com/r/StableDiffusion/comments/1fjwseh/differential_diffusion_denoising_technique_for/

Models

1. Flat2DAnimerge: /model/35960/flat-2d-animerge

2. AnimateLCM: https://huggingface.co/wangfuyun/AnimateLCM LoRA in models/loras/animatediff and checkpoint in models/animatediff_models

3. ip-adapter-plus_sd15.safetensors. Install with manager

Custom Nodes

Install using manager

1. ComfyUI_IPAdapter_plus

2. AnimateDiff Evolved

3. ComfyUI-VideoHelperSuite

4. ComfyUI Essentials

5. KJNodes for ComfyUI

6. ComfyUI-Inspyrenet-Rembg