Create a Consistent Character Story Just 1 Click in ComfyUI

Details

Model description

hello. In 'ComfyUI How to Create a Consistent Character Story in 1 Click with ComfyUI | Easy Workflow ',

For Workflow Info how to use:  https://www.youtube.com/watch?v=m4veQL0xYpo

This Workflow can create a magic story by generating consistent images and videos. Our work mainly has two parts:

Consistent self-attention for character-consistent image generation over long-range sequences. It is hot-pluggable and compatible with all SD1.5 and SDXL-based image diffusion models. For the current implementation, the user needs to provide at least 3 text prompts for the consistent self-attention module. We recommend at least 5 - 6 text prompts for better layout arrangement.

Motion predictor for long-range video generation, which predicts motion between Condition Images in a compressed image semantic space, achieving larger motion prediction.

Github:  https://github.com/smthemex/ComfyUI_StoryDiffusion?tab=readme-ov-file

Images made by this model

No Images Found.