CogVideoX-Fun Simplified (NO SUPPORT PROVIDED)

NO SUPPORT WILL BE PROVIDED. THERE ARE NOTES IN THE WORKFLOW THAT EXPLAIN EVERYTHING. SEE INSTALLATION INSTRUCTIONS BELOW:

This workflow uses:

CogVideoX-Fun 2B/5B - Uses text and an input image to create a video.

Florence2 - To create a caption. You can provide your own caption, use Florence2 for the caption, or combine your caption with Florence2 caption.

DepthFlow - Create an end image for your video. You can provide your own end image or have DepthFlow create the end image for you.

YOU WILL NEED TO RUN: git checkout origin/1.0_legacy to get the legacy version of the CogVideoXWrapper.

Installation Instructions

Download and install ComfyUI. https://github.com/comfyanonymous/ComfyUI
Download and install ComfyUI manager. https://github.com/ltdrdata/ComfyUI-Manager
Run the ComfyUI server from your terminal/command prompt.
Open ComfyUI in your browser.
Download this workflow.
Drag and drop the JSON file that was download into your browser window.
You will get an error message saying that some nodes are missing.
Open the ComfyUI manager.
Click on Install Missing Custom Nodes.
Wait for the installation to finish.
Open ComfyUI\custom_nodes\ComfyUI-Manager\config.ini and update: bypass_ssl = True
Open ComfyUI\custom_nodes\ComfyUI-CogVideoXWrapper in your terminal/command prompt.
Run: git checkout origin/1.0_legacy
A popup will show that you need to restart the ComfyUI server. Restart it with the button.
When the server has restarted, refresh the page.
Delete the workflow.
Drag and drop the JSON file that was download into your browser window.
Run the workflow by pressing Queue.
You will get a popup error saying that the T5 clip is missing. Download it by following the instructions in the Note node next to the Load Clip node.
The CogVideoX-Fun model will be downloaded automatically.
READ THE NOTES FOR EACH CORRESPONDING NODE FOR HELP.
Add an Input image.
Update the prompt.
Run the workflow by pressing Queue.
Wait for the video to be generated. This should take around 100-400 seconds depending on your GPU.

On a 4090, it takes 100 seconds to generate a video.