Image to Video (using AD/HV)

This workflow creates a video from still images.

How to use

(1) Prepare the original still image and load it to "Load Image" in the "Input" group.

(2) Modify the text in the following parts to match the image you want to create.

Auto-generates the prompt from the loaded image, but enter additional text to make it more similar to your image.

If you are not sure, you can leave everything blank.

(2-1) "Prompt(additionaal:common)" in the "Input" group;

This is the entire prompt.

You will provide a detailed explanation of the main object and a brief explanation of the background.

For the main object, it is effective to enter keywords or actions that are not detected by automatic analysis.

Example: Walking

Regarding the background, do not write in details, but write roughly.

　　　Example: on the beach

If you want a simple finished background, specify something like "white background".

(2-2) "Prompt (Only Step 1)" in the "Input" group;

Write the prompt for initial video creation (STEP 1).

The initial video uses AnimationDiff, making it difficult to maintain detailed backgrounds.

Here, please be intentionally vague so that the background is rough.

Example: Light blue background

(2-3) "Negative Prompt (Only Step 1)" in the "Input" group;

Write a negative prompt.

This prompt is only used during base video creation (STEP 1).

(2-4) “Prompt (Only Step2)” in the “Input” group;

Write the prompt for the detailed video (STEP2).

　　Describe the contents you want to emphasize from the contents created in Step 1 and the specific contents that were not described in (2-1).

(2-5) "Question" in "Analyze image";

　　Enter appropriate questions regarding still image analysis.

(2-6) "Exclude tags" in "Analyze image";

If there are any tags that are automatically analyzed from still images that you do not want to reflect, please write them down.

(3) Specify the parameters of the video to be created.

(3-1) "Target video size (larger size of W or H)" in the "Input" group;

Describe the size of the video to be generated.

The aspect ratio of the generated video is determined based on the image loaded in (1).

The size described here is recognized as the larger of the vertical and horizontal dimensions.

Note: The vertical and horizontal sizes will be adjusted and generated to be a multiple of 16.

The size of the generated video is displayed in "Width" and "Height" in "Step2".

(3-2) "Frame step" in the "Input" group

Specify the number of frames to generate.

(3-3) “Frame rate” in the “Input” group

Specify the number of frames per second.

Note: The duration of the generated video is

(3-4) "NoiseSeed" in the "Input" group

Set the initial value of noise.

(4) LoRA in Step 2

LoRA can only be applied to Step2 (HunYuanVideo).

Please set the LoRA you want to apply to "LoRA Stack JK (Only Step2)" in the "Step2" group.

P.S:

I am running it in the following environment.

Operation has not been confirmed in any other environment.

　CPU: Intel Core i7-13700KF (not tuned)　Mem:64GB

GPU: NVIDIA GeForce RTX 4080Super MEM:16GB

　OS: Windows11pro 24H2