TheDirector

Details

Download Files

Model description

🎬 THE DIRECTOR – AI Image, Script & Video Generation Tool for Creators
v2.0 – April 16, 2025
Built for influencers, storytellers, educators, and visual content pros.

Turn ideas into cinematic short scenes β€” with images, scripts, voiceovers, and sound effects β€” all in one seamless AI pipeline.

πŸŽ₯ Walkthrough video: https://youtu.be/L7SYD_pbraA


🌟 What’s New in v2.0

  • βœ… MMAAudio Support – auto-generates matching sound/music for each scene

  • πŸš€ Faster Rendering – scenes now complete in under 4 minutes on Ultra Pro

  • 🧠 Start from Text or Image – describe your character or provide a visual

  • 🎞️ Improved Scene Generation – better detail, consistency, and flow

  • πŸ› οΈ Modified Interface – cleaner, more intuitive node layout

  • 🧩 Seamless integration with ComfyUI

πŸ”Š Complete 3-scene video with audio in under 17 minutes


πŸ“˜ Version History

v1.0 – March 27, 2025
β€’ Initial Release – basic scene generation and rendering engine


🧭 STEP-BY-STEP WORKFLOW GUIDE


πŸ”Ή Step 1 – Get a Gemini API Key
β€’ Go to: https://aistudio.google.com/apikey
β€’ Log in with your Google account
β€’ Click "Create API Key"
β€’ Copy it into the purple GEMINI API KEY node in ComfyUI


πŸ”Ή Step 2 – Choose a Reference Image
β€’ Upload a visual reference OR
β€’ Set Use Reference Image = False to start from a text description
β€’ (Optional) Enter a project name for easy folder organization


πŸ”Ή Step 3 – Enter a Story Prompt
β€’ Be as detailed or brief as you like
β€’ If you skipped the reference image, describe your character clearly


πŸ”Ή Step 4 – Select Mode + Audio
β€’ Choose: Portrait or Landscape
β€’ Toggle MMAudio ON if you want auto-generated sound


πŸ”Ή Step 5 – Click QUEUE
β€’ Generation begins β€” each step takes ~32 seconds
β€’ Increasing the number of steps improves quality (but takes longer)


πŸ”Ή Step 6 – Select Your Scenes
β€’ You’ll see image batches (4 at a time)
β€’ Pick your favorites and drag them into order (1–24)
β€’ Hit Cancel + Retry if the results aren’t what you want


πŸ”Ή Step 7 – Generate Video & Stitching
β€’ Images are rendered into scenes
β€’ Selected scenes are stitched into a full video (with audio, if enabled)


πŸ”Ή Step 8 – Retrieve Your Final Video
β€’ Check the output folder
β€’ Look for the .mp4 file (with "audio" in the name if you chose MMAudio)


πŸ’‘ Pro Tips:
β€’ For best results: allow ~4.5 mins per scene on Ultra Pro
β€’ Want higher detail? Increase steps from 8 β†’ 16
β€’ Imperfect outputs? Cancel & re-run! AI isn't flawless β€” but it is fast


πŸ‘₯ Creators & Credits

AJO6268 aka KurtCPhotoEd
Clark Glenn Davis aka Verevolf
SoundTech: manu_le_surikhate_gamer


🧰 INSTALLATION GUIDE – GETTING STARTED WITH THE DIRECTOR


βœ… Requirements

  • Latest ComfyUI (Portable or Custom Build)

  • AjoNodes

  • MMAudio

  • Wan2.1 Native model

  • A Google account to access Gemini API


πŸ”§ Step-by-Step Installation

1. Install AjoNodes

AjoNodes contains all the custom logic that powers The Director’s workflow.

πŸ“¦ GitHub: https://github.com/AJO-reading/ComfyUI-AjoNodes

πŸ› οΈ To install:

bash

CopyEdit

cd ComfyUI/custom_nodes git clone https://github.com/AJO-reading/ComfyUI-AjoNodes

Restart ComfyUI after installation.


2. Download & Install Wan2.1 Native Model

This is the core model used for visual generation.

🌐 Wan2.1 ComfyUI Workflow - Complete Guide | ComfyUI Wiki


3. Install MMAudio (Sound Effects & Music)

Adds voice/music/sfx to your generated scenes.

πŸ“¦ GitHub: kijai/ComfyUI-MMAudio

Make sure to download the models and put them in ComfyUI/models/mmaudio


4. (Optional) Install Additional Models or LoRAs

Depending on the theme, you may want character-specific LoRAs or style models. Place those in:

  • models/loras/

  • models/embeddings/ (if using textual inversion)


5. Load the Director Workflow (.json)

β€’ Open ComfyUI
β€’ Load the provided TheDirectorV2.json workflow
β€’ Paste your Gemini API Key in the designated node
β€’ You’re ready to go!


πŸŽ‰ That’s it β€” you’re ready to start generating movies like it’s Hollywood, minus the budget.

Images made by this model

No Images Found.