💪 UniFlex-Workflow ⁘ Flux.1 (.2) · SDXL · Qwen-Image (Edit Plus)

kaptainkorykaptainkory
10
198
flexiblecontrolnetworkflowcannytoolreduxllmupscalerdepthgeminiponykandinskymodularsdxlsd1.5illustriousaioollamacontrolnet unionfluxflux schnellflux 1sd3.5flux toolsflux.1 devchromaqwenbackground removalhidreamkontextomnigen2gemini aiqwen-imageqwen-image editqwen-image edit pluslanpaintunifiedextensibleflux 2flux.2flux.2 devz-imagez-image turbokandinsky 5 lite imagekandinsky 5
9.2 [ 💪 ]9.1 [ ☠️ ]9.0 [ ☠️ ]

Details

Download Files

Model description

Introduction

💪 This is my attempt at a unified flexible and extensible workflow framework in default variants of Flux, SDXL, and Qwen-Image. Additional models also run after minor revisions*:

[* = models confirmed to run at least a default text-to-image or image-to-image workflow; not all functions, such as ControlNets, work for every model]

Many customizable pathways are possible to create particular recipes 🥣 from the available components, without unnecessary obfuscation (e.g., noodle convolution, stacking nodes over others, etc.) and arguably capable of rendering results of similar quality to more complicated specialized workflows.

The workflow was developed and tested on the following system:

  • Operating system: Linux Mint 21.3 Cinnamon with 124 GB RAM

  • Processor: 11th Gen Intel© Core™ i9-11900 @ 2.50GHz × 8

  • Graphics card: NVIDIA GeForce RTX 3060 with 12 GB VRAM

  • Browser: Google Chrome

Please report bugs 🪲 or errors 🚫, as well as successes 🤞 and requests/suggestions 📝. Post and share your SFW creations!!! I spent a lot of time working on this project (((for no 💰))), so I hope others make good use of it and find it helpful.

Components *

Background Removal:

Captioning & Prompt Engineering:

ControlNets & Detailing:

LLMs for Text & Vision:

Upscaling:

XY Plots:

[* = scaled down Core 🦴 editions are also included]

What's New?

  • [v9.1] Added SeedVR2 upscaler.

  • [v9.1] Replaced the save image node with an equivalent node from the (already required) Easy Use package; removed requirement for the Image Metadata Extended package.

  • [v9.0] Reworked the Flexi-Workflow 8.0 by adding in and reconfiguring existing node pathways for newer models (e.g., Qwen-Image Edit Plus, etc.). [v9.0] Reworked the Flexi-Workflow 8.0 by moving many components and functions into subgraphs, greatly reducing the real estate used and simplifying the interface. [v9.0] Reworked the Flexi-Workflow 8.0 by reducing the number of out-dated and/or superseded node groups, largely due to the abilities of newer models (e.g., Flux Kontext and Qwen-Image Edit Plus).

Known Issues

  • [v9.1] On the latest update of ComfyUI (v0.3.65), things seem a bit glitchy—what's new, right?—with intermittent CUDA OOM errors and lockups, particularly when queuing consecutive renders. Running one queue at a time and/or bypassing (or deleting) the global seed node may help mitigate some of the problems.

  • [v9.0] In the Captioners group (31), the Florence2 model is currently out of order. However, forcing transformers<=4.49.0, may allow it to work; noodles will need to be reconnected.

  • [v9.0] In the Background Removal group (33), the Florence2 + SAM2 model combination is currently out of order. However, forcing transformers<=4.49.0, may allow it to work; noodles will need to be reconnected.

  • [v9.0] The InvSR upscaler is not currently working for me.

Quick Start

  1. Install or update ComfyUI to the very latest version. Follow your favorite YouTube installation video, if needed.

  2. Install ComfyUI Manager.

  3. Download the following models or equivalents:

  4. Open one of the UniFlex-Workflows in ComfyUI. You may want to start with a reduced Core 🦴 edition.

  5. Use the Manager to Install Missing Custom Nodes:

    • Fresh installation: It is recommended to install just a few custom node packages at a time until you get through all of them. You may need to set security_level = normal- (notice the dash/minus!) in the config.ini file to download some custom nodes.

    • Updating from a previous workflow version: It is good practice to first backup your Python virtual environment configuration, such as with conda env export > environment.yml. Custom node requirements are likely to have changed significantly, so disable all custom node packages, except for Manager itself. Then, re-enable or install missing custom nodes as required.

    • Tip to avoid downloading unneeded packages: Delete any unconnected nodes and/or accessory groups (e.g., 20's, 30's, or 99 groups) showing as missing if you know you won't need their functions.

  6. Restart ComfyUI.

  7. Follow the Flux, SDXL, or Qwen-Image default recipe 🥣 according to your folder structure and resources.

  8. Run the default text-to-image recipe 🥣.

  9. Enjoy your generated image creations! 😎

  10. BONUS TIP: Drag-and-drop your rendered image back onto the ComfyUI canvas to make any additional workflow revisions. This ensures you will always have a good default workflow as fallback. 🏅

RunPod

Follow the provided guide for Deployment of Flexi-Workflows (or others) on RunPod.

Additional Recommended Installations

Navigation

The workflow is structured for flexibility. With just a few adjustments, it can flip from text-to-image to image-to-image to inpainting or application of Flux Tools 🛠️. Additional unconnected nodes have been included to provide options and ideas for even more adjustments, such as linking in nodes for increasing details. (The workflow does not employ Anything Everywhere, so if a node connection looks empty, it really is empty.)

In the Switchboard, flip the yes|no 🔵 toggles to activate or deactivate groups and the jump arrows ➡️ to quickly move to particular groups for checking and making adjustments to the settings/switches.

🛑 DO NOT RUN THE WORKFLOW WITH ALL SWITCHES FLIPPED TO "YES"! 🛑

There are also bookmarks 🔖 to help you navigate quickly.

In the rgthree settings, it is also recommended to show fast toggles in group headers for muting.

In the Lite Graph section of the settings, enable the fast-zoom shortcut and set the zoom speed to around 1.5–1.75. The workflow was built with a snap to grid size of 20.

Most of the workflow is unpinned 📌, so grab any empty space with your mouse to navigate around. You are welcome to pin 📌 anything you like to prevent accidentally moving groups or nodes.

Recipes

This is the default text-to-image recipe 🥣 and should be run first to make sure you have the basics configured correctly.

☎️ ⁘ Toggle on 01a, 02b, 03 all, 04, and 05
03a ⁘ Latent switch = 1 (empty)
03b ⁘ Conditioning switch = 1 (no ControlNets +)
05 ⁘ Save image switch = 2 (generated image)

Once you have the workflow running, it is recommended to drag-and-drop rendered images back onto the ComfyUI canvas to make any additional workflow adjustments. This ensures you will always have a good default workflow as fallback.

Reference the Start Here group to find additional workflow recipes 🥣.

Images made by this model

No Images Found.