GGUF_K: Flux Unchained K_M Quants

Warning: Although these quants work perfectly with ComfyUI - I couldn't get them to work with Forge UI yet. Let me know if this changes. The original non-k quants can be found HERE which are verified working with Forge UI.

[Note: Unzip the download to get the GGUF. Civit doesn't support it natively, hence this workaround]

GGUF version of FluxUnchained by socalguitarist . Credit goes to him for tuning this model. More specifically these are the K (_M) quants for this model. K quants usually lead to better quality for the same model size. Also, the inference can be slightly faster. The non-K quants can be found here.

It can be used in ComfyUI with this custom node. But I couldn't get these to work with Forge UI.

See https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/1050 to learn more about Forge UI GGUF support and also where to download the VAE, clip_l and t5xxl models.

Which model should I download?

[Current situation: Using the updated Comfy UI (GGUF node) I can run all of these quants on my 11GB 1080ti.]

Download the one that fits in your VRAM. The additional inference cost is quite small if the model fits in the GPU. Size order is Q2 < Q3 < Q4 < Q5 < Q6. However, I wouldn't recommend using Q2 and Q3 unless you absolutely have to, because they tend to mess up text and finer details.

All the license terms associated with Flux.1 Dev apply.