Uncensored Mistral 3 3B (Ernie) FP8-FP32

Uncensored Mistral (Ernie)

• Custom Mistral 3 3B model for use in Comfy UI with Ernie

• A FP8 variant is available that is far faster for cards that support it. (Ampere will autocast to BF16) cards older then Ampere may autocast to FP16 or offload to CPU and cast to FP32

If you see CPU offloading use FP32. Or see below. The reason being is comfy UI will first cast to FP16, then the CPU calculates in FP32, then back to FP16

If you know for a fact your GPU can fit both models and do the calculations you can use one or both of these commands to fix COMFY UI's BS

--bf16-text-enc

--highvram

---

NOTE: Comfy uses a custom version. Diffusers default can be found here.