FlashAttention VS Test

FelldudeFelldude
2
50
工具attentionflash attention
Test Tool12.9_CUDA_FlashAtten
model-image-0
model-image-1

详情

下载文件 (1)

模型描述

FlashAttention VS Test

  • Test and Graphs attentions based on your system.

  • TO DO ADD Sage Attention

  • Comfy UI Users I recommend: 

cmd /k python main.py --fp32-text-enc --fp32-vae --bf16-unet --use-flash-attention

Note: The compiled version of flash attention also included is for Cuda 12.9

(Tested Working with COMFY UI)

此模型生成的图像