CivitAI ๐Ÿ† Style Fusion - FFusionAI Entry (+dataset)

์„ธ๋ถ€ ์ •๋ณด

ํŒŒ์ผ ๋‹ค์šด๋กœ๋“œ

๋ชจ๋ธ ์„ค๋ช…

CivitAI ์Šคํƒ€์ผ ์œตํ•ฉ๐Ÿ†LoRAs

์ตœ์ข… ์—…๋ฐ์ดํŠธ: ๐Ÿš€ CivitAI Lora5 32DIM ๋ฐ์ดํ„ฐ์…‹ ํฌํ•จ ๋…ธํŠธ๋ถ

์ตœ์ข… ์—…๋ฐ์ดํŠธ: ๐Ÿš€ CivitAI Lora3 ์„ค์ • - CivitAI ํŠธ๋ ˆ์ด๋„ˆ๋กœ ํ•™์Šต๋จ

๐Ÿš€ ๋‚ ์งœ: 2023-11-10 | ์ œ๋ชฉ: CivitAI_64_ALL

๐Ÿ” ์ฃผ์š” ์‚ฌ์–‘:

  • ํ•ด์ƒ๋„: 1024x1024

  • ์•„ํ‚คํ…์ฒ˜: stable-diffusion-xl-v1-base/lora

  • ๋„คํŠธ์›Œํฌ Dim/Rank: 64.0, Alpha: 1.0

  • ๋ชจ๋“ˆ: networks.lora

  • ํ•™์Šต๋ฅ : UNet LR ๋ฐ TE LR์„ ์ตœ์  ์ˆ˜์ค€์œผ๋กœ ์„ค์ •

  • ์ตœ์ ํ™”๊ธฐ: ๊ณ ๊ธ‰ AdamW8bit

  • ์—ํฌํฌ ๋ฐ ํ•™์Šต: 576๊ฐœ์˜ ๋ฐฐ์น˜๋กœ 10์—ํฌํฌ ์ง‘์ค‘ ํ•™์Šต

๐Ÿ“Š ๋ชจ๋ธ ํ†ต๊ณ„:

  • UNet ๊ฐ€์ค‘์น˜: Mag - 7.602, Str - 0.0187
Resolution: 1024x1024 Architecture: stable-diffusion-xl-v1-base/lora
Network Dim/Rank: 64.0 Alpha: 1.0
Module: networks.lora
Learning Rate (LR): 0.0005 UNet LR: 0.0005 TE LR: 5e-05
Optimizer: bitsandbytes.optim.adamw.AdamW8bit(weight_decay=0.1)
Scheduler: constant  Warmup steps: 0
Epoch: 10 Batches per epoch: 576 Gradient accumulation steps: 1
Train images: 2304 Regularization images: 0
Multires noise iterations: 6.0 Multires noise discount: 0.3
Min SNR gamma: 5.0 Zero terminal SNR: True Max grad norm: 1.0  Clip skip: 1
Dataset dirs: 1
        [img] 576 images
UNet weight average magnitude: 7.602270778898858
UNet weight average strength: 0.018722912685324843
Text Encoder (1) weight average magnitude: 2.7649271326702607
Text Encoder (1) weight average strength: 0.009535635958680934
Text Encoder (2) weight average magnitude: 2.6905091182810352
Text Encoder (2) weight average strength: 0.007233532415344915

์ƒˆ๋กญ๊ฒŒ ์ถœ์‹œ๋œ LoRA ๋ชจ๋ธ์„ ํ†ตํ•ด FFusionAI์˜ AI ๊ธฐ๋ฐ˜ ์Šคํƒ€์ผ ํ•ฉ์„ฑ ์ ‘๊ทผ ๋ฐฉ์‹์„ ํƒ์ƒ‰ํ•ด ๋ณด์„ธ์š”. ๊ฐ ๋ชจ๋ธ์€ CivitAI ๊ณต์‹ ํŠธ๋ ˆ์ด๋„ˆ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๊ฐœ๋ฐœ๋˜์–ด ์ •๋ฐ€์„ฑ๊ณผ ํ’ˆ์งˆ์„ ๋ณด์žฅํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ› ๏ธ LoRA ๋ชจ๋ธ ๊ฐœ์š”:

  • LoRA 1 - ๋ผ์ดํŠธ ๋ฒ„์ „: ๋น ๋ฅธ ํ…Œ์ŠคํŠธ์šฉ์œผ๋กœ ์„ค๊ณ„๋˜์—ˆ์œผ๋ฉฐ, ์†Œ๊ทœ๋ชจ ๋ฐ์ดํ„ฐ์…‹์„ ์‚ฌ์šฉํ•ด ๋น ๋ฅด๊ฒŒ ์Šคํƒ€์ผ์„ ์ƒ์„ฑํ•˜๋ฉฐ, 32์ฐจ์› ์šฉ๋Ÿ‰์„ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค.

  • LoRA 2 - ์ปค๋ฎค๋‹ˆํ‹ฐ ์œตํ•ฉ: CivitAI ์ฝ˜ํ…Œ์ŠคํŠธ์— ์—ฌ๋Ÿฌ ์‚ฌ์šฉ์ž๊ฐ€ ์ œ์ถœํ•œ 500๊ฐœ ์ด์ƒ์˜ ์ด๋ฏธ์ง€๋กœ ๊ฐœ๋ฐœ๋œ ๊ฐ•๋ ฅํ•œ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค. ์ด ๋ฒ„์ „๋„ 32์ฐจ์› ์šฉ๋Ÿ‰์„ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค.

  • LoRA 3 - ํ–ฅ์ƒ๋œ ์ •๋ฐ€๋„: LoRA 2๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ๋” ๋†’์€ ์ฐจ์›์œผ๋กœ ์ถ”๊ฐ€ ํ•™์Šต๋˜์–ด ์ „์ฒด ์ด๋ฏธ์ง€ ํ’ˆ์งˆ์„ ๊ฐœ์„ ํ•˜๋Š” ๋ฐ ์ค‘์ ์„ ๋‘ก๋‹ˆ๋‹ค.

  • LoRA 4 - ํฌ๊ด„์  ์Šคํƒ€์ผ ๊ฒฐํ•ฉ: 1400๊ฐœ์˜ ์ด๋ฏธ์ง€๋กœ ๊ตฌ์„ฑ๋œ ๋ฐฉ๋Œ€ํ•œ ๋ฐ์ดํ„ฐ์…‹์€ FFusionAI ์ œ์ถœ์ž‘์˜ ๋ชจ๋“  ์Šคํƒ€์ผ์„ ์ง‘์•ฝํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ด ๋ชจ๋ธ์€ ์ƒ์„ฑ ์Šคํƒ€์ผ์„ ์ •๊ตํ™”ํ•˜๊ณ  ๋‹ค์–‘ํ™”ํ•˜๊ธฐ ์œ„ํ•ด ์ถ”๊ฐ€ UNet ํ•™์Šต์„ ๊ฑฐ์ณค์Šต๋‹ˆ๋‹ค.

1. FFusionAI ์Šคํƒ€์ผ ์บก์ฒ˜ ๋ฐ ์œตํ•ฉ ๋Œ€๊ฒฐ LoRA

๐ŸŽจ ๋ฐ์ดํ„ฐ์…‹ ๋ฐ ํ•™์Šต:

ํŒจํ‚ค์ง€์—๋Š” CivitAI ์ปฌ๋ ‰์…˜์—์„œ ์ ‘๊ทผํ•  ์ˆ˜ ์žˆ๋Š” ์„ ๋ณ„๋œ ์ปฌ๋ ‰์…˜์ด ํฌํ•จ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค. ํ•™์Šต ํ”„๋กฌํ”„ํŠธ๋Š” BLIP-2, FLAN-T5-XL ๋ฐ ViT-H-14๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์ƒ์„ฑ๋˜์—ˆ์Šต๋‹ˆ๋‹ค.

์›๋ž˜ ํ”„๋กฌํ”„ํŠธ๋Š” ํ•™์Šต์— ์‚ฌ์šฉ๋˜์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค. ๋Œ€์‹  blip2-flan-t5-xl ๋ฐ ViT-H-14/laion2b_s32b_b79k๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์˜๋„์ ์œผ๋กœ ์ˆ˜์ •ํ•˜์—ฌ ํ•™์Šต ๋ฐ์ดํ„ฐ์…‹์„ ์กฐ์ •ํ•˜๊ณ  ํ–ฅ์ƒ์‹œ์ผฐ์œผ๋ฉฐ, ์ด ๋‚ด์šฉ์€ ์—ฌ๊ธฐ์—์„œ ํ™•์ธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

๐Ÿ”„ ์ถ”๊ฐ€ ์ •๋ณด:

์ž์„ธํ•œ ํ•™์Šต ๋ฐ์ดํ„ฐ์…‹, ํŒŒ๋ผ๋ฏธํ„ฐ ๋ฐ ๋ชจ๋ธ ์‚ฌ์–‘์„ ํ™•์ธํ•˜๋ ค๋ฉด ์ „๋ฌธ๊ฐ€ ๋ฐ ์• ํ˜ธ๊ฐ€๋ถ„๋“ค์€ ์ปฌ๋ ‰์…˜ ๋‚ด์— ์ œ๊ณต๋œ ๋ฉ”ํƒ€๋ฐ์ดํ„ฐ๋ฅผ ํƒ์ƒ‰ํ•ด ์ฃผ์„ธ์š”.

  • LORA 2

    ๐Ÿš€ CivitAI ์„ค์ • ๊ฐœ์š” - 2023-11-10

๐Ÿš€ ๊ณต์‹ CivitAI ํŠธ๋ ˆ์ด๋„ˆ๋กœ ํ•™์Šต๋จ

๐Ÿ“… ๋‚ ์งœ: 2023-11-10

๐Ÿ–ผ๏ธ ์ œ๋ชฉ: CivitAI_ALL

๐Ÿ” ํ•ด์ƒ๋„: 1024x1024

๐Ÿ—๏ธ ์•„ํ‚คํ…์ฒ˜: stable-diffusion-xl-v1-base/lora

โš™๏ธ ์ฃผ์š” ์„ค์ •:

  • ๋„คํŠธ์›Œํฌ Dim/Rank: 32.0

  • Alpha: 1.0

  • ๋ชจ๋“ˆ: networks.lora

  • ํ•™์Šต๋ฅ : UNet LR - 0.0005, TE LR - 5e-05

  • ์ตœ์ ํ™”๊ธฐ: AdamW8bit (weight_decay=0.1)

  • ์—ํฌํฌ ๋ฐ ๋ฐฐ์น˜: 10์—ํฌํฌ, 167๋ฐฐ์น˜/์—ํฌํฌ

  • ํ•™์Šต ์ด๋ฏธ์ง€: 576

๐Ÿ“Š ๋ชจ๋ธ ํ†ต๊ณ„:

  • UNet ๊ฐ€์ค‘์น˜: Mag - 3.755, Str - 0.0135

  • Text Encoder (1): Mag - 1.833, Str - 0.0091

  • Text Encoder (2): Mag - 1.836, Str - 0.0071

๐Ÿท๏ธ ์ฃผ์š” ํƒœ๊ทธ:

  • ์œตํ•ฉ ์Šคํƒ€์ผ, Artgerm, Beeple

  • ๋‹คํฌ ํŒํƒ€์ง€, ๊ณต์‹ ์•„ํŠธ์›Œํฌ, ํ•€์—… ์•„ํŠธ

  • ๋””์ง€ํ„ธ ์ผ๋Ÿฌ์ŠคํŠธ๋ ˆ์ด์…˜, ํŒํƒ€์ง€ ๋ฐ SF

  • ...๊ทธ๋ฆฌ๊ณ  4500๊ฐœ ์ด์ƒ์˜ ์ถ”๊ฐ€ ํƒœ๊ทธ!

๐ŸŒ FFusion.ai ์—ฐ๋ฝ์ฒ˜ ์ •๋ณด

Source Code Bulgaria Ltd ๋ฐ Black Swan Technologies์—์„œ ์ž๋ž‘์Šค๋Ÿฝ๊ฒŒ ์šด์˜ํ•ฉ๋‹ˆ๋‹ค.

  • ๐Ÿ“ง ํ˜‘์—…, ๋ฌธ์˜ ๋˜๋Š” ์ง€์›: [email protected]

  • ๐ŸŒ ์œ„์น˜: ์†Œํ”ผ์•„ | ์ด์Šคํƒ„๋ถˆ | ๋Ÿฐ๋˜

์šฐ๋ฆฌ์™€ ์—ฐ๊ฒฐํ•˜์„ธ์š”:

์šฐ๋ฆฌ์˜ ์›น์‚ฌ์ดํŠธ:

์ด ๋ชจ๋ธ๋กœ ๋งŒ๋“  ์ด๋ฏธ์ง€

์ด๋ฏธ์ง€๋ฅผ ์ฐพ์„ ์ˆ˜ ์—†์Šต๋‹ˆ๋‹ค.