alice from A Misanthrope Teaches a Class for Demi-Humans
詳細
ファイルをダウンロード (1)
モデル説明
the 1st character make me learn more about lora training.1st time i use AdamW8it and thought it was just another easy boring training,but i found that it doesnt even match to training image.so i try a few more times and using diferent settings or images,but the results were same.2 days ago, i found a important video on bilibili:
【全网最细的秋叶训练器参数讲解，查漏补缺，LoRA训练，调度器函数，优化器，AdamW8bit,lion,DA,D-Adaptation，prodigy神童优化器】 https://www.bilibili.com/video/BV1a3iYY3ETn/?share_source=copy_web&vd_source=62b7af7b4367facd37340c57ca6b1e27
it explains meaning of every settings,and then the biggest transform of my lora training was using Prodigy as my optimizer.it improves my lora quality hugely.from then on, all my loras r using Prodigy until i find a better optimizer
AdamW8bit:
