"additional_parameters": "--lr_scheduler_type "CosineAnnealingLR" --lr_scheduler_args "T_max=135" "eta_min=0e-0" --network_args "loraplus_lr_ratio=16"",
"epoch": 30,
"optimizer": "AdamW8bit",
在LoRA+测试中创建的科隆宾LoRA
训练30个epoch后,效果相当不错