SDXL dildo

Another SDXL LoRA for more explicit content, this time it is for dildos and sex toys. This was a difficult concept for SD 1.5 to master, so we will see how XL can handle it.

v0.3:
- Better support for anime and cartoon/render/pixar styles.
- More variety of lingerie and clothing, not always with breasts out.
- Works at 0.8-1.0 strength, not as overtrained.
v0.2:
- Epoch 93 and 99 are both pretty good, using 0.7 - 0.8 strength.
v0.1:
- In general, I think epoch 74 has the best results, using about 0.75 strength.

Learned Keywords:

primary:
- dildo for v0.3
- sexl_dildo for v0.1 and v0.2
others:
- dildo: 1410
- 1girl: 1254
- pussy: 1114
- solo: 1099
- realistic: 1015
- sex toy: 864
- object insertion: 837
- nude: 674
- ass: 634
- breasts: 610
- masturbation: 603
- anus: 569
- female masturbation: 563
- nipples: 549
- spread legs: 534
- long hair: 524
- pubic hair: 510
- vaginal: 505
- vaginal object insertion: 488
- female pubic hair: 424
- lips: 360
- lying: 354
- brown hair: 349
- anal: 338
- blonde hair: 317
- black hair: 317
- anal object insertion: 314

Complete list of tag frequencies: https://gist.github.com/onnx-nsfw/4bd77d82a0354853bec14bc667b1ddd1

Example Captions:

dildo, solo, ass, pantyhose, nude, pussy, indoors, from behind, vaginal, fingernails, uncensored, anus, sex toy, anal, close-up, masturbation, female masturbation, object insertion, realistic, dildo, ass focus, anal object insertion, vaginal object insertion, lower body, gaping, large insertion, dildo riding
dildo, solo, ass, pantyhose, pussy, from behind, vaginal, uncensored, anus, sex toy, anal, close-up, masturbation, female masturbation, object insertion, realistic, dildo, ass focus, anal object insertion, vaginal object insertion, lower body, gaping, large insertion, dildo riding
dildo, solo, ass, nude, pussy, from behind, vaginal, fingernails, uncensored, anus, sex toy, anal, close-up, masturbation, female masturbation, object insertion, realistic, dildo, ass focus, anal object insertion, vaginal object insertion, dildo riding
dildo, solo, thighhighs, underwear, panties, ass, from behind, bra, black panties, back, underwear only, lingerie, black bra, close-up, garter belt, head out of frame, ass focus
dildo, solo, thighhighs, underwear, panties, ass, from behind, fishnets, sex toy, anal, garter belt, object insertion, dildo, ass focus, fishnet pantyhose, anal object insertion, fishnet thighhighs

Training Method:

Testing this method: https://civitai.com/articles/1771. Versions 0.1 and 0.2 used the 100 epoch method with 2e-05 learning rate.

v0.3:
- 1458 source images (> 768 in shortest dimension)
- 1588 random crops (1024x1024)
- 1410 remaining after curation
  - up to 12 crops per source
  - downscaled shortest dimension to 1024
  - deduplicated with resnet 18, cosine similarity, 0.925 threshold
  - deleted partial and out of frame
  - no watermarks
- automated captions with WD 1.4, threshold 0.45
  - incorrect tags removed
- 2 repeats
- 8 batch size
- 100 epochs
- 32 dim/32 alpha
- AdamW8bit with constant
- 2e-05 learning rate for both text encoder and UNet
- shuffle captions
- caption dropout rate 0.05
- stop text encoder training after 30% (still not sure if this feature is implemented)
v0.2:
- 344 source images
- 287 after deduplication and resize
- 1087 random crops
- 806 remaining after curation
  - same method as v0.1
- automation captions with WD 1.4, threshold 0.6
  - lightly curated, incorrect tags removed
- 3 repeats
- 8 batch size
- 100 epochs
- 32 dim/32 alpha
- AdamW8bit with constant
- 2e-05 learning rate for both text encoder and UNet
- shuffle captions
v0.1:
- about 500 source images (> 1024x1024)
- about 1000 random crops (1024x1024)
- 440 remaining after curation
  - deduplicated with resnet 18, cosine similarity, 0.9 threshold
  - deleted partial and out of frame
  - no watermarks
- 1 repeats
- 8 batch size
- 100 epochs (models around 45-50 and 70-75 were best)
- 32 dim/32 alpha
- AdamW8bit with constant
- 2e-05 learning rate for both text encoder and UNet

I am happy to share the data set but do not have a good place for hosting those.

v0.3:
- Includes more lingerie and clothing
v0.2:
- Next time I need to indicate the color of the dildo in the caption and include more of the image poses.
v0.1:
- Next time I think I will try removing the sexl_dildo keyword and specializing the existing dildo token.

Training Parameters:

{
  "LoRA_type": "Standard",
  "adaptive_noise_scale": 0,
  "additional_parameters": "",
  "block_alphas": "",
  "block_dims": "",
  "block_lr_zero_threshold": "",
  "bucket_no_upscale": false,
  "bucket_reso_steps": 64,
  "cache_latents": true,
  "cache_latents_to_disk": true,
  "caption_dropout_every_n_epochs": 0.0,
  "caption_dropout_rate": 0.05,
  "caption_extension": ".txt",
  "clip_skip": "1",
  "color_aug": false,
  "conv_alpha": 1,
  "conv_block_alphas": "",
  "conv_block_dims": "",
  "conv_dim": 1,
  "decompose_both": false,
  "dim_from_weights": false,
  "down_lr_weight": "",
  "enable_bucket": false,
  "epoch": 100,
  "factor": -1,
  "flip_aug": true,
  "full_bf16": false,
  "full_fp16": false,
  "gradient_accumulation_steps": "1",
  "gradient_checkpointing": true,
  "keep_tokens": "0",
  "learning_rate": 2e-05,
  "logging_dir": "",
  "lora_network_weights": "",
  "lr_scheduler": "constant",
  "lr_scheduler_args": "",
  "lr_scheduler_num_cycles": "",
  "lr_scheduler_power": "",
  "lr_warmup": 0,
  "max_bucket_reso": 2048,
  "max_data_loader_n_workers": "0",
  "max_resolution": "1024,1024",
  "max_timestep": 1000,
  "max_token_length": "75",
  "max_train_epochs": "100",
  "max_train_steps": "",
  "mem_eff_attn": false,
  "mid_lr_weight": "",
  "min_bucket_reso": 256,
  "min_snr_gamma": 5,
  "min_timestep": 0,
  "mixed_precision": "fp16",
  "model_list": "custom",
  "module_dropout": 0,
  "multires_noise_discount": 0,
  "multires_noise_iterations": 0,
  "network_alpha": 32,
  "network_dim": 32,
  "network_dropout": 0,
  "no_token_padding": false,
  "noise_offset": 0,
  "noise_offset_type": "Original",
  "num_cpu_threads_per_process": 2,
  "optimizer": "AdamW8bit",
  "optimizer_args": "",
  "output_dir": "/mnt/training/results/dildo-v03-std/",
  "output_name": "last",
  "persistent_data_loader_workers": false,
  "pretrained_model_name_or_path": "stabilityai/stable-diffusion-xl-base-1.0",
  "prior_loss_weight": 1.0,
  "random_crop": false,
  "rank_dropout": 0,
  "reg_data_dir": "",
  "resume": "",
  "sample_every_n_epochs": 1,
  "sample_every_n_steps": 0,
  "sample_prompts": "beautiful woman playing with dildo,  detailed, 8k, long hair, breasts, open mouth, multiple girls, ass, nude, pussy, sex toy, anal, object insertion, realistic, dildo, anal object insertion --d 5 --w 1024 --h 1024 --l 9 --s 75",
  "sample_sampler": "euler_a",
  "save_every_n_epochs": 1,
  "save_every_n_steps": 0,
  "save_last_n_steps": 0,
  "save_last_n_steps_state": 0,
  "save_model_as": "safetensors",
  "save_precision": "fp16",
  "save_state": false,
  "scale_v_pred_loss_like_noise_pred": false,
  "scale_weight_norms": 0,
  "sdxl": true,
  "sdxl_cache_text_encoder_outputs": false,
  "sdxl_no_half_vae": true,
  "seed": "",
  "shuffle_caption": true,
  "stop_text_encoder_training_pct": 30,
  "text_encoder_lr": 2e-05,
  "train_batch_size": 8,
  "train_data_dir": "/mnt/training/cropped/dildo-v03",
  "train_on_input": true,
  "training_comment": "",
  "unet_lr": 2e-05,
  "unit": 1,
  "up_lr_weight": "",
  "use_cp": false,
  "use_wandb": false,
  "v2": false,
  "v_parameterization": false,
  "v_pred_like_loss": 0,
  "vae_batch_size": 0,
  "wandb_api_key": "",
  "weighted_captions": false,
  "xformers": "xformers"
}

Model Type	LORA
Base Model	SDXL 1.0
Published	10/6/2023
Trained Words	dildo sex toy vaginal object insertion anal object insertion

Details

Download Files

About this version

Model description

Learned Keywords:

Example Captions:

Training Method:

Training Parameters:

Images made by this model