ControlNet is required to use it well.
Or Inpainting the face of the generated image without LoRA works well😉