You must reduce the Lora's strength. In general, I recommend reducing it to 0.50. But 0.50-0.70 is worth experimenting with depending on the checkpoint and prompt being used.
Recommended Settings:
Checkpoint: Natural Sin RC1 VAE
Lora Strength: 0.50-0.70
CFG: 2-5