Jack Sparrow - Realistic + Anime - LoRA

Making models can be expensive. Do you like what I do? Consider supporting me on Patreon 🅿️ or feel free to buy me a coffee ☕

Consider leaving a ❤️ to receive future updates.

This is a successful experiment I made for testing out my theory on how to make an anime character from a photorealistic dataset. The answer was simply to use NeverEnding Dream (NED). NED was made basically to bridge the gap between photorealistic models and anime ones, so the theory was to use a dataset made of movie screencaps of Jack Sparrow (about 80), tag them with booru style tags (using a combination of WD Tagger + manual) and train a LoRA on NED.
If you then make the inference on NED it gives a perfectly photorealistic model, but if you use it on AnyLoRA or anime models in general it gives you an anime version of Jack Sparrow with little to no style transfer.

You can probably use this technique to turn any real person into an anime counterpart and vice versa (see: my Ganyu LoRA).

You can use at weight 1 generally, but tune it based on the model. Trigger is jack sparrow.

As most of my LoRA's, this can be customized a lot. In the examples I provided a blonde anime girl Jack Sparrow. Examples 6 and 7 are of course using my One Piece style LoRA. Third image by bloodsplash09.

How to use LoRA's in auto1111:

• Update webui (use git pull like here or redownload it)

• Copy the file to stable-diffusion-webui/models/lora

• Select your LoRA like in this video

• Make sure to change the weight according to the instructions (by default it's :1)