No matter what I did, I couldnโt get Astralite Heartโs pony-diffusion-v1 model to generate a pony completely covered in mud. Phrases like โcovered in mudโ or โmuddyโ &c would only generate mud around where the ponyโs body contacted the mud puddle, even though his model must have seen pictures of ponies totally drenched in mud. So I eventually broke out textual inversion: I show ~10 pictures to the AI and ask it, โWhatโs the common theme in these pictures that you know about, even if you donโt have a human readable name for it?โ โItโs [6ab8].โ โCool. Generate a picture of [6ab8] Fluttershyโฆโ
Asking the AI what it thought this concept was (and then naming it โamuddy1โ for future reference) resulted in the above pic. Best generation out of 10, then went through img2img maybe five times to clean up the eyes, which were way lopsided in the first generation.
@Background Pony #50DB
I tried 1, 2, and 4. This image was made with an embedding of a single vector, while 2 and 4 destroyed the ability to make faces.
I tried 1, 2, and 4. This image was made with an embedding of a single vector, while 2 and 4 destroyed the ability to make faces.
How do I download the model?
See the first link in Background Pony #B396โs comment below.
That would explain why they tend to clean off so well in the show, too.
thanks
The model is https://huggingface.co/AstraliteHeart/pony-diffusion and the program I used for inference was https://github.com/AUTOMATIC1111/stable-diffusion-webui. I uploaded the 4 kilobyte concept embedding file where I interrogated the AI what it thought muddy was here: https://mega.nz/file/BaonyBBT#YSuiWthxETX_5i3tFmjfkTvgGpWomqxJOcDmVhgdcco . Put it in your embedding/ directory and you should be able to directly use the word โamuddy1โ to refer to this concept. (Note that embedding file will only work with the pony-diffusion model. Waifu Diffusion or one of the furry models โknowโ different things so youโd have to repeat the process of showing them pictures to find what they call the conceptโฆor maybe they understand โcovered in mudโ in the first place!)