Terms
Stable Diffusion Term Meaning CFG Classifier Free Guidance VAE Variational AutoEncoder
Prompt techniques
Tested in Automatic1111 (and most in ComfyUI). Reference: https://www.youtube.com/watch?v=MgLpmksylOc&t=482s Syntax Example Behaviour [a|b] [cat|dog] Alternatively will use cat and dog for every step [a|a|a|b] [cat|cat|cat|dog] Will use cat for every step, except each fourth step, which will be dog [from:to:when] [cat:dog:10][cat:dog:.6] Will use cat for the first 10 steps and then switch to dogWill use
Stable Diffusion samplers
Name Effective max steps Remarks Euler 30 Euler adaptive 100 Heun 30 LMS 50 PLMS 60 DDIM 60 DPM adaptive 10 I don’t use it DPM fast 150 DPM 2 40 DPM 2 adaptive 100 DPM 2 adaptive Karras 100 DPM 2 Karras 30 I don’t use it
Alternatives
Chat: Prompters: Bots:
Stable Diffusion: Textual Inversion embeddings
References I have written this article as a personal summary of following detailed videos on the subject: Settings In stable-diffusion-webui go to: Settings -> Training and preferably enable following (RAM allowing): If your video card does not have enough VRAM, you could try and disable following setting (note that this will decrease training success rate):
Stable Diffusion: VAE
VAE stands for Variational AutoEncoder. Images are generated in a “compressed” way, with may result in artifacts. Models may come with a integrated VAE, but can also benefit from a custom one. You can install VAE files under models/VAE by downloading the applicable file there. Two VAE’s can be found on https://huggingface.co/stabilityai/sd-vae-ft-mse-original/tree/main, of which I