Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

How to Do Stable Diffusion LORA Training by Using Web UI on Different Models

Software Engineering Courses - SE Courses via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!

This course is focused on teaching the LoRA methodology for training Stable Diffusion, a deep learning model for generating images from text prompts. The course starts with an introduction speech and covers the installation of the LoRA extension to the Stable Diffusion Web UI.

The course then moves on to preparation of the training set images by properly sized cropping, which is done using Paint .NET, an open-source image editing software. It also explains what Low-Rank Adaptation LoRA is and how to start the preparation for training using the DreamBooth tab - LoRA.

The next section covers the explanation of all training parameters, settings, and options, including how many training steps equal one epoch, save checkpoints frequency, and how to set the path for training images. The course also covers the Classification Dataset Directory, training prompt, Class and Sample Image Prompt in SD training, and Image Generation settings.

Once the setup is complete, the course explains how to start the training process, how and why to tune your Class Prompt generating generic training images, and why we generate regularization generic images by class prompt. It also covers how much GPU, CPU, and RAM the class regularization image generation uses, and how to resume training after training has crashed or you close it down.

The course covers lifetime vs. session training steps, how to pick a checkpoint to generate a full model .ckpt file, and how to generate a full model .ckpt file from a LoRA checkpoint .pt file. It also explains how to do inference and generate new images using the text2img tab with our newly trained and generated model.

The course then moves on to setting up the training parameters/options for SD version 1.5 and re-generating class regularization images since SD 1.5 uses 512 pixel resolution. The training of Stable Diffusion 1.5 using the LoRA methodology and teaching a face has been completed and the results are displayed. The inference text2img results with SD 1.5 training are also covered.

Finally, the course covers how to give more attention/emphasis to certain keywords in the SD Web UI, how to generate more than 100 images, how to check PNG info to see used prompts and settings, how to upscale using AI models, fixing face image quality, especially eyes, with GFPGAN visibility, and how to batch post-process. The course also explains where batch-generated images are saved.

Overall, this course provides a comprehensive introduction to LoRA methodology for training Stable Diffusion and covers everything from setup to inference and post-processing.

Syllabus

Introduction speech
How to install the LoRA extension to the Stable Diffusion Web UI
Preparation of training set images by properly sized cropping
How to crop images using Paint .NET, an open-source image editing software
What is Low-Rank Adaptation LoRA
Starting preparation for training using the DreamBooth tab - LoRA
Explanation of all training parameters, settings, and options
How many training steps equal one epoch
Save checkpoints frequency
Save a preview of training images after certain steps or epochs
What is batch size in training settings
Where to set LoRA training in SD Web UI
Explanation of Concepts tab in training section of SD Web UI
How to set the path for training images
Classification Dataset Directory
Training prompt - how to set what to teach the model
What is Class and Sample Image Prompt in SD training
What is Image Generation settings and why we need classification image generation in SD training
Starting the training process
How and why to tune your Class Prompt generating generic training images
Why we generate regularization generic images by class prompt
Recap of the setting up process for training parameters, options, and settings
How much GPU, CPU, and RAM the class regularization image generation uses
Training process starts after class image generation completed
Displaying the generated class regularization images folder for SD 2.1
The speed of the training process - how many seconds per iteration on an RTX 3060 GPU
Where LoRA training checkpoints weights are saved
Where training preview images are saved and our first training preview image
When we will decide to stop training
How to resume training after training has crashed or you close it down
Lifetime vs. session training steps
After 30 epochs, resembling images start to appear in the preview folder
The command line printed messages are incorrect in some cases
Training step speed, a certain number of seconds per iteration IT
How I'm picking a checkpoint to generate a full model .ckpt file
How to generate a full model .ckpt file from a LoRA checkpoint .pt file
Generated/saved file name is incorrect, but it is generated from the correct selected .pt file
Doing inference generating new images using the text2img tab with our newly trained and generated model
The results of SD 2.1 Version 768 pixel model after training with the LoRA method and teaching a human face
Setting up the training parameters/options for SD version 1.5 this time
Re-generating class regularization images since SD 1.5 uses 512 pixel resolution
Displaying the generated class regularization images folder for SD 1.5
Training of Stable Diffusion 1.5 using the LoRA methodology and teaching a face has been completed and the results are displayed
The inference text2img results with SD 1.5 training
You have to do more inference with LoRA since it has less precision than DreamBooth
How to give more attention/emphasis to certain keywords in the SD Web UI
How to generate more than 100 images
How to check PNG info to see used prompts and settings
How to upscale using AI models
Fixing face image quality, especially eyes, with GFPGAN visibility
How to batch post-process
Where batch-generated images are saved

Taught by

Software Engineering Courses - SE Courses

Reviews

Start your review of How to Do Stable Diffusion LORA Training by Using Web UI on Different Models

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.