Overview
Syllabus
Intro
Required resources
LyCORIS overview
LoCon training settings
redjuice LoCon Epoch vs. Weight grid analysis 32 dims
redjuice LoCon Epoch vs. Weight grid analysis 40 dims
Vanilla LoRA
Explaining how I finalized my hyperparameters
LoHa training settings
redjuice LoHa grid analysis Conv. Dim = 4, Conv. Alpha = 2
redjuice LoHa grid analysis Conv. Dim = 4, Conv. Alpha = 1
swd3e2 style dataset overview
BooruDatasetTagManager
swd3e2 LoCon grid analysis 40 dims
swd3e2 LoHa grid analysis Conv. Dim = 4, Conv. Alpha = 1
Adjusting LoHa hyperparameters Part 1
swd3e2 LoHa grid analysis, Conv. Dim = 4, Conv. Alpha = 2, Adam8Wbit, fixed initial learning rate
Adjusting LoHa hyperparameters Part 2
swd3e2 LoHa grid analysis, Conv. Dim = 14, Conv. Alpha = 14, DAdaptation
Closing thoughts
Taught by
kasukanra