Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Video to Anime - Generate an Epic Animation from Your Phone Recording by Using Stable Diffusion AI

Software Engineering Courses - SE Courses via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Learn how to transform a real video into an epic animation using Stable Diffusion AI in this comprehensive 36-minute tutorial. Explore the process of preparing video footage with Davinci Resolve, extracting frames using FFmpeg, and leveraging Automatic1111 Web UI for AI-powered conversion. Master techniques such as DreamBooth training, ControlNet implementation, and multi-frame rendering to achieve consistent and high-quality results. Discover methods for upscaling, improving facial features, and reducing flickering in your animated output. Gain insights into alternative approaches and freely available tools to enhance your video-to-anime conversion skills.

Syllabus

How to turn a video into an animation in a fully automated manner for free
Introduction to Davinci Resolve free edition
Introduction to FFmpeg
Short tutorial video for Davinci Resolve
How to prepare your real video footage
How to change timeline resolution in Davinci Resolve
Imported video image scaling Davinci Resolve - mismatched resolution files
Edit tab and video importing in Davinci Resolve
Where to see properties of your video in Davinci Resolve
How to crop a video into square or any aspect ratio with Davinci Resolve
Negative side of using distant position
How to export / render your video in Davinci Resolve with best settings
How to export all frames of a video by using FFmpeg
Parameters of extracting all frames of a video by using FFmpeg
File names importance for batch processing scripts
How to install and use Automatic1111 Web UI
Which training dataset I made to train myself from video exported frames
Why and how I used RunPod IO for training
Why I trained myself and a style into SD 1.5 for video to animation
How to train yourself and a style tutorial
How to do 2 concept training in Stable Diffusion 1.5 DreamBooth
What DreamBooth settings I have used to train myself and style into SD 1.5 in this tutorial
Master tutorial for DreamBooth
What is ControlNet, how to install and use it
Settings change of ControlNet to use in video to anime process
Multi-frame video rendering for Stable Diffusion script for video to animation with consistency
How install external scripts to Automatic1111 Web UI
How to change commit version of git repos, ex. Automatic1111 web UI
When you are ready to start processing real video frames into anime
You don't have to do pre-training to follow this tutorial
First step of video to animation
Importance of first generated frame
How to generate your first converted driving frame
What kind of initial frame to image conversation you should aim
What is the difference if we don't train ourselves and just use a custom model
Next step after you got first converted frame of your anime video
The settings used in img2img tab for batch frame processing
Multi-frame Video rendering for StableDiffusion settings
How to upscale all video to animation generated frames
How to fix naming of the batch generated images for upscaling
How to do batch upscaling by AI in Automatic1111 Web UI
How to improve faces, eyes, when doing upscaling by AI
How to animate generated frame images
How to import images as an image sequence into Davinci Resolve for animating
Clip attributes fixing
First time playing our animated video
How to improve flickering problem with a very simple trick
How to move clip frame by frame in Davinci Resolve
Which composite mode to reduce flickering problem in Davinci Resolve
How to apply deflickering in Davinci Resolve
How animation made in this video could have been improved significantly
Which other technique I have tested - img2img alternative test
img2img alternative test video to animation results
Searched for freely available deflickering tools - models - libraries
All-In-One-Deflicker
My videos have fully corrected subtitles

Taught by

Software Engineering Courses - SE Courses

Reviews

Start your review of Video to Anime - Generate an Epic Animation from Your Phone Recording by Using Stable Diffusion AI

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.