Transformers Courses and Certifications

CodeEmporium

Transformers - From Zero to Hero

Comprehensive deep dive into transformer architecture, covering key concepts from self-attention to tokenization. Includes hands-on coding for both encoder and decoder implementations.

• YouTube
• 3 hours 35 minutes
• On-Demand
• Free Video

Alfredo Canziani

Differentiable Associative Memories, Attention, and Transformers

Explore differentiable associative memories, attention mechanisms, and transformers. Learn about energy minimization, planning, and various transformer applications in machine learning and AI.

• YouTube
• 2 hours
• On-Demand
• Free Video

Alfredo Canziani

Deep Learning for Natural Language Processing

Explore NLP architectures, transformers, language models, and advanced techniques for text generation and embedding learning in this comprehensive deep learning lecture.

• YouTube
• 1 hour 41 minutes
• On-Demand
• Free Video

saVRee

Transformer Parts and Functions

Comprehensive overview of transformer components and functions, including core, windings, bushings, tank, relays, and cooling systems. Explains key parts and their roles in power engineering.

• YouTube
• 28 minutes
• On-Demand
• Free Video

James Briggs

NER Powered Semantic Search in Python

Learn to implement NER-powered semantic search in Python using Transformers, Sentence Transformers, and Pinecone. Explore dataset preparation, entity creation, embedding generation, and querying techniques for efficient information retrieval.

• YouTube
• 18 minutes
• On-Demand
• Free Video

James Briggs

Building MLM Training Input Pipeline - Transformers From Scratch

Learn to create a complex input pipeline for Masked Language Modeling, transforming raw OSCAR data into a DataLoader ready for training transformer models from scratch.

• YouTube
• 23 minutes
• On-Demand
• Free Video

James Briggs

Sentiment Analysis on Any Length of Text With Transformers - Python

Learn to perform sentiment analysis on long texts using transformers in Python, overcoming token limitations through chunking and processing techniques for NLP tasks.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Envato Tuts+

Transformers: Introduction and Fundamentals - Day 1

Explore the fundamentals of Transformers, a powerful deep learning architecture revolutionizing natural language processing and beyond.

• YouTube
• 44 minutes
• On-Demand
• Free Video

CodeEmporium

Informer Architecture Explained - Complete Guide

Comprehensive exploration of Informer encoder architecture, detailing its components and implementation for advanced time series forecasting and sequence modeling tasks.

• YouTube
• 38 minutes
• On-Demand
• Free Video

CodeEmporium

Informer Encoder Architecture Explained

Explore the Informer Encoder architecture, its key components, and implementation details for advanced time series forecasting and sequence modeling tasks.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Center for Language & Speech Processing(CLSP), JHU

Toward Length Extrapolatable Transformers

Explore innovative techniques for enhancing transformer models' ability to handle longer sequences, improving their performance and scalability in natural language processing tasks.

• YouTube
• 1 hour 5 minutes
• On-Demand
• Free Video

Center for Language & Speech Processing(CLSP), JHU

Streaming Sequence Transduction through Dynamic Compression

Explore efficient sequence-to-sequence transduction with STAR, a novel Transformer-based model for streaming ASR and simultaneous speech-to-text tasks.

• YouTube
• 46 minutes
• On-Demand
• Free Video

Center for Language & Speech Processing(CLSP), JHU

Do Pretrained Transformers Learn In-Context by Gradient Descent?

Explore the relationship between In-Context Learning and Gradient Descent in large language models, examining theoretical connections and empirical evidence from pre-trained transformers.

• YouTube
• 15 minutes
• On-Demand
• Free Video

Center for Language & Speech Processing(CLSP), JHU

The NLP Task Effectiveness of Long-Range Transformers

Explore the effectiveness of long-range Transformer variants on NLP tasks, comparing their performance and analyzing attention behaviors to uncover strengths and limitations.

• YouTube
• 12 minutes
• On-Demand
• Free Video

Valerio Velardo - The Sound of AI

Transformers Explained - Part 1: Generative Music AI

Comprehensive exploration of transformer architectures in AI, covering intuition, theory, and mathematical formalization, with focus on their application in music and audio processing.

• YouTube
• 1 hour 13 minutes
• On-Demand
• Free Video