Transformers Courses and Certifications

Stanford Seminar - Transformers United: Neuroscience-Inspired Artificial Intelligence

Explore neuroscience-inspired AI with insights on attention mechanisms and sparse distributed memory, bridging the gap between transformers and brain function in this Stanford seminar.

• YouTube
• 1 hour 22 minutes
• On-Demand
• Free Video

Stanford Seminar 2022 - Self Attention and Non-Parametric Transformers

Explore self-attention and Non-Parametric Transformers with PhD students discussing Transformer origins, intuitions, and recent advancements in neural network architecture.

• YouTube
• 1 hour 6 minutes
• On-Demand
• Free Video

Stanford Seminar 2022 - Transformers in Vision: Tackling Problems in Computer Vision

Explore how transformers revolutionize computer vision with Lucas Beyer, covering innovative applications and advancements in representation learning for visual AI tasks.

• YouTube
• 1 hour 9 minutes
• On-Demand
• Free Video

Transformers that Transform Well Enough to Support Near-Shallow Architectures - Stanford CS25 Lecture

Explore precision language models for efficient training and hardware-based control systems. Learn about non-random parameter initializations and applications in resource-limited environments.

• YouTube
• 1 hour 20 minutes
• On-Demand
• Free Video

Overview of Transformers - Stanford CS25: Lecture 1

Comprehensive introduction to NLP, Transformers, and AI agents, covering history, functionality, recent breakthroughs, applications, and challenges in the field of artificial intelligence.

• YouTube
• 1 hour 17 minutes
• On-Demand
• Free Video

Open Source LLMOps Solutions

Gain hands-on experience deploying open-source LLMs, from understanding fundamentals to fine-tuning models and building AI applications using a code-first approach.

• Coursera
• 1 day 11 hours 54 minutes
• On-Demand
• Free Online Course (Audit)

LLMs Mastery: Complete Guide to Transformers & Generative AI

5488 ratings at Udemy

Generative AI, LLMs, ChatGPT, GPT4, Llama3, Decoders, T5, BERT, LoRA, FSDP, 4bit, Machine Learning, Data Science

• Udemy
• 7 hours 30 minutes
• On-Demand
• Paid Course

Explore transformers, the core of GPT models, and apply them to text generation and sentiment analysis using Hugging Face libraries. Learn about their history and environmental impact.

• Codecademy
• 2 hours
• On-Demand
• Free Trial Available

Yannic Kilcher

Hopfield Networks Is All You Need - Paper Explained

Explores the connection between Hopfield networks and transformer attention, analyzing BERT through this lens and applying Hopfield attention to immune repertoire classification.

• YouTube
• 1 hour 5 minutes
• On-Demand
• Free Video

Yannic Kilcher

Big Bird- Transformers for Longer Sequences

Explanation of BigBird's sparse attention mechanism for transformers, enabling longer sequence processing. Covers theoretical foundations, architecture details, and experimental results in NLP and genomics applications.

• YouTube
• 35 minutes
• On-Demand
• Free Video

Yannic Kilcher

Infinite Memory Transformer - Research Paper Explained

Explores innovative Transformer model with unbounded memory, enabling processing of arbitrarily long sequences. Discusses continuous attention mechanisms, sticky memories, and potential applications in language modeling.

• YouTube
• 37 minutes
• On-Demand
• Free Video

tinyML

Delta Keyword Transformer: Bringing Transformers to the Edge Through Dynamically Pruned Multi-Head Self-Attention

Explore cutting-edge techniques for optimizing Transformers in edge computing, focusing on the Delta Keyword Transformer and its dynamic pruning approach for efficient multi-head self-attention.

• YouTube
• 21 minutes
• On-Demand
• Free Video

Simons Institute

Sparks of Artificial General Intelligence

Exploring GPT-4's advanced capabilities and the potential for smaller models to exhibit AGI-like properties through high-quality data and efficient training methods.

• YouTube
• 1 hour 11 minutes
• On-Demand
• Free Video

1littlecoder

Hugging Face Agents - Full Tutorial

Explore Hugging Face's new Transformers Agents API for natural language-driven multimodal tasks, including image generation and text-to-speech, with extensible tools and practical examples.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Simons Institute

Pretraining Task Diversity and the Emergence of Non-Bayesian In-Context Learning for Regression

Explores how task diversity in pretraining affects transformers' in-context learning abilities for regression, revealing a threshold beyond which models can solve novel tasks and outperform Bayesian estimators.

• YouTube
• 1 hour 6 minutes
• On-Demand
• Free Video