Transformer Architecture Courses and Certifications

Shaping the Future of AI from the History of Transformer Architectures - Stanford CS25

Explore the evolution of Transformer architectures and AI development with OpenAI researcher Hyung Won Chung, focusing on historical motivations and future projections in the field.

• YouTube
• 37 minutes
• On-Demand
• Free Video

Introduction to LLMs in Python

Learn the nuts and bolts of LLMs and the revolutionary transformer architecture they are based on!

• DataCamp
• 4 hours
• On-Demand
• Free Trial Available

Generative AI Language Modeling with Transformers

35 ratings at Coursera

Learn to apply transformer-based models for NLP tasks, covering encoder-decoder architectures, attention mechanisms, and implementations of BERT and GPT models using PyTorch for text classification and translation.

• Coursera
• 8 hours 51 minutes
• On-Demand
• Free Online Course (Audit)

CodeEmporium

Deep Dive into the Transformer Encoder Architecture

Detailed exploration of transformer encoder architecture, covering embeddings, positional encodings, self-attention mechanisms, and key components for effective natural language processing.

• YouTube
• 21 minutes
• On-Demand
• Free Video

Alfredo Canziani

Self - Cross, Hard - Soft Attention and the Transformer

Explore attention mechanisms and Transformer architecture, covering self/cross and hard/soft attention, key-value stores, and practical implementation in PyTorch for advanced deep learning applications.

• YouTube
• 1 hour 12 minutes
• On-Demand
• Free Video

Alfredo Canziani

Attention and the Transformer

Explore self-attention, key-value stores, and transformer architecture in deep learning. Learn to implement attention mechanisms and understand encoder-decoder paradigms for advanced neural network design.

• YouTube
• 1 hour 18 minutes
• On-Demand
• Free Video

Discover AI

Reversible Transformer - GPU Memory Optimization Using ReFORMER and Reversible Residual Layers

Delve into GPU memory optimization techniques for transformers, exploring reversible residual layers and locality-sensitive hashing to enhance deep neural network efficiency and performance.

• YouTube
• 18 minutes
• On-Demand
• Free Video

AI Bites

Mixture of Transformers for Multi-modal Foundation Models

Explore Meta's Mixture-of-Transformers (MoT) architecture, a revolutionary approach to handling multi-modal AI tasks combining text, speech, images, and videos with enhanced efficiency and performance.

• YouTube
• 16 minutes
• On-Demand
• Free Video

Transformer Models and BERT Model

Explore Transformer architecture and BERT model, learning key components like self-attention and applications in text classification, question answering, and natural language inference.

• Google Cloud Skills Boost
• 30 minutes
• On-Demand
• Free Certificate

Donato Capitella

The Transformer Architecture: Understanding Self-Attention and Positional Encoding

Delve into the revolutionary Transformer architecture, exploring self-attention mechanisms, positional encoding, and key components that revolutionized natural language processing and machine learning.

• YouTube
• 15 minutes
• On-Demand
• Free Video

Transformer Models and BERT Model - 简体中文

本课程向您介绍 Transformer 架构和 Bidirectional Encoder Representations from Transformers (BERT) 模型。您将了解 Transformer 架构的主要组成部分，例如自注意力机制，以及该架构如何用于构建 BERT 模型。您还将了解可以使用 BERT 的不同任务，例如文本分类、问答和自然语言推理。完成本课程估计需要大约 45 分钟。

• Coursera
• 48 minutes
• On-Demand
• Free Online Course (Audit)

Stanford Seminar - Decision Transformer: Reinforcement Learning via Sequence Modeling

Innovative approach to reinforcement learning using sequence modeling and Transformer architecture, offering simplicity and scalability while matching or exceeding state-of-the-art performance in various tasks.

• YouTube
• 1 hour 21 minutes
• On-Demand
• Free Video

Intuitions on Language Models and Shaping AI's Future - Stanford CS25 Lecture

Explore intuitions on language models and the evolution of Transformer architectures with OpenAI researchers. Gain insights into next-word prediction, scaling laws, and the future of AI development.

• YouTube
• 1 hour 17 minutes
• On-Demand
• Free Video

DeepLearning.AI;  Amazon Web Services

Generative AI with Large Language Models

3049 ratings at Coursera

Explore generative AI fundamentals, LLM architecture, and real-world applications. Learn to optimize, fine-tune, and deploy models while addressing challenges and opportunities in this emerging field.

• Coursera
• 16 hours 36 minutes
• On-Demand
• Free Online Course (Audit)

LLM Mastery: ChatGPT, Gemini, Claude, Llama3, OpenAI & APIs

542 ratings at Udemy

Basics to AI-Agents: OpenAI API, Gemini API, Open-source LLMs, GPT-4o, RAG, LangChain Apps, Colab, Prompt Engineering

• Udemy
• 19 hours 53 minutes
• On-Demand
• Paid Course