Transformer Architecture Courses and Certifications

Shaping the Future of AI from the History of Transformer Architectures - Stanford CS25

Explore the evolution of Transformer architectures and AI development with OpenAI researcher Hyung Won Chung, focusing on historical motivations and future projections in the field.

• YouTube
• 37 minutes
• On-Demand
• Free Video

Introduction to LLMs in Python

Learn the nuts and bolts of LLMs and the revolutionary transformer architecture they are based on!

• DataCamp
• 4 hours
• On-Demand
• Free Trial Available

Generative AI Language Modeling with Transformers

18 ratings at Coursera

Learn to apply transformer-based models for NLP tasks, covering encoder-decoder architectures, attention mechanisms, and implementations of BERT and GPT models using PyTorch for text classification and translation.

• Coursera
• 8 hours 48 minutes
• On-Demand
• Free Online Course (Audit)

Discover AI

Reversible Transformer - GPU Memory Optimization Using ReFORMER and Reversible Residual Layers

Delve into GPU memory optimization techniques for transformers, exploring reversible residual layers and locality-sensitive hashing to enhance deep neural network efficiency and performance.

• YouTube
• 18 minutes
• On-Demand
• Free Video

AI Bites

Mixture of Transformers for Multi-modal Foundation Models

Explore Meta's Mixture-of-Transformers (MoT) architecture, a revolutionary approach to handling multi-modal AI tasks combining text, speech, images, and videos with enhanced efficiency and performance.

• YouTube
• 16 minutes
• On-Demand
• Free Video

CodeEmporium

Deep Dive into the Transformer Encoder Architecture

Detailed exploration of transformer encoder architecture, covering embeddings, positional encodings, self-attention mechanisms, and key components for effective natural language processing.

• YouTube
• 21 minutes
• On-Demand
• Free Video

Alfredo Canziani

Self - Cross, Hard - Soft Attention and the Transformer

Explore attention mechanisms and Transformer architecture, covering self/cross and hard/soft attention, key-value stores, and practical implementation in PyTorch for advanced deep learning applications.

• YouTube
• 1 hour 12 minutes
• On-Demand
• Free Video

Alfredo Canziani

Attention and the Transformer

Explore self-attention, key-value stores, and transformer architecture in deep learning. Learn to implement attention mechanisms and understand encoder-decoder paradigms for advanced neural network design.

• YouTube
• 1 hour 18 minutes
• On-Demand
• Free Video

Transformer Models and BERT Model

Explore Transformer architecture and BERT model, learning key components like self-attention and applications in text classification, question answering, and natural language inference.

• Google Cloud Skills Boost
• 30 minutes
• On-Demand
• Free Certificate

Transformer Models and BERT Model - 简体中文

本课程向您介绍 Transformer 架构和 Bidirectional Encoder Representations from Transformers (BERT) 模型。您将了解 Transformer 架构的主要组成部分，例如自注意力机制，以及该架构如何用于构建 BERT 模型。您还将了解可以使用 BERT 的不同任务，例如文本分类、问答和自然语言推理。完成本课程估计需要大约 45 分钟。

• Coursera
• 48 minutes
• On-Demand
• Free Online Course (Audit)

Intuitions on Language Models and Shaping AI's Future - Stanford CS25 Lecture

Explore intuitions on language models and the evolution of Transformer architectures with OpenAI researchers. Gain insights into next-word prediction, scaling laws, and the future of AI development.

• YouTube
• 1 hour 17 minutes
• On-Demand
• Free Video

Stanford Seminar - Decision Transformer: Reinforcement Learning via Sequence Modeling

Innovative approach to reinforcement learning using sequence modeling and Transformer architecture, offering simplicity and scalability while matching or exceeding state-of-the-art performance in various tasks.

• YouTube
• 1 hour 21 minutes
• On-Demand
• Free Video

DeepLearning.AI;  Amazon Web Services

Generative AI with Large Language Models

2957 ratings at Coursera

Explore generative AI fundamentals, LLM architecture, and real-world applications. Learn to optimize, fine-tune, and deploy models while addressing challenges and opportunities in this emerging field.

• Coursera
• 16 hours 36 minutes
• On-Demand
• Free Online Course (Audit)

Transformer Models and BERT Model

76 ratings at Coursera

Explore Transformer architecture and BERT model, learning key components like self-attention and applications in text classification, question answering, and natural language inference.

• Coursera
• 51 minutes
• On-Demand
• Free Online Course (Audit)

Large Language Models (LLMs) Concepts

73 ratings at DataCamp

Discover the full potential of LLMs with our conceptual course covering LLM applications, training methodologies, ethical considerations, and latest research.

• DataCamp
• 2 hours
• On-Demand
• Free Trial Available