Transformer Models Courses and Certifications

Yannic Kilcher

Longformer - The Long-Document Transformer

Explore Longformer's innovative attention mechanism for processing lengthy documents, combining local windowed and global attention to overcome Transformer limitations in handling long sequences.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Yannic Kilcher

Sparse Expert Models - Switch Transformers, GLAM, and More With the Authors

Explore sparse expert models in AI, discussing their architecture, routing, history, applications, and future potential. Learn about Switch Transformers, GLAM, and advancements in efficient large-scale language models.

• YouTube
• 58 minutes
• On-Demand
• Free Video

Serrano.Academy

Transformer Models: Understanding Their Architecture and Functionality - Part 3

Demystifying Transformer models with visuals and examples, covering key concepts like attention mechanism, tokenization, embeddings, and fine-tuning for various NLP tasks.

• YouTube
• 44 minutes
• On-Demand
• Free Video

Trelis Research

Distillation of Transformer Models - Tutorial and Code Walk-through

Learn advanced techniques for distilling transformer models, including pruning, fine-tuning, and performance evaluation. Gain practical insights through code walkthroughs and real-world examples.

• YouTube
• 1 hour 21 minutes
• On-Demand
• Free Video

Scalable Parallel Computing Lab, SPCL @ ETH Zurich

A Chiplet-Based Generative Inference Architecture with Block Floating Point Datatypes

Explore a chiplet-based architecture for generative inference, featuring block floating point datatypes and optimizations for large language models in AI accelerated computing.

• YouTube
• 1 hour 6 minutes
• On-Demand
• Free Video

Association for Computing Machinery (ACM)

Transformer-based Reasoning for Learning Evolutionary Chain of Events on Temporal Knowledge Graphs

Explore transformer-based reasoning for learning evolutionary event chains on temporal knowledge graphs, enhancing understanding of complex temporal relationships.

• YouTube
• 15 minutes
• On-Demand
• Free Video

Data Science Conference

Revealing the Unseen: Visualizing Attention in Transformer Models

Dive into the visualization techniques of attention mechanisms in Transformer models, understanding their inner workings and practical applications through expert insights.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Toronto Machine Learning Series (TMLS)

Efficient Inference of Extremely Large Transformer Models

Explore techniques for optimizing large transformer models, including compression, efficient attention, and parallelism for faster, smaller, and cost-effective inference.

• YouTube
• 28 minutes
• On-Demand
• Free Video

GAIA

Do Chemformers Dream of Organic Matter? Evaluating Transformer Models for Synthesis Prediction

Explore transformer models for synthesis prediction in drug discovery, including challenges, comparisons, and performance in product and retrosynthesis prediction for pharmaceutical applications.

• YouTube
• 27 minutes
• On-Demand
• Free Video

USC Information Sciences Institute

Do Androids Know They're Only Dreaming of Electric Sheep?

Explore transformer language models' internal representations to detect and analyze hallucinatory behavior in AI-generated content, with insights on task-dependent patterns and evaluation methods.

• YouTube
• 59 minutes
• On-Demand
• Free Video

Stanford Seminar - Transformers in Language: The Development of GPT Models Including GPT-3

Explore the evolution of language models from 3-Gram to GPT-3, examining their capabilities in various tasks and discussing the potential of unsupervised learning in AI development.

• YouTube
• 49 minutes
• On-Demand
• Free Online Course

Sequence Models

30411 ratings at Coursera

Master sequence models for NLP tasks, including RNNs, LSTMs, and transformers. Apply these techniques to speech recognition, language modeling, and machine translation.

• Coursera
• 1 day 13 hours 17 minutes
• On-Demand
• Free Online Course (Audit)

Generative Pre-trained Transformers (GPT)

29 ratings at Coursera

Explore the fundamentals of natural language processing and language modeling, focusing on Transformer-based models like GPT. Gain hands-on experience with Python exercises and discuss ethical implications.

• Coursera
• 12 hours 40 minutes
• On-Demand
• Free Online Course (Audit)

Modern Natural Language Processing in Python

1709 ratings at Udemy

Solve Seq2Seq and Classification NLP tasks with Transformer and CNN using Tensorflow 2 in Google Colab

• Udemy
• 5 hours 48 minutes
• On-Demand
• Paid Course

Machine Reading, Fast and Slow - When Do Models Understand Language?

Explore the challenges and limitations of machine reading comprehension, examining behavioral benchmarks, transformer models, and open problems in AI language understanding.

• YouTube
• 29 minutes
• On-Demand
• Free Video