Transformer Models Courses and Certifications

How I Learned to Stop Worrying and Love the Transformer - Stanford CS25 Lecture

Explore the Transformer's evolution and future directions with Ashish Vaswani, co-author of "Attention is All You Need". Gain insights into motivations, developments, and promising research areas in AI and NLP.

• YouTube
• 1 hour 21 minutes
• On-Demand
• Free Video

NLP's and Transformer Models

101 ratings at Pluralsight

Transformers have revolutionized NLP since their inception in 2017. They can understand language at a deeper level as well as parallelize training on GPUs. In this course, you will learn how to create Transformers for NLP.

• Pluralsight
• 2 hours 36 minutes
• On-Demand
• Free Trial Available

Explore finetuning techniques for transformer models, including GPU optimization and Hugging Face integration, to enhance deep learning capabilities and model performance.

• Codecademy
• 2 hours
• On-Demand
• Free Trial Available

Practical Application of LLMs

53 ratings at Pluralsight

This is a beginner-level introduction to large-language models (LLMs). This course will teach you the fundamentals of this powerful technology along with hands-on examples using the OpenAI API.

• Pluralsight
• 58 minutes
• On-Demand
• Free Trial Available

Introduction to Large Language Models for Data Practitioners

12 ratings at Pluralsight

As a data practitioner, you're on the leading edge of AI; a field moving almost faster than we can keep up. This course will give you a critical understanding of large language models, their history, how they work, and how they can be leveraged.

• Pluralsight
• 40 minutes
• On-Demand
• Free Trial Available

Open Data Science

Riding the Tailwind of NLP Explosion

Explore NLP's evolution, from prehistoric to modern era, and learn practical applications, challenges, and strategies for leveraging transformers and open-source tools in data science projects.

• YouTube
• 40 minutes
• On-Demand
• Free Video

Open Data Science

ODSC East 2022 Keynote by Luis Vargas, Ph.D. - The Big Wave of AI at Scale

Explore the trend of larger AI models, their growing capabilities, and impact on language, vision, and multi-modality. Learn about research, engineering efforts, and implications for companies.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Yannic Kilcher

Linformer - Self-Attention with Linear Complexity

Detailed explanation of the Linformer model, which reduces self-attention complexity in transformers from O(n²) to O(n), improving efficiency while maintaining performance in NLP tasks.

• YouTube
• 50 minutes
• On-Demand
• Free Video

Yannic Kilcher

Nyströmformer- A Nyström-Based Algorithm for Approximating Self-Attention

Explore Nyströmformer, a novel algorithm for approximating self-attention in Transformers with linear complexity, enabling processing of longer sequences and improving scalability in natural language tasks.

• YouTube
• 48 minutes
• On-Demand
• Free Video

Yannic Kilcher

Feedback Transformers - Addressing Some Limitations of Transformers with Feedback Memory

Explores Feedback Transformers, an architecture that improves on standard Transformers by allowing higher-level representations to inform lower-level processing, enhancing performance on complex reasoning and long-range dependency tasks.

• YouTube
• 44 minutes
• On-Demand
• Free Video

Simons Institute

Knowledge Is Embedded in Language Neural Networks but Can They Reason?

Explore language models' reasoning capabilities, from n-grams to transformers, and discuss future research directions in neural state machines for improved natural language understanding.

• YouTube
• 50 minutes
• On-Demand
• Free Video

Yannic Kilcher

Scaling Transformer to 1M Tokens and Beyond with RMT - Paper Explained

Explore the Recurrent Memory Transformer technique for scaling transformers to process 1 million tokens, examining its strengths, weaknesses, and potential impact on long-term dependency handling in NLP tasks.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Databricks

Conversational AI with Transformer Models - Building Blocks and Optimization Techniques

Explore building conversational AI agents using transformer models, covering advantages over RNN/LSTM, knowledge distillation, and model compression techniques for efficient production deployment.

• YouTube
• 36 minutes
• On-Demand
• Free Video

James Briggs

How to Build Custom Q&A Transformer Models in Python

Learn to fine-tune pre-trained transformer models for question-answering using HuggingFace and PyTorch. Gain practical skills in NLP and unlock the power of transformers for custom Q&A applications.

• YouTube
• 1 hour 10 minutes
• On-Demand
• Free Video

Yannic Kilcher

Reformer - The Efficient Transformer

Discover how Reformer revolutionizes Transformer models, reducing memory usage and enabling processing of longer sequences through innovative techniques like Locality Sensitive Hashing and Reversible Networks.

• YouTube
• 29 minutes
• On-Demand
• Free Video