Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Codecademy

Intro to AI Transformers

via Codecademy

Overview

Learn about what transformers are (the T of GPT) and how to work with them using Hugging Face libraries
Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face's transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.


* Understand how transformers work

* Use Hugging Face’s Transformers package

* Create pipelines for NLP tasks

* Select the right model for a task

Syllabus

  • Transformers: the "T" in GPT: Learn about transformers, the "T" in GPT.
    • Lesson: Transformers: The 'T' in GPT
    • Quiz: Introduction to Transformers Quiz
  • Exploring Transformers with Hugging Face: Apply transformers to text generation and sentiment analysis using Hugging Face's libraries.
    • Lesson: Exploring Transformers with Hugging Face
    • Quiz: Exploring Transformers Quiz
    • Article: Carbon Footprints of Transformer Models
    • Project: Exploring Transformers and their Carbon Footprint
    • Informational: Next Steps

Taught by

Kenny Lin

Reviews

4.3 rating at Codecademy based on 20 ratings

Start your review of Intro to AI Transformers

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.