Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Accelerating AI Inference Workloads with Google Cloud TPUs and GPUs

Google Cloud Tech via YouTube

Overview

Explore key considerations for accelerating AI inference workloads in this 14-minute video featuring a discussion between Debi Cabrera and Alex Spiridonov, Group Product Manager at Google Cloud. Learn about balancing cost and efficiency when choosing between cloud tensor processing units (TPUs) and NVIDIA-powered graphics processing unit (GPU) VMs for deploying AI models at scale. Discover the differences between TPUs and GPUs for various AI models, and gain insights on getting started with Google Cloud's offerings. Address common challenges in inference optimization and explore available resources for AI inference workloads. The video covers topics such as cost implications, deployment strategies, and optimization techniques for inference pipelines on Google Cloud.

Syllabus

- Meet Alex
- Balancing cost and efficiency
- TPU vs GPU for AI models
- Getting started with Google Cloud TPUs and GPUs
- Common challenges when using inference optimization
- Available resources for AI inference workloads
- Wrap up

Taught by

Google Cloud Tech

Reviews

Start your review of Accelerating AI Inference Workloads with Google Cloud TPUs and GPUs

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.