Explore efficient inference techniques for Large Language Models (LLMs) on CPUs and Intel GPUs using Intel Neural Speed in this 30-minute video. Dive into the performance capabilities of Intel Extension for Transformers and gain practical insights through provided Jupyter notebooks. Learn how to optimize LLM inference for data science and machine learning applications, leveraging Intel's hardware-specific solutions. Access accompanying resources, including a Medium article and GitHub repositories, to deepen your understanding and implement the techniques discussed.
LLM Efficient Inference in CPUs and Intel GPUs - Intel Neural Speed
The Machine Learning Engineer via YouTube
Overview
Syllabus
LLM Efficient Inference In CPUs and Intel GPUs. Intel Neural Speed #datascience #machinelearning
Taught by
The Machine Learning Engineer
Related Courses
-
Intel® Solutions Pro – Principles of AI Everywhere
-
Inferencia Eficiente de LLMs en CPUs y GPUs Intel con Neural Speed
-
Finetuning Large Language Models
-
vLLM Inference and LLM Server Engine for Machine Learning
-
LLMOPS: Training a Small LLM (GPT-2) - Machine Learning and Data Science
-
Deploying AI Models Using Intel AMX CPUs on VMware vSphere with Tanzu Kubernetes
