Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Streaming for LangChain Agents and FastAPI

James Briggs via YouTube

Overview

Limited-Time Offer: Up to 75% Off Coursera Plus!
7000+ certificate courses from Google, Microsoft, IBM, and many more.
This course covers the following learning outcomes and goals: mastering streaming for LangChain Agents and serving it through FastAPI, using OpenAI's GPT-3.5-turbo model via LangChain's ChatOpenAI object, starting from simple terminal streaming with LLMs to parsing stream outputs with Async Iterator streaming. The individual skills taught include developing streaming for LangChain Agents, utilizing FastAPI for serving, and implementing custom callback handlers for both synchronous and asynchronous streaming. The teaching method involves practical demonstrations and hands-on coding exercises. The intended audience for this course is individuals interested in artificial intelligence, LangChain, OpenAI, NLP, and deep learning, who want to deploy streaming solutions in production efficiently.

Syllabus

Streaming for LLMs and Agents
Simple StdOut Streaming in LangChain
Streaming with LangChain Agents
Final Output Streaming
Custom Callback Handlers in LangChain
FastAPI with LangChain Agent Streaming
Confirming we have Agent Streaming
Custom Callback Handlers for Async
Final Things to Consider

Taught by

James Briggs

Reviews

Start your review of Streaming for LangChain Agents and FastAPI

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.