Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Private, Local AI: Running Open-Source LLMs Locally

MLOps World: Machine Learning in Production via YouTube

Overview

Explore the world of private AI in this 37-minute conference talk from MLOps World: Machine Learning in Production. Dive into Sanctum AI, a private AI application that enables running full-featured, open-source Large Language Models (LLMs) locally on Mac or PC. Learn how users can access any open-source LLM available on Hugging Face in an encrypted, local environment. Discover the benefits of private AI for users looking to fine-tune models on sensitive data, such as uploading and chatting with PDFs or financial models. Gain insights into the development of Sanctum and the importance of making leading open-source language models easily accessible in a secure, local setting.

Syllabus

Private, Local AI

Taught by

MLOps World: Machine Learning in Production

Reviews

Start your review of Private, Local AI: Running Open-Source LLMs Locally

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.