Overview
Learn how to install, run, and chat with Llama 2 on a Mac or Windows laptop using llama.cpp and Jupyter Lab in this 11-minute tutorial video. Follow step-by-step instructions for setting up JupyterLab, creating a virtual environment, activating it, and installing necessary components. Discover how to start JupyterLab, run cells, download the language model, and choose between speed and long context length. Explore chatting with Jupyter Llama and find out about additional features like saving chats, analyzing PDF files, and searching Bing. For those preferring a DIY approach, links to installation guides are provided, while a purchasable automated solution is also available for a more streamlined experience.
Syllabus
Introduction
Installing JupyterLab
Creating a Virtual Environment
Activating the Environment, Installing ipykernel
Starting JupyterLab
Running All Cells
Downloading the Language Model
Speed or Long Context Length
Chatting with Jupyter Llama
Taught by
Trelis Research