Explore the cutting-edge application of tensor network substitutions in Large Language Models (LLMs) through this comprehensive seminar. Delve into the world of matrix product state tensor networks and their role in enhancing the explainability of natural language processing. Discover how tensor networks contribute to model compression, performance improvement, and increased controllability for high-dimensional datasets. Learn about recent advancements in substituting LLM layers with lightweight tensor networks, including Multiverse Computing's compression of LlaMA-2 7B and Terra Quantum's work on GPT-2small. Gain insights into specific strategies for recoding LLMs layer-by-layer using tensor networks, as detailed in current literature. Participate in a live question-and-answer session to deepen your understanding of this innovative approach to AI model optimization.
How to Re-Code LLMs Layer by Layer with Tensor Network Substitutions
Overview
Syllabus
How to Re-Code LLMs Layer by Layer with Tensor Network Substitutions
Taught by
ChemicalQDevice
Related Courses
-
Understanding LLMs and Basic Prompting Techniques
5.0 -
Generative AI Engineering with LLMs
-
LLM Explainability and Controllability Improvements with Tensor Networks
-
Create a Large Language Model from Scratch with Python – Tutorial
-
Drug Discovery Generative AI: End-to-End De Novo Proteins and Tensor Networks
-
Drug Discovery Generative AI Using Tensor Network GPT or BERT
