Dive into the development journey of DBRX, a cutting-edge open-source foundation model, in this 1-hour 6-minute conference talk by Databricks. Explore the tools, methods, and lessons learned during the creation of a high-quality LLM, presented by the team behind DBRX. Gain insights into building custom state-of-the-art models capable of reasoning on data, covering topics such as the DBRX development story, training tools and methods, best practices, and real-world examples of successful LLM development. Learn how to apply these techniques to create your own advanced language models, and discover the potential applications of DBRX in various industries.
Overview
Syllabus
In the Trenches with DBRX: Building a State-of-the-Art Open-Source Model
Taught by
Databricks
