Scaling Analytical Capabilities for Increasing Client Demand

Explore how NatWest Boxed scales analytical capabilities to meet growing demand from multiple clients in this 15-minute talk by Lead Data Scientist Avision Ho at Data Science Festival. Discover the innovative use of Large Language Models (LLMs) to create a text-to-SQL product that democratizes data access and provides quicker insights. Learn about the selection of open-source models like Llama3, the benefits of frameworks such as LangChain and Vanna, and the strategies employed to ensure privacy and risk compliance. Gain insights into the infrastructure required for building and deploying this solution, enabling a team of 10 data scientists and analysts to flexibly and rapidly scale their services for businesses utilizing NatWest Boxed's Banking-as-a-Service (BaaS) platform.