From Uncertainty to Certainty: Strategies for Deterministic LLMOps

Explore strategies for implementing deterministic approaches in Large Language Model operations in this 36-minute talk by Amanda Milberg, Senior Partner Sales Engineer at Dataiku. Learn how to address the unpredictability of LLMs in mission-critical business applications by introducing qualitative methods to assess, evaluate, and refine these models. Discover techniques for determining factors such as toxicity, latency, cost, and bias, and how to use MLflow and Dataiku to establish monitoring mechanisms and track metrics over time. Gain insights on reassuring stakeholders and building trust in LLMs by addressing their inherent unpredictability. Acquire a strategic advantage in deploying and operationalizing LLMs across various applications, empowering you to maintain control in uncertain environments. Access additional resources including the LLM Compact Guide and the Big Book of MLOps to further enhance your understanding of the topic.