Fine-Tune LLMs or Integrate 3rd Party APIs? A Financial Case Study

Explore the transformative impact of ChatGPT and GPT-4 on machine learning in this 29-minute conference talk by Hannes Hapke, Principal Machine Learning Engineer at Digits. Discover how Digits' machine learning team adapted to the new era of Large Language Models (LLMs), modified their MLOps processes, and gained insights into fine-tuning and deploying LLMs as a small, focused team. Learn the crucial questions to consider when deciding between fine-tuning open-source LLMs or integrating third-party APIs. Examine the challenges and ethical concerns associated with using advanced language models via APIs, and understand strategies to mitigate risks in your projects through engineering approaches. Gain valuable insights from this financial case study to inform your own LLM implementation decisions.