Rethinking How We're Linking: Optimizing Performance for Large-Scale Python Applications

Explore a PyCon US sponsor presentation that challenges conventional wisdom about improving Python module performance. Dive into Meta's innovative approach to handling large-scale applications with over 20,000 shared libraries. Learn why rewriting modules as CExtensions isn't always the answer and discover how statically linking native extensions into the runtime can significantly boost performance. Gain insights into linkers, loaders, and binary layout, and delve deep into the workings of Native extensions in Python. This 53-minute talk by Loren Arthur offers valuable lessons for optimizing Python applications at scale, complete with illustrative slides to enhance understanding.