Hunting for New Particles Leveraging Legacy Infrastructure with Kubernetes
CNCF [Cloud Native Computing Foundation] via YouTube
Overview
Explore how CERN leverages Kubernetes to analyze billions of particle collision events from the Large Hadron Collider while integrating legacy high-throughput computing systems. Learn about the challenges of processing massive datasets in particle physics research and how cloud-native technologies are revolutionizing scientific computing. Discover the implementation of complex physics analysis workflows using Kubernetes, the role of software containers in open science, and the innovative use of the HTCondor Operator to bridge modern and traditional computing infrastructures. Gain insights into the intricate world of high-energy physics computing, the importance of legacy systems, and the future of scientific data processing in the cloud era.
Syllabus
Intro
The Large Hadron Collider
High Energy Physics
Legacy Infrastructure
Grid Sites
Challenges
Cluster
Workflow
Example Workflow
The Problem
The HD Condor Operator
The HD Condor Implementation
Running HD Condor jobs with Argo
Conclusion
Questions
Storage
Workflows
Other tools
Other questions
Improvements
Taught by
CNCF [Cloud Native Computing Foundation]