Hyper Speed! When Big Data Blooms

Explore the challenges of handling and processing massive volumes of data in this conference talk from NDC Security 2023. Dive into the infrastructure used by Report URI to process nearly 65,000 JSON payloads per second, containing telemetry from clients worldwide. Learn about the power of Bloom Filters, an underutilized data structure that enables processing of enormous amounts of data with incredible speed and space efficiency. Gain insights into managing big data effectively and discover techniques for optimizing data processing in high-volume environments.