The Security Wolf of Wall Street - Fighting Crime With High-Frequency Classification

Explore cutting-edge techniques for real-time threat detection in this Black Hat conference talk. Dive into the world of scalable machine learning infrastructure applied to massive DNS data processing. Learn about OpenDNS's innovative approach to data science, combining Big Data engineering and science to create a predictive security system. Discover the Avalanche stream processing framework, which enables data scientists to build scalable processing pipelines using a modular graph-oriented representation. Understand how finance industry paradigms from high-frequency trading are adapted for traffic analysis. Examine the integration of the NLP-Rank statistical model for large-scale phishing detection with Avalanche. Gain insights into automating security analysts' decision-making processes through machine learning techniques applied to HTML content. Explore data preprocessing, information retrieval, and natural language processing techniques used in the phishing classification system. Uncover the performance benefits and real-world applications of this advanced threat detection infrastructure.