Signals from the Deep Web - Making Sense of Ephemeral and Anonymous Content

Explore alternative methods for capturing and analyzing social media data beyond mainstream APIs in this 50-minute conference talk. Discover how data scraping techniques, particularly using oXpath within the Vadalog framework, can overcome biases and limitations associated with conventional API usage. Learn about a scalable architecture for extracting information from the deep web, and see a practical demonstration of its implementation. Gain insights into applying Topic Modelling and Sentiment Analysis on captured data to uncover potential manipulation of online communities through bots and other means. Delve into the intersection of Computational Social Science, Machine Learning, and Reasoning to make sense of ephemeral and anonymous content from the depths of the internet.