Private Data Anonymization with Python - Fundamentals

Explore the fundamentals of private data anonymization using Python in this 21-minute conference talk from EuroPython 2023. Learn how to make large legal document repositories publicly accessible while protecting sensitive information. Discover key concepts such as entity recognition, masking types, and pseudoanonymization. Gain insights into utilizing Python libraries like spaCy and PyTorch to achieve effective anonymization scores. Understand the application of AI models for Named Entity Recognition (NER) within the anonymization process. Explore techniques for improving results through text mining and human-in-the-loop approaches. Delve into the challenges of GDPR compliance in banking, legal, and other sectors. Follow the process of converting PDF and DOCX documents to XML, processing them with regular expressions and machine learning models, and analyzing results using tools like AntConc and Textacy. Benefit from real-world examples drawn from the MAPA project, a European initiative for anonymization completed in 2022.