Overview
Discover how SQLAlchemy serves as the backbone of a data science company in this EuroPython Conference talk. Explore the scalability of relational data models in the era of NoSQL databases and Map Reduce algorithms. Learn how Blue Yonder utilizes SQLAlchemy throughout their data science workflows to manage billions of records for predictive algorithms. Delve into SQLAlchemy's advanced features beyond ORM, focusing on the Core API, Expression Language, and database migrations with Alembic. Gain insights into database abstraction, security measures against SQL injection, query composability and reuse, testability techniques, and database reflection. Understand the implementation of a custom SQLAlchemy dialect for the EXASolution database system. Cover topics including data flow in data science, database schema definition, data manipulation and query languages, query builders, testing strategies, and database migrations.
Syllabus
Intro
Data Flow in a Data Science Company
Defining your Database Schema
Data Manipulation Language
Data Query Language
Using a Query Builder
Simple Query Builder Implementation
Composability and Reuse
Merge Statement SQLAlchemy
Testability
Testing against SQLite
Transaction/Rollback in your tests
Databse Reflection & Introspection
Security - Little Bobby Tables we call him
Database Migrations with Alembic
SQLAlchemy Exasol
Apache Arrow
Documentation
Taught by
EuroPython Conference