High Throughput Data Conversion for Database Virtualization

Explore a conference talk from Code BEAM America 2024 focusing on Hyper-Q, an Erlang-based database virtualization application. Dive into the process of cross-compiling SQL dialects and emulating functionalities for guest databases over host databases. Learn about diagnosing bottlenecks in the cross-compilation process through profiling and discover architectural changes implemented to address these issues. Understand how reducing memory consumption during processing improves query throughput, enabling customers to transition from legacy data warehouses to cloud databases with minimal application rewrites. Gain insights into the time and effort-saving benefits of this approach for database migration and virtualization.