Data Warehouse Automation Using Agile Methods

Explore data warehouse automation techniques using agile methodologies in this comprehensive conference talk from PASS Data Community Summit. Discover how to overcome the challenges of delivering quick results to businesses while maintaining a robust architecture for shorter delivery cycles. Learn about the Data Vault design pattern and its role in providing a flexible architecture for agile development. Understand the potential hurdles developers may face when transitioning to this design, similar to the shift from database normalization to dimensional modeling. Examine how dimensional models can still be utilized as information marts atop the data vault. Delve into the power of metadata in automating processes and leveraging repeatable patterns for structured ETL or ELT, whether using T-SQL or SSIS. Gain insights into generating management documentation from metadata, enhancing project transparency and communication. This two-hour session equips data professionals with valuable strategies to implement agile methods in data warehouse development, ultimately improving efficiency and responsiveness to business needs.