Data Ingestion Courses and Certifications

Databricks

Automating FAA's SWIM Data Ingestion and Analysis with Databricks

Automating FAA's SWIM data ingestion and analysis using cloud-based services, showcasing infrastructure setup, configuration, and insights derived from flight data for improved air transportation management.

• YouTube
• 26 minutes
• On-Demand
• Free Video

SNIAVideo

The Role of Flash in Data Ingestion Within the AI Pipeline

Explore how flash storage revolutionizes data ingestion for AI pipelines, focusing on scalability challenges, performance demands, and efficient solutions for modern AI infrastructure deployment.

• YouTube
• 44 minutes
• On-Demand
• Free Video

Amazon Web Services;  Amazon

AWS SimuLearn: Data Ingestion Methods

Hands-on AI-powered simulation for designing and implementing AWS data ingestion solutions, focusing on Glue, Lambda, Athena, and Kinesis. Develop technical and soft skills through interactive scenarios.

• AWS Skill Builder
• 1 hour
• On-Demand
• Paid Course

MLOps.community

Partnering with Product for Effective Data Ingestion and Training Data

Discover strategies for collaborating with product teams to optimize data collection, architecture, and ML model success. Learn to prove ROI and leverage product analytics for effective data-driven decision-making.

• YouTube
• 19 minutes
• On-Demand
• Free Video

Databricks

Simplifying Data Ingestion for LLMs with Unstructured and Databricks

Learn to build a scalable solution for unstructured data ingestion in LLM applications using Unstructured and Databricks, addressing challenges and exploring efficient methods.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Databricks

Introducing Databricks' New Native Ingestion Connectors

Explore Databricks' new native ingestion connectors for SaaS apps, databases, and file sources. Learn about auto-optimized, low-maintenance solutions integrated with Data Intelligence Platform features.

• YouTube
• 34 minutes
• On-Demand
• Free Video

PyCon Israel

High-Performance Database Design for Processing 100,000 Events per Second in Python

Discover key insights from building a Python application that processes 100k events per second, exploring database solutions and performance optimization techniques.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Get started with Microsoft Sustainability Manager

Learn to set up, import data, calculate emissions, and generate reports using Microsoft Sustainability Manager. Explore organization setup, data ingestion, and monitoring progress with scorecards and goals.

• Microsoft Learn
• 1 hour 5 minutes
• On-Demand
• Free Online Course

Designing Data Systems

Learn to architect enterprise data systems by designing staging areas, operational data stores, and data warehouses. Gain hands-on experience with Snowflake, data transformation, and OLAP reporting using real-world datasets.

• Udacity
• 4 weeks, 4-5 hours a week
• On-Demand
• Paid Course

pandas Foundations

Learn how to use the industry-standard pandas library to import, build, and manipulate DataFrames.

• DataCamp
• 4 hours
• On-Demand
• Free Trial Available

Snowflake Decoded - Master the Fundamental Concepts

14494 ratings at Udemy

Become a Snowflake Professional with hands-on training and expert guidance from an industry pro

• Udemy
• 4 hours 56 minutes
• On-Demand
• Paid Course

Azure Data Factory For Data Engineers - Project on Covid19

14160 ratings at Udemy

Real world project for Data Engineers using Azure Data Factory, SQL, Data Lake, Databricks, HDInsight, CI/CD [DP203]

• Udemy
• 12 hours 46 minutes
• On-Demand
• Paid Course

Azure Synapse Analytics For Data Engineers -Hands On Project

3301 ratings at Udemy

Hands on Project for Data Engineers using all the services available in Azure Synapse Analytics [DP-203, DP-500]

• Udemy
• 13 hours 28 minutes
• On-Demand
• Paid Course

Building Data Engineering Pipelines in Python

Learn how to build and test data engineering pipelines in Python using PySpark and Apache Airflow.

• DataCamp
• 4 hours
• On-Demand
• Free Trial Available

Apache NiFi - A Beginners Guide | Big DataFlow | HDF & CDF

1515 ratings at Udemy

Apache NiFi is a robust Data Ingestion, Distribution framework & ETL Option. NiFi the core of the Big DataFlow (HDF/CDF)

• Udemy
• 2-3 hours
• On-Demand
• Paid Course