Search results for big data

Databricks

Rapid PySpark Custom Processing on Time Series Big Data in Databricks

Efficient PySpark processing for time series big data, enabling rapid custom calculations on rolling windows with constant time complexity, demonstrated using Sleep Number Smartbed sensor data.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Databricks

Big Data Visualization in Public Health - Optimizing Respiratory Illness Dashboard with Databricks

Explore CDC's enhanced big data processing for public health visualizations, optimizing respiratory illness monitoring through efficient data management and accelerated insight delivery.

• YouTube
• 35 minutes
• On-Demand
• Free Video

CNCF [Cloud Native Computing Foundation]

Scaling Batch, Big Data, and AI Workloads Beyond the Kubernetes Scheduler

Explore solutions for scaling AI, big data, and batch workloads on Kubernetes. Compare projects like Koordinator, Kueue, MCAD, Volcano, and YuniKorn to optimize cluster utilization and overcome scheduling challenges.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Big Data for Data Engineers

This course introduces you to essential concepts in handling vast datasets, equipping you with the ability to implement an effective data solution.

• Pluralsight
• 59 minutes
• On-Demand
• Free Trial Available

Creating Your First Big Data Hadoop Cluster Using Cloudera CDH

78 ratings at Pluralsight

In this course, fast track to Hadoop & Big Data with the Cloudera QuickStart VM and then set up a Hadoop cluster with Cloudera CDH.

• Pluralsight
• 1 hour 33 minutes
• On-Demand
• Free Trial Available

Alan Turing Institute

Astrophysics in the Age of Big Data

Explore how large datasets and machine learning revolutionize astrophysics, from classifying supernovae to studying exoplanet atmospheres, advancing our understanding of the universe.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Ubuntu OnAir

YTsaurus - The Next Generation of Open Source Big Data Platforms

Explore YTsaurus, an open-source big data platform for distributed storage and processing. Learn about its components, features, and capabilities for creating large-scale clusters up to 20,000 nodes.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Paul G. Allen School

GraphLab - Machine Learning for Big Data in the Cloud

Explore GraphLab, a framework for efficient parallel machine learning algorithms handling Big Data. Learn about its advantages over existing tools and its impact on large-scale tasks.

• YouTube
• 33 minutes
• On-Demand
• Free Video

CNCF [Cloud Native Computing Foundation]

Streamlining Big Data Workflows with Memoization and Work Avoidance

Optimize big data and ML workflows using memoization and work avoidance techniques in Argo Workflows. Learn best practices to reduce runtime and compute costs for data processing and machine learning jobs.

• YouTube
• 22 minutes
• On-Demand
• Free Video

NashKnolX

Big Data Transformation Powered by Apache Spark

Revolutionize data processing with Spark. Master transformative functions, aggregation, array manipulation, and advanced joins to unlock actionable insights from big data.

• YouTube
• 50 minutes
• On-Demand
• Free Video

Data Modeling Fluency

Learn to design relational and non-relational data models, understand Big Data fundamentals, and explore NoSQL databases to handle diverse data needs and massive datasets efficiently.

• Udacity
• 2 weeks, 4-5 hours a week
• On-Demand
• Paid Course

Data lakes and Lakehouses with Spark and Azure Databricks

Learn about the big data ecosystem and how to use Spark to work with massive datasets. Learners will also store big data in a data lake and develop Lakehouse architecture on the Azure Databricks platform.

• Udacity
• 3 weeks, 4-5 hours a week
• On-Demand
• Paid Course

DevConf

Scale Your Batch, Big Data, and AI Workloads Beyond the Kubernetes Scheduler

Explore solutions for scaling batch, big data, and AI workloads on Kubernetes. Compare projects like Karmada, Koordinator, and Kueue to optimize cluster utilization and overcome scheduling challenges.

• YouTube
• 25 minutes
• On-Demand
• Free Video

SAIConference

Meeting Societal Challenges: Scalable Big Data-driven, AI-enabled Approaches

Explore scalable big data-driven, AI-enabled approaches for societal challenges. Learn about innovative solutions in healthcare, agriculture, and smart cities using advanced analytics and deep learning techniques.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Inside Livermore Lab

Big Data Inverse Problems - Promoting Sparsity and Learning to Regularize

Explore novel methods for solving big data inverse problems, focusing on sparse representation and L1 regularization. Learn about variable projection and deep neural networks for parameter optimization.

• YouTube
• 1 hour
• On-Demand
• Free Video