Overview
Syllabus
Introduction
Relational Databases
Sharding
Who this talk is for
Big Data
Agenda
Spark
Gray Sort
Spark vs Hadoop
Spark history
MOSS
Spark Context
Working with Spark
RDD Example
MapReduce
Demo Code
Spark Modules
Spark Sequel
Spark DataFrame
Spark Streaming
Spark Window Functions
Cassandra
Token Rings
quorum
Replication across data centers
Why use Cassandra
What happens if a node goes down
Linear scalability
Performance
What is Cassandra
Tables
Terminus
Query
Data Model
Partition Keys
Clustered Rows
Spark vs Cassandra
Weaknesses
Companies
Spark Cassandra Connector
Spark Cassandra Smart Algorithms
Spark Cassandra Cluster Design
Why Spark Cassandra
Spark Cassandra Example
How many nodes should you use
Common data pipeline patterns
Spring Cloud Dataflow
Programming Model
Code
Spark Configuration
Resource Management
Java Functions
Warning
Managing Cassandra
Pricing
Understanding where your code lives
Mapping into classes
Mapping into local packages
Spring app demo
Spark master URL
Commandline tool
Demo web
Demo client app
Demo client project
Thank you
Taught by
Spring I/O