What you'll learn:
- You will learn about the Snowflake Architecture and Performance management
- Deep Dive in to the Access management and the type of Db objects
- Understand in full detail how the data moves from external system to Snowflake
- Deep knowledge on Dynamic data masking and visualization
- Extensive knowledge on Data Sharing and Data Protection
Are you a technology professional or college graduate who have thought multiple times to learn snowflake but couldn't learn it so far?
Is your self snowflake learning a struggle? As a busy technology professional, do you feel overwhelmed and frustrated with all the 'answers' to master snowflake, but still not sure which one is right for you?
Have you wondered, how many days , weeks and months are passed in just thinking about learning snowflake? The time is NOW to get started.
In this course, you will discover exactly what you need to focus on to master snowflake. We will take you through an easy step by step approach to learn and master snowflake in shortest period of time with out overwhelm.
Cloud is the new norm, almost all tech giants are moving towards cloud platform for the solutions which are cost effective and scalable. Cloud data-warehousing aka Snowflake warehouse is one the fastest growing technology which most of the technology companies are adopting. This is going to be big in future, hence this is the right time to get into the ship to learn and equip ourselves will all the knowledge of snowflake and prepare ourselves for better career today and in future. So if you find yourself saying "May be I will try it another time ". I would say THE TIME IS NOW. Don't let yourself go another day, another week, another month of learning procrastination. It's time RIGHT NOW to get on the journey of learning and have the life knowledge and excellent career you have designed for you.
Added the new section on Dynamic Tables for year 2024.
Following modules will be covered in a very easily step by step approach
Snowflake Architecture and Performance Management
Introduction
Create Trial account
Know your UI interface
Shared and Non Shared Disk Architecture
High Level Architecture
Create Virtual Warehouses
Scaling Policy
Create First Database and Table
Load CSV from public S3 bucket
Snowflake Architecture
Snowflake Editions
Credits
Credit Usage Scenarios
Credit to Dollar Storage cost
Credit Storage Consumption
Performance Management
Performance Improvement Methods
Dedicated Virtual Warehouses
Dedicated Virtual Warehouses Creation
Scale Up and Scale Down
Scale Out and Scale In
Maximize Caching
Maximize Caching demonstration
Clustering Keys
Clustering Cost
Clustering Performance
Micropartitions
Access management and snowflake objects
Access management
Access control and RBAC
Securable objects
Roles
Tables in snowflake
Table Types
Database and schema type
User Defined Functions (UDF’s) and Stored Procedures
User defined functions (UDF’s)
Stored procedures (SP’s)
Secure UDF’s and SP’s
Views
Non Materialized views
Materialized views
Data Movement - Techniques and Unloading
Data Loading techniques
Types of Data load
Know snowflake stages
Install Snowsql
Internal Stages
Userstage
Tablestage
Namedstage
External Stages
COPY Command
COPY Transformation
File Format Object
COPY OPTIONS
ON ERROR
SIZE LIMIT
RETURN_FAILED_ONLY
ENFORCE_LENGTH / TRUNCATECOLUMNS
FORCE / LOAD_UNCERTAIN_FILES
LOAD_HISTORY
VALIDATION MODE
Logging rejected records
Data loading best practices
Data Unloading
Data unloading theory
COPY into location - Internal Stage -> User stage
Resolving max_workers must be greater than 0
COPY into location - Internal Stage -> Table stage
COPY into location - Internal Stage -> Named Internal Stage
Unloading using Query
Unloading to Multiple Files
Data Movement - Data loading
Loading from AWS
Create AWS free-tier account
Create S3 bucket, file and role
Storage integration object
Load file from AWS
Unload data to AWS
Loading from Azure
Create Azure free trial account
Create storage and container
Integration object
Load data from Azure
Unload data to Azure
Loading from GCP
Create GCP free trial account, create bucket and upload file
Integration object
Load data from GCP
Unload data to GCP
Loading Semi-Structured Data
Introduction
Process and understanding the demo data
JSON: Load raw data and analyze nested objects
JSON: FLATTEN
Array/Objects
Hierarchical
JSON: Data transformation and load
JSON: Querying Data
PARQUET: File load and transformation
Snowpipe
Overview
Create snowpipe, load and configure
Troubleshooting and pipe refresh
Manage snowpipe
Dynamic Data Masking and Visualization
Dynamic data masking
Overview
Create masking policy
Change, Unset and replace masking policy
Conditional masking
Data Visualization
Snowsight - Dashboard and Visualization
Getting started with Tableau
Tableau visualization from snowflake data
Partner Connect
Overview
Partner connect categories
Data Sharing and Data Protection
Data Sharing
Overview
Data sharing demo of Table, External tables and UDF’s.
Data share to a reader account
Imported privileges
Data share - entire database
Data share operations - DDL and DML affect
Sharing views and materialized views
Time Travel
Overview and retrieve data using “at” and “before”
Data restoration using direct method
Data restoration using indirect method
UNDROP
Understanding retention time
Fail-Safe
Overview
Fail Safe demo
Zero-Copy Cloning
Overview
Cloning permanent tables
Copy grants and clone temporary external tables
Clone schema and database
Swap
Clone using time travel and understand sharing vs cloning
Streams
Overview
Consuming streams using insert, update and delete
Types of streams - default, append only. Consume stream using false condition
Insert only streams for external tables
Multiple consumers with streams
Changes clause
Streams consideration and stale after attribute
Recreate, rename and clone effect on stream
Tasks
Understanding tasks
Create task using procedure when and troubleshoot task
Scheduling tasks using CRON
CRON - Daylight savings considerations
DAG - Tree of tasks
Task with stream
User managed tasks and warehouse considerations
Sampling Data
Overview
Row sampling method
System block method
Access management in practice
System defined roles and its users
Custom roles and its users
Create objects from sysadmin role and assign to developer role
Create custom users - developer1, developer2,qa1 and reader1
Problems due to unassigned custom roles
Solution of the problems
Public Role
Best Practices
Auto resume, success and failure and long running queries
Resource monitor
Columns storage cost and benchmarking the queries
Dynamic Tables
a. Dynamic Table Theory
b. Dynamic Table Create Data Pipeline - Part1
c. Dynamic Table Create Data Pipeline - Part2
Enjoy and Happy Learning !