Hadoop Administration - Cloudera Hadoop on AWS

Hadoop Administration - Cloudera Hadoop on AWS

itversity via YouTube Direct link

Setup CDH on AWS - Setup local yum repository server for Cloudera Manager and Hadoop

16 of 64

16 of 64

Setup CDH on AWS - Setup local yum repository server for Cloudera Manager and Hadoop

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Hadoop Administration - Cloudera Hadoop on AWS

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Amazon Web Services - Sign up and Regions
  2. 2 Amazon Web Services - Networking
  3. 3 Amazon Web Services - Key Pair (authentication) and Security Groups (firewalls)
  4. 4 Amazon Web Services - Storage
  5. 5 Amazon Web Services - EC2 Pricing (Very Important)
  6. 6 Amazon Web Services - Provision EC2 Instance Demo
  7. 7 Amazon Web Services - Setup SSH forwarding (Bastion)
  8. 8 Amazon Web Services - Mac - Setup SSH Forwarding (Bastion)
  9. 9 Amazon Web Services - Setup SSH Tunneling and Foxyproxy
  10. 10 Big Data Introduction
  11. 11 Hadoop Introduction and brief comparison with Oracle
  12. 12 Hadoop Administration - CDH5 on AWS - Introduction
  13. 13 Setup CDH on AWS - Provision EC2 Instances
  14. 14 Setup CDH on AWS - Setup parallel ssh
  15. 15 Setup CDH on AWS - Setup http server on master01 or gateway node
  16. 16 Setup CDH on AWS - Setup local yum repository server for Cloudera Manager and Hadoop
  17. 17 Setup CDH5 on AWS - Setup pre-requisites using parallel-ssh
  18. 18 Setup CDH5 on AWS - Install Cloudera Manager
  19. 19 Setup CDH on AWS - Review Cloudera Management Service Components
  20. 20 Setup CDH on AWS - Setup HDFS
  21. 21 HDFS - Files and blocks - dfs.blocksize (Block Size)
  22. 22 HDFS - Replication Factor - Fault Tolerance
  23. 23 HDFS - Metadata, Datanode, Namenode and Secondary Namenode
  24. 24 HDFS - Heartbeat, Block report and Checksum
  25. 25 HDFS - Namenode Recovery (role of editlogs, fsimage and secondary namenode)
  26. 26 Setup CDH on AWS - Setup HDFS High Availability Introduction
  27. 27 Setup CDH on AWS - Setup HDFS High Availability using Cloudera Manager
  28. 28 HDFS - High Availability - Setup using Cloudera Manager
  29. 29 HDFS - High Availability - Review components and parameter files
  30. 30 HDFS Commands - hadoop fs command overview, help and appendToFile
  31. 31 HDFS Commands - cat, checksum, chgrp, chmod, chown
  32. 32 HDFS Commands - copyFromLocal or put, copyToLocal or get and cp
  33. 33 HDFS Commands - count, df, du and expunge
  34. 34 HDFS Commands - find, getmerge and ls
  35. 35 Hadoop Certification - HDPCA - Recover a snapshot
  36. 36 Hadoop Certification - HDPCA - Create a snapshot of an HDFS directory
  37. 37 Hadoop Certification - HDPCA - Configure ACLs
  38. 38 HDFS Commands - mkdir, moveFromLocal, moveToLocal, mv
  39. 39 HDFS Commands - stat, tail, test, text, touchz and usage
  40. 40 Setup Map Reduce v1 (MRv1) or Classic using Cloudera Distribution
  41. 41 Setup Map Reduce v1 (MRv1) or Classic using Cloudera Distribution - Review
  42. 42 Setup Map Reduce v1 (MRv1) or Classic using Cloudera Distribution - JobLifeCycle
  43. 43 Setup Map Reduce v1 (MRv1) - Heartbeat, Fault Tolerance and Speculative Execution
  44. 44 Setup Map Reduce v1 (MRv1) - Challenges
  45. 45 Setup CDH on AWS - Configure MRv2 + YARN
  46. 46 Setup CDH on AWS - Configure MRv2 + YARN - Review
  47. 47 Setup CDH on AWS - Configure MRv2 + YARN - Validate
  48. 48 Setup CDH on AWS - Configure MRv2 + YARN - Map Reduce Job Life Cycle
  49. 49 Setup CDH on AWS - Configure MRv2 + YARN - Fault Tolerance
  50. 50 Hadoop Certification - CCAH - Principal points to consider hardware and OS for Hadoop cluster
  51. 51 Hadoop Certification - CCAH - Cluster planning
  52. 52 Hadoop Certification - CCAH - Logging Configuration (log4j.properties)
  53. 53 Hadoop Certification - CCAH - Setup Hadoop eco system tools - Introduction
  54. 54 Hadoop Certification - CCAH - Hadoop metrics and cluster health monitoring
  55. 55 Setup CDH on AWS - Setup mysql for hive, oozie, sqoop etc.
  56. 56 Setup CDH - Setup Pig using Cloudera Manager
  57. 57 Setup CDH on AWS - Setup Hive using Cloudera Manager
  58. 58 Setup CDH on AWS - Setup Hive using Cloudera Manager - Review
  59. 59 Setup CDH on AWS - Setup Hive using Cloudera Manager - Validate
  60. 60 Setup CDH on AWS - Setup Sqoop using Cloudera Manager
  61. 61 Setup CDH - Schedulers Overview
  62. 62 Setup CDH - FIFO Scheduler
  63. 63 Setup CDH - Fair Scheduler
  64. 64 Setup CDH - Capacity Scheduler

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.