What you'll learn:
- Setup Development environment for building Scala and Spark applications
- Install Java and JDK
- Setup IntelliJ and add Scala plugin
- Develop simple Scala program
- Integrating IntelliJ with Spark
- Setup sbt to build scala applications
- Setup winutils to read files on windows using Spark
- Build jar file using sbt
- Setup Spark and run Spark job
Thiscourse is primarily to set up development environment to build Scala based Spark applications. As part of this we will see
- Setup Development environment to build highly scalable applications using Scala and Spark
- Demonstration of developing Spark applications using IntelliJ as IDE and Scala as programming language
This course is primarily to set up development environment and get ready to explore Scala and Spark in more detail.