Cloudera Developer Training for Apache Spark
About this Course
Cloudera University’s three-day training course for Apache Spark enables participants to build complete, unified Big Data applications combining batch, streaming, and interactive analytics on all their data. With Spark, developers can write sophisticated parallel applications to execute faster decisions, better decisions, and real-time actions, applied to a wide variety of use cases, architectures, and industries.
Audience Profile
This course is best suited to developers and engineers. Course examples and exercises are presented in Python and Scala, so knowledge of one of these programming languages is required. Basic knowledge of Linux is assumed. Prior knowledge of Hadoop is not required.
Course Content
Through instructor-led discussion and interactive, hands-on exercises, participants will navigate the Hadoop ecosystem, learning topics such as:
-
Using the Spark shell for interactive data analysis
-
The features of Spark’s Resilient Distributed Datasets
-
How Spark runs on a cluster
- Parallel programming with Spark
- Writing Spark applications
- Processing streaming data with Spark
Course Outline
1. Why Spark?
- Problems with Traditional Large-Scale Systems
- Introducing Spark
2. Spark Basics
- What is Apache Spark?
- Using the Spark Shell
- Resilient Distributed Datasets (RDDs)
- Functional Programming with Spark
3. Working with RDDs
- RDD Operations
- Key-Value Pair RDDs
- MapReduce and Pair RDD Operations
4. The Hadoop Distributed File System
- Why HDFS?
- HDFS Architecture
- Using HDFS
5. Running Spark on a Cluster
- Overview
- A Spark Standalone Cluster
- The Spark Standalone Web UI
6. Parallel Programming with Spark
- RDD Partitions and HDFS Data Locality
- Working With Partitions
- Executing Parallel Operations
7. Caching and Persistence
- RDD Lineage
- Caching Overview
- Distributed Persistence
8. Writing Spark Applications
- Spark Applications vs. Spark Shell
- Creating the SparkContext
- Configuring Spark Properties
- Building and Running a Spark Application
- Logging
9. Spark, Hadoop, and the Enterprise Data Center
- Overview
- Spark and the Hadoop Ecosystem
- Spark and MapReduce
10. Spark Streaming
- Spark Streaming Overview
- Example: Streaming Word Count
- Other Streaming Operations
- Sliding Window Operations
- Developing Spark Streaming Applications
11. Common Spark Algorithms
- Iterative Algorithms
- Graph Analysis
- Machine Learning
12. Improving Spark Performance
- Shared Variables: Broadcast Variables
- Shared Variables: Accumulators
- Common Performance Issues
Sorry! It looks like we haven’t updated our dates for the class you selected yet. There’s a quick way to find out. Contact us at 502.265.3057 or email info@training4it.com
Request a Date