Build and Monitor Apache Spark Applications (Spark v2.1)

Build and Monitor Apache Spark Applications (Spark v2.1)

About this Course

In this course you will learn about the full Spark program lifecycle and SparkSession, along with how to build and launch standalone Spark applications. Also described are the components of the Spark execution model using the Spark Web UI to monitor Spark applications.

This is the second course in the Apache Spark v2.1 Series.

What's Covered

Course Lessons Lab Activities

4: Build a Simple Apache Spark Application

Define the Spark Program Lifecycle
Define SparkSession
Describe Ways to Launch Spark Applications
Launch a Spark Application

 

Import and Configure Application Files
Complete, Package, and Launch the Application

5: Monitor Apache Spark Applications

Describe Logical and Physical Plans of Spark Execution
Use Spark Web UI to Monitor Spark Applications
Debug and Tune Spark Applications

 

Use the Spark UI
Find Spark System Properties

Get Certified

This course is part of the preparation for the MapR Certified Spark Developer (MCSD) certification exam.

Prerequisites

  • Completion of the MapR Academy on-demand courses: ESS 100 -102, and DEV 360
  • Basic Hadoop knowledge and intermediate Linux knowledge
  • Experience using a text editor such as vi
  • Terminal program installed; familiarity with command-line options such as mv, cp, ssh, grep, cd, and useradd
  • Knowledge of functional programming with Scala, and experience with SQL

Curriculum

  • Lesson 4: Build a Simple Apache Spark Application
  • Quiz 4
  • Lesson 5: Monitor Apache Spark Applications
  • Quiz 5
  • Course Materials
  • Slide Guide (Transcript)
  • Lab Guide
  • Lab Environment Setup Guide
  • Course Sandboxes

About this Course

In this course you will learn about the full Spark program lifecycle and SparkSession, along with how to build and launch standalone Spark applications. Also described are the components of the Spark execution model using the Spark Web UI to monitor Spark applications.

This is the second course in the Apache Spark v2.1 Series.

What's Covered

Course Lessons Lab Activities

4: Build a Simple Apache Spark Application

Define the Spark Program Lifecycle
Define SparkSession
Describe Ways to Launch Spark Applications
Launch a Spark Application

 

Import and Configure Application Files
Complete, Package, and Launch the Application

5: Monitor Apache Spark Applications

Describe Logical and Physical Plans of Spark Execution
Use Spark Web UI to Monitor Spark Applications
Debug and Tune Spark Applications

 

Use the Spark UI
Find Spark System Properties

Get Certified

This course is part of the preparation for the MapR Certified Spark Developer (MCSD) certification exam.

Prerequisites

  • Completion of the MapR Academy on-demand courses: ESS 100 -102, and DEV 360
  • Basic Hadoop knowledge and intermediate Linux knowledge
  • Experience using a text editor such as vi
  • Terminal program installed; familiarity with command-line options such as mv, cp, ssh, grep, cd, and useradd
  • Knowledge of functional programming with Scala, and experience with SQL

Curriculum

  • Lesson 4: Build a Simple Apache Spark Application
  • Quiz 4
  • Lesson 5: Monitor Apache Spark Applications
  • Quiz 5
  • Course Materials
  • Slide Guide (Transcript)
  • Lab Guide
  • Lab Environment Setup Guide
  • Course Sandboxes