Spark in Scala → Spark catalog management

Module 1: Spark features I: the computational model (4 hours)

The basic principles and concepts behind Spark, as a framework for distributed processing.
Module 2: Spark features II: Spark APIs (4 hours)

How do we process massive distributed data sets in a cluster? With high-level APIs! We have two major alternative APIs available at your fingertips: statically typed and dynamically typed.
Module 3: Spark features III: Reading and writing in Spark (4 hours)

The last module focused on transformations, whereas this one focuses on the data side: formats, optimizations, management, etc.
Module 4: Spark optimizations (4 hours)

Learn how to take the most of the spark optimizations for free.
Module 5. Best practices on performance & modular design (4 hours)

Learn the best ways to optimize and organize your Spark code to make it more robust and performant.

Spark in Scala