Apache Spark Fundamentals

RDD-based framework for automated distributed code execution, and companion projects in different paradigms: Spark SQL, Spark Streaming, MLLib, Spark ML, GraphX.
Code: EAS-017
Duration: 24 hours

Description

This training course delivers the key concepts and methods for data processing applications development using Apache Spark. We’ll look at RDD-based framework for automated distributed code execution, and companion projects in different paradigms: Spark SQL, Spark Streaming, MLLib, Spark ML, GraphX.

Roadmap

  • Spark concepts and architecture
  • Programming with RDDs: transformations and actions
  • Using key/vaule pairs
  • Loading and storing data
  • Accumulators and broadcast variables
  • Spark SQL, DataFrames, Datasets
  • Spark Streaming
  • Machine Learning using MLLib and Spark ML
  • Graph analysis using GraphX

Objectives

  • Understand core Spark concepts and architecture
  • Write data processing pipelines queries using simple and pair RDDs
  • Write data processing programs using DataFrames
  • Write stream processing programs using DStreams
  • Utilize pre-packaged machine learning and graph analysis algorithms
  • Move data between Spark and external systems (Kafka, Cassandra)

Target Audience

  • Developers
  • Architects

Prerequisites

Basic Java programming skills. Unix/Linux shell familiarity. Experience with databases is optional.


Register for the next course
+
Registering in advance ensures you have priority. We’ll notify you when we schedule the next course on this topic
Bucharest €360
Krakow €360
Wroclaw €360

Invoices for the course will be issued in local currency. All fees above can change according to training location and delivery mode and are subject to change while scheduling. For individual participants the price is as displayed. For legal entities VAT is added to the displayed price.

Courses you may be interested in:

Sign up

First Name*
Last Name*
Company
Email*
Preferred Location
Phone
Your Comment
Luxoft Warsaw - Warsaw Spire, plac Europejski 1, 00-844 Warszawa
Dimitrie Pompeiu nr 5-7 , building C, Et. 5, sect 2, Bucharest, 014459

Contact phone:

021 371 4858
Luxoft Poland Wroclaw - Silver Tower pl. Konstytucji 3-go Maja 3 50-048 Wroclaw
Aleja Generała Tadeusza Bora-Komorowskiego 25, Quattro Business Park Five, 31-476 Kraków, Poland

Contact phone:

+48 122110650
Success
Thank you.
Your request has been received.