Apache Spark Fundamentals

RDD-based framework for automated distributed code execution, and companion projects in different paradigms: Spark SQL, Spark Streaming, MLLib, Spark ML, GraphX.
Code: EAS-017
Duration: 24 hours

Description

This training course delivers the key concepts and methods for data processing applications development using Apache Spark. We’ll look at RDD-based framework for automated distributed code execution, and companion projects in different paradigms: Spark SQL, Spark Streaming, MLLib, Spark ML, GraphX.

Roadmap

  • Spark concepts and architecture
  • Programming with RDDs: transformations and actions
  • Using key/vaule pairs
  • Loading and storing data
  • Accumulators and broadcast variables
  • Spark SQL, DataFrames, Datasets
  • Spark Streaming
  • Machine Learning using MLLib and Spark ML
  • Graph analysis using GraphX

Objectives

  • Understand core Spark concepts and architecture
  • Write data processing pipelines queries using simple and pair RDDs
  • Write data processing programs using DataFrames
  • Write stream processing programs using DStreams
  • Utilize pre-packaged machine learning and graph analysis algorithms
  • Move data between Spark and external systems (Kafka, Cassandra)

Target Audience

  • Developers
  • Architects

Prerequisites

Basic Java programming skills. Unix/Linux shell familiarity. Experience with databases is optional.


Trainer in Wroclaw
Vladimir Slobodyanyuk Data Warehouses and Integration Projects Consultant
Has professional experience in practical using of case and ETL tools, as well as experience in deployment and adaptation of industrial models. Has cumulative experience in architecture and design of more than 7 years.
Course is scheduled in: Wroclaw
26.09.2018 - 28.09.2018
Time: 09:00-17:00
City: Wroclaw
Duration: 24 hours
Language: English
Trainer
Vladimir Slobodyanyuk
Data Warehouses and Integration Projects Consultant
€360
Register for the next course
+
Registering in advance ensures you have priority. We’ll notify you when we schedule the next course on this topic
Register for the next course
+
Registering in advance ensures you have priority. We’ll notify you when we schedule the next course on this topic
Bucharest €360
Krakow €360
Wroclaw €360

Invoices for the course will be issued in local currency. All fees above can change according to training location and delivery mode and are subject to change while scheduling. For individual participants the price is as displayed. For legal entities VAT is added to the displayed price.

Courses you may be interested in:

Sign up

Choose dates
First Name*
Last Name*
Company
Email*
Phone
Your Comment
loading map...
Luxoft Warsaw - Warsaw Spire, plac Europejski 1, 00-844 Warszawa
loading map...
Dimitrie Pompeiu nr 5-7 , building C, Et. 5, sect 2, Bucharest, 014459

Contact phone:

021 371 4858
loading map...
Luxoft Poland Wrocław - Silver Tower pl. Konstytucji 3-go Maja 3 50-048 Wrocław
loading map...
Aleja Generała Tadeusza Bora-Komorowskiego 25, Quattro Business Park Five, 31-476 Kraków, Poland

Contact phone:

+48 122110650
   Subscribe to our monthly newsletter
Success
Thank you.
Your request has been received.