'Y'

Apache Spark Fundamentals

RDD-based framework for automated distributed code execution, and companion projects in different paradigms: Spark SQL, Spark Streaming, MLLib, Spark ML, GraphX.
Code: EAS-017
Duration: 24 hours

Description

This training course delivers the key concepts and methods for data processing applications development using Apache Spark. We’ll look at RDD-based framework for automated distributed code execution, and companion projects in different paradigms: Spark SQL, Spark Streaming, MLLib, Spark ML, GraphX.

Roadmap

  • Spark concepts and architecture
  • Programming with RDDs: transformations and actions
  • Using key/vaule pairs
  • Loading and storing data
  • Accumulators and broadcast variables
  • Spark SQL, DataFrames, Datasets
  • Spark Streaming
  • Machine Learning using MLLib and Spark ML
  • Graph analysis using GraphX

Objectives

  • Understand core Spark concepts and architecture
  • Write data processing pipelines queries using simple and pair RDDs
  • Write data processing programs using DataFrames
  • Write stream processing programs using DStreams
  • Utilize pre-packaged machine learning and graph analysis algorithms
  • Move data between Spark and external systems (Kafka, Cassandra)

Target Audience

  • Developers
  • Architects

Prerequisites

Basic Java programming skills. Unix/Linux shell familiarity. Experience with databases is optional.


Trainer in Online
Avanish Chauhan Software Development Consultant
Avanish is an experienced and detail-oriented senior Java/J2EE Developer & Software Engineer. He has a proven track record of leading teams to spearhead application development & deliver enterprise applications using Java 8, J2EE, Spring, Hibernate, DevOps and UI frameworks such as React.js & Angular 6.

He is proficient in object-oriented design & development and has expertise in developing REST and SOAP-based Java web services. Highly skilled in web and application development. Avanish is currently working as a Senior Software Developer for one of our key clients in the financial industry and is also leading a software development team as Scrum Master.

His responsibilities include both coding and scripting as well as testing and Agile methodologies – directing Unit, Integration testing & rendered direct support of existing software systems and playing a key role in various Scrum ceremonies such as story grooming, sprint planning sessions and more.

Among the trainings he delivers for us are our software architecture trainings such as Key Concepts of Software Architecture.
Course is scheduled in: Online
5.08.2020 - 7.08.2020
Time: 09:00-17:00
City: Online
Duration: 24 hours
Language: English
Trainer
Avanish Chauhan
Software Development Consultant
-10% €415
€374
Register for the next course
+
Registering in advance ensures you have priority. We’ll notify you when we schedule the next course on this topic
5.08.2020 - 7.08.2020
Time: 09:00-17:00
City: Online
Duration: 24 hours
Language: English
Trainer
Avanish Chauhan
Software Development Consultant
-10% €415
€374
Register for the next course
+
Registering in advance ensures you have priority. We’ll notify you when we schedule the next course on this topic
Bucharest €415
Krakow €415
Wroclaw €415

Invoices for the course will be issued in local currency. All fees above can change according to training location and delivery mode and are subject to change while scheduling. Price does not include VAT.

Courses you may be interested in:

Sign up

Choose dates
First Name*
Last Name*
Company
Email*
Phone
Your Comment
Luxoft Warsaw - Warsaw Spire, plac Europejski 1, 00-844 Warszawa
Dimitrie Pompeiu nr 5-7 , building C, Et. 5, sect 2, Bucharest, 014459

Contact phone:

021 371 4858
Luxoft Poland Wroclaw - Silver Tower pl. Konstytucji 3-go Maja 3 50-048 Wroclaw
Aleja Generała Tadeusza Bora-Komorowskiego 25, Quattro Business Park Five, 31-476 Kraków, Poland

Contact phone:

+48 122110650
Success
Thank you.
Your request has been received.