Master Apache Spark - Hands On!

Learn how to slice and dice data using the next generation big data platform - Apache Spark!

4.67 (1090 reviews)

Udemy

platform

English

language

Data Science

What you will learn

Utilize the most powerful big data batch and stream processing engine to solve big data problems

Master the new Spark Java Datasets API to slice and dice big data in an efficient manner

Build, deploy and run Spark jobs on the cloud and bench mark performance on various hardware configurations

Optimize spark clusters to work on big data efficiently and understand performance tuning

Transform structured and semi-structured data using Spark SQL, Dataframes and Datasets

Implement popular Machine Learning algorithms in Spark such as Linear Regression, Logistic Regression, and K-Means Clustering

Why take this course?

LAST UPDATED: November 2023

Apache Spark is the next generation batch and stream processing engine. It's been proven to be almost 100 times faster than Hadoop and much much easier to develop distributed big data applications with. It's demand has sky rocketed in recent years and having this technology on your resume is truly a game changer. Over 3000 companies are using Spark in production right now and the list is growing very quickly! Some of the big names include: Oracle, Hortonworks, Cisco, Verizon, Visa, Microsoft, Amazon as well as most of the big world banks and financial institutions!

In this course you'll learn everything you need to know about using Apache Spark in your organization while using their latest and greatest Java Datasets API. Below are some of the things you'll learn:

How to develop Spark Java Applications using Spark SQL Dataframes
Understand how the Spark Standalone cluster works behind the scenes
How to use various transformations to slice and dice your data in Spark Java
How to marshall/unmarshall Java domain objects (pojos) while working with Spark Datasets
Master joins, filters, aggregations and ingest data of various sizes and file formats (txt, csv, Json etc.)
Analyze over 18 million real-world comments on Reddit to find the most trending words used
Develop programs using Spark Streaming for streaming stock market index files
Stream network sockets and messages queued on a Kafka cluster
Learn how to develop the most popular machine learning algorithms using Spark MLlib
Covers the most popular algorithms: Linear Regression, Logistic Regression and K-Means Clustering

You'll be developing over 15 practical Spark Java applications crunching through real world data and slicing and dicing it in various ways using several data transformation techniques. This course is especially important for people who would like to be hired as a java developer or data engineer because Spark is a hugely sought after skill. We'll even go over how to setup a live cluster and configure Spark Jobs to run on the cloud. You'll also learn about the practical implications of performance tuning and scaling out a cluster to work with big data so you'll definitely be learning a ton in this course. This course has a 30 day money back guarantee. You will have access to all of the code used in this course.

Screenshots

Master Apache Spark - Hands On! - Screenshot_01

Master Apache Spark - Hands On! - Screenshot_02

Master Apache Spark - Hands On! - Screenshot_03

Master Apache Spark - Hands On! - Screenshot_04

Reviews

Siddhesh

January 12, 2024

Instructions are very clear and crips. Various terms and techniques are introduced at the right pace and in a logical sequence.

Murugananthavel

September 21, 2022

Good a get understanding on Spark for beginner. However required a knowledge on Java for this course. Anyways java or any oops programming language is implicitly requirement for using Spark.

Athar

June 17, 2022

Awesome way of delivery. Nice and targeted content. No sentences other than topic where there. Its really worthy to watch.

John

March 23, 2022

1. The instructor is starting to say "OK?" very often. Quite distracting. 2. project 2 included three different scenarios. I found commenting and uncommenting distracted from the flow of the information.

Chakrapani

January 27, 2022

This course is really awesome.. Imtiaz explained all concepts related to spark in detail, i'm looking forward to use this leaning at my work, Definitely gave me more confidence to work on any spark project.

Niveditha

October 26, 2021

This Spark course is very helpful. It's very relevant to what i am looking for. The content is easily understandable and explained the topics clearly

Murilo

September 21, 2021

O conteúdo é bom, ele explica calmamente mas não de maneira extremamente profunda, deixa para você pesquisar se quiser saber mais. Recomenda livros também.

Faizan

June 21, 2021

Good course however use of learning aids and diagrams to explain concepts would have certainly improved the experience

Michael

January 18, 2021

Very Happy so far , I am finding the course excellent , Trainer is very knowledgeable and has a great pace , woud highly recommend this course

SABNIS

December 9, 2020

This course is awesome, because it starts with real examples to build on the concepts. A lot of other courses start with theory, but in this course you get to work hands on lab! Loving this course so far.

Violeta

November 14, 2018

Connecting all components into one. Have to a complete picture of the functionality of an application.

Daniyal

November 6, 2018

I'm definitely a fan of this Instructor. I've taken a lot of other courses on Udemy but this instructor's style of explaining things makes difficult subjects easy to understand and retain. For example, before I took one of his other Java courses, I had been struggling to understand OOP for many months in college. My college professor just could not explain it in a way to satisfied my curiosities. Online tutorials were not making sense either. I came across one of Imtiaz's youtube videos on OOP and within a 1/2 hr, I understood things that had eluded me for months. This instructor is truly one of a kind! No wonder he won an award from Udemy! Coming over to this course - hands down, the best way to learn Spark! nuff said!

Yusra

November 4, 2018

Fantastic course and very well put together.One of the best Instructor on Udemy who can simplify concepts and teach even a layman cool techy stuff easily..Content is really useful to any spark user and will enable you to gain upto intermediate level of knowledge to easily do most real world spark projects...I wish there was an extra session regarding Spark security though, such as configuring spark for kerberos ( and Sentry) enabled clusters , SSL etc. This I am sure is something all professionals would love to know as well as security is paramount importance to most data related work. But overall great course and looking forward to find more Big data tool courses (flink , kudu :)) from the instructor.

Mr.

October 20, 2018

I'm about halfway through this course already and it's been quite a ride. I feel much more confident about Spark. The Java API is tricky to understand from the documentation and this course made it super easy to understand. Looking forward to the rest of the course and the machine learning lectures. I'm a fan of Imtiaz's work.

Leonardo

October 19, 2018

A must-have survival guide in big data world! Mr. Imtiaz, thanks for your interest and involvement in our learning process. Leonardo.

Charts

Price

Rating

Enrollment distribution

Master Apache Spark - Hands On! - Distribution chart