Expertise Spark 2.0 with Scala and Databricks

Spark 2.0 with a flavour of Databricks

4.00 (9 reviews)
Udemy
platform
English
language
IT Certification
category
instructor
98
students
4 hours
content
Oct 2019
last update
$44.99
regular price

What you will learn

Who wants to learn spark 2.0 along with Scala in simple language

Description

In this course you will learn the basics of creating Spark 2.0, including Spark SQL. Also you will get a flavor of Databricks along with this course. You will learn to create notebook,  loading data, and working with data in Databricks as well as without the Databricks. You’ll also get an introduction to running machine learning algorithms and working with streaming data. lets you start writing Spark queries instantly so you can focus on your data problems.

We also provide a crash course for Scala to work with Spark 2.0. So even if you are not aware of scala you need not to worry about it.


We believe that when you learn something, you should be able to apply it somewhere. So, in this course, we are also providing you with some of the important spark interview questions , which will help you to crack the interview with flying colors.

Content

Introduction

Course Introduction
Introduction to Big Data Trunk
Big Data Before Spark
Big Data After Spark

Environment Setup for Spark

Downloading Java JDK-8 for Scala
Downloading and Installing Eclipse for Scala
Installing Spark2.x
Executing first Spark program in Spark Shell

Scala Basics - Head Start for Spark

Scala Introduction
Scala Basics
Lab - Operators in Scala
Lab - If-Else and Loops in Scala
Lab - Declaring and Calling functions in Scala
Lab - Few Data Structures in Scala

Let's Begin with Spark

Introduction to Spark
Something More about Spark
Difference Between Spark 1.x and Spark 2.x
Spark's Resilient Distributive Dataset
Spark Core
Spark Context
Spark Session
Spark Driver
Spark application Architecture
Brain Twister - 01
Spark RDD Operations
Features and Limitations of RDD
RDD Lineage & Lazy Evaluation
DAG (Direct Acyclic Graph)
Brain Twister - 02

Lets Work with Spark - HandsOn

Lab - RDD - Part 01
Spark Operations
Lab - RDD - Part 02
Lab - Spark word Count Application
Spark SQL
Lab - Spark SQL
Brain Twister - 03

Spark on Databricks

Databricks Introduction
Provisioning Databricks workspace with Azure
Databricks Community Edition
Notebooks in Databricks
Running a Spark application on Databricks
Uploading Data and creating Table on Databricks

Deep Dive into Spark

RDD Vs DataSet Vs DataFrame
DataSets : TypeSafe
Repartition Vs Coalesce

Thank you !!

Looking your Way forward !!
Bonus Lecture

Screenshots

Expertise Spark 2.0 with Scala and Databricks - Screenshot_01Expertise Spark 2.0 with Scala and Databricks - Screenshot_02Expertise Spark 2.0 with Scala and Databricks - Screenshot_03Expertise Spark 2.0 with Scala and Databricks - Screenshot_04

Reviews

Daryl
December 20, 2019
I would like to see more lab work. Also the video seems to cut pieces out and changes volume lot and often ends abruptly.

Charts

Price

Expertise Spark 2.0 with Scala and Databricks - Price chart

Rating

Expertise Spark 2.0 with Scala and Databricks - Ratings chart

Enrollment distribution

Expertise Spark 2.0 with Scala and Databricks - Distribution chart
2177966
udemy ID
1/26/2019
course created date
11/23/2019
course indexed date
Bot
course submited by