Azure Cloud Azure Databricks Apache Spark Machine learning

Big Data, Spark SQL, Hadoop, Kafka, Data Lake, Transfer Learning, Zeppelin Notebook, Graph, Hortonworks HDP, Cloudbreak

2.15 (139 reviews)
Udemy
platform
English
language
Data Science
category
765
students
8.5 hours
content
May 2020
last update
$39.99
regular price

What you will learn

This course will provide you an in depth knowledge of apache Spark and how to work with spark using Azure Databricks

You will understand the main concepts of Azure Cloud

You'll learn about the basic use of Azure Cloud

You will learn to deploy Apache Spark ecosystems locally

You'll learn how to develop a databricks dependency library through IDEA

You will be able to process continual streams of data with Spark streaming

You will learn how to train a machine learning model

You will understand the use case of graph analysis

Deploy Azure Virtual Networks via the Portal

Deploy Azure Resource Groups

You'll learn how to use Azure Data Factory

You'll learn the historical story of Apache Hadoop, Apache Spark and Graph Analysis

You'll learn how to use Apche Zepplin to develop a hello world example of Spark

Deploy Azure Virtual Networks via the Portal

Description

Microsoft Azure is the fastest growing cloud platform in the world. No prior Azure experience required.

Azure Databricks is unique collaboration between Microsoft and Databricks, forged to deliver Databricks’ Apache Spark-based analytics offering to the Microsoft Azure cloud. With Azure Databricks, you can be developing your first solution within minutes. Azure Databricks is a fast, easy and collaborative Apache Spark–based analytics service.


Databricks builds on top of Spark and adds:

     Highly reliable and performant data pipelines

     Productive data science at scale


In this course, you'll have a strong understanding of azure databricks, you will know how to use Spark SQL, Machine Learning, Graph Computing and Structured Streaming Computing in Aziure Databricks.


Why Azure Databricks?

Productive : Launch your new Apache Spark environment in minutes.

Scalable : Globally scale your analytics and machine learning projects.

Trusted : Help protect your data and business with Azure AD integration, role-based controls and enterprise-grade SLAs.

Flexible : Build machine learning and AI solutions with your choice of language and deep learning frameworks.


This course contains both theory lectures ( slides are attached to download for reference) and a significant number of hands-on demos that helps you in gaining hands-on experience. This course help you in laying strong basic foundation in preparation of Microsoft Azure Cloud and Databricks.


In this course, you can not only learn azure databricks, but also learn and practice Machine Learning, Streaming Computing, Graph Analysis, installation and deployment of Open Source Apache spark.

Content

Introduction

Introduction
What is databricks?

Databricks Quickstart

Hands-on: How to navigate to the databricks service?
Hands-on: How to create a workspace?
Hands-on: How to create a spark cluster?
Hands-on: How to create a notebook?
Hands-on: How to create a table?
Hands-on: How to delete a spark cluster?
Hands-on: How to delete all resources in Azure Cloud?
What is workspace?
What is Resource Group?
What is Databricks Runtime?
What is Cluster?

Apache Spark

History of Hadoop
What is Apache Spark?
Hands-on: Download and install virtualbox
Hands-on: Download and Install putty
Hands-on: Download and Install winscp
Hands-on: How to download HDP?
Hands-on: How to set up HDP
Hands-on: How to SSH into HDP with PuTTY?
Hands-on: How to connect to HDP with WinSCP?
Hands-on: How to connect to HDP with Web Shell?
How to use ambari to manage Hadoop?
Hands-on: Apache Spark Quick Start
Apache Spark Architecture
What is the ecosystem of Apache Spark?

Databricks Developer Tools

What is Databricks Developer tools?
Hands-on: Download and install python
Hands-on: How to set up databricks cli?
Hands-on: How to use databricks cli?
Hands-on: How to use Databricks Utilities?
Hands-on: Download and install JDK
Hands-on: Download and install IntelliJ IDEA
Hands-on: Using Databricks Utilities API Library in IDE
Hands-on: How to use databricks in Azure Data Factory
Hands-on: How to debug the notebook in pipeline?
Hands-on: ETL with Azure Databricks
Hands-on: How to debug ETL notebook in ETL pipeline?

Databricks Notebook

What is notebook?
Hands-on: Using notebook to visualize data

Databricks Delta Lake

Hands-on: Set up Apache Spark with Delta Lake
Hands-on: Using python to operate delta lake

Databricks REST API

Hands-on: Download and install postman
Hands-on: Generate a token
Hands-on: Create a spark cluster using REST API
Hands-on: Delete a spark cluster using REST API
Hands-on: Permanently delete a spark cluster using REST API

Databricks Machine Learning

History of Artificial Intelligence
What is Machine Learning?
Workflow of Machine Learning
Hands-on: Using scikit-learn with Spark on Databricks
Hands-on: Using Spark to distribute parameter tuning
Hands-on: Using tensorflow with Spark on Databricks
Introduction to Distributed Deep Learning
Distributed methods for using TensorFlow
Hands-on: Distributed deep learning training using TensorFlow with HorovodRunner
Hands-on: Using MLflow to track parameters and metrics
History of Transfer Learning
Hands-on: How to perform Transfer Learning on Databricks?

Structured Streaming

Hands-on: Create a virtual network
Hands-on: Create an Kafka cluster on HDInsight
Hands-on: How to connect to kafka using an SSH client
Hands-on: Configure Kafka for IP advertising
Hands-on: Peer the Kafka cluster to the Azure Databricks cluster
Hands-on: Create an Apache Kafka topic
Hands-on: Production Structured Streaming with Kafka
Hands-on: Consumption Structured Streaming with Kafka

Databricks Graph Analysis

History of Graph Analytics
Hands-on: How to install dataframes library?
Hands-on: How to create a graph?

Bonus: An Open Source Alternative Solution for Databricks

Why use open source alternative solutions?
How to deploy Cloudbreak on Azure Cloud?
Using Cloudbreak to create a cluster

Screenshots

Azure Cloud Azure Databricks Apache Spark Machine learning - Screenshot_01Azure Cloud Azure Databricks Apache Spark Machine learning - Screenshot_02Azure Cloud Azure Databricks Apache Spark Machine learning - Screenshot_03Azure Cloud Azure Databricks Apache Spark Machine learning - Screenshot_04

Reviews

Navaneeth
August 12, 2022
Worst.Not able to understand.The slang of the person who teaches this course is not in understandable form.
Sergio
May 31, 2022
The instructor does not "talk". It can be said that the content is incomplete since the instructor saved on production putting only one song.
Jeff
June 27, 2021
The course has potential but guessing this is the instructors first attempt at something like this. English is sub-standard for teaching. He should have had someone else read the script. Second when you are moving through a GUI, you should explain what you are doing and give some sense of where you are heading. I would suggest to the instructor to keep after it. Materials are fair to good, you need to improve the way you teach it. And do something about the music - annoying. :) HTH.
juan
May 24, 2020
really interesting course, and touching many of the features of Databricks. Bonus Cloudbreak is really appreciated
Vamsi
April 20, 2020
its ok not that interactive and easy to understand language. half of time is wasted with same unnecessary wait on setting up clusters and resource groups..doesnt explain why to use and use cases
Thenmozhi
April 3, 2020
Voice over is very poor. Not able to understand at all . Waste of time .completely not satisfied. Waste of money
Stefano
March 20, 2020
I got a number of useful suggestions but the biggest problem is the lack of explanation. In addition, too much time wasted waiting for cluster running.
Varasidhi
January 9, 2020
The course is good. I however preferred the instruction style followed by Jose Portilla. Instructor for this course is very difficult to follow.
Michael
August 31, 2019
I'm seriously thinking of seeking a refund for this one. Teaching databricks with cartoons doesn't work for me. The animations add nothing and if anything are a distraction. The presenter, not a native English speaker by the sound of it, has a very think accent which makes things difficult to understand. That's fine, he recognises this and even suggests using the transcript and closed captions, however, there are huge chunks of video with no transcript or closed captions. There are also large stretches of video that show the presenter browsing information on the origins of Hadoop - absolutely pointless since the text is not readable and there is no commentary. There are also long stretches of waiting for things to happen, for example creating a Databrikcs workspace from the Azure portal. Also absolutely pointless (unless length of video is considered a selling point?) This is also another course where Udemy pricing is a huge issue - I paid £9.99 but it is currently over at £179.99. It isn't worth what I paid, if you pay 18 times that then I strongly suspect you will be sorely disappointed. It's a shame really as the presenter obviously has some knowledge that could be shared.
Shashikiran
July 31, 2019
I am not able to understand what the person is talking initially. for other slides there is no voice. not happy
Ankur
July 17, 2019
This course looks like created for kids... I did not enjoy it... I am not able to stand it for 5 mins... Please remove this course from Udemy site...
Renate
June 14, 2019
- You'll do a lot of scrolling through the course. Many hands-on starts with same (starting databricks and cluster), that takes more than half of "hands on" video time (like video is 14 min, from which 10 min you'll be watching how cluster is starting). And in next "hands on” again 7-10 min watching how cluster is starting. If this was shown once, why to repeat over and over again? And if it is repeated, why not to cut from video all those waiting time? - Bad English. There is transcript, but in one of sections it is total crap, here is extract “First let's open the watch box and start up a view take some ham let's wait for it now and you curse a party spark of worsen two point four Pawlenty to our ball net love into embryo and let's check the worms back” - Course would benefit in giving background info during labs in normal English. + Content gives good overview for those who never worked with Databricks. It definitely not for architects or developers with experience.
Lisa
June 10, 2019
This is a great course. Author explains everything so simply yet with loads of detail.Excellent explanation of material, good pace, wide topic coverage great course!Thanks author for making this course on Azure Cloud.
Dane
June 10, 2019
Instructor very difficult to understand. Also most of the course is clicking around with no explanation. Also really annoying music all the way through. Don't buy!
COREY
June 3, 2019
Good course. Excellent presentation in an easy and understandable manner. The animation gave me a deep understanding of big data and machine learning.

Charts

Price

Azure Cloud Azure Databricks Apache Spark Machine learning - Price chart

Rating

Azure Cloud Azure Databricks Apache Spark Machine learning - Ratings chart

Enrollment distribution

Azure Cloud Azure Databricks Apache Spark Machine learning - Distribution chart
2295373
udemy ID
3/28/2019
course created date
2/28/2021
course indexed date
Bot
course submited by