Apache Spark Streaming 3 with Scala | Rock the JVM

Stream big data with Apache Spark Streaming 3 and integrate with Kafka, JDBC, Cassandra and more, hands-on, in Scala

4.54 (681 reviews)
Udemy
platform
English
language
Data Science
category
Apache Spark Streaming 3 with Scala | Rock the JVM
6,193
students
7 hours
content
Feb 2021
last update
$64.99
regular price

What you will learn

Process data as it arrives

Handle data of any scale in real time

Use Structured Streaming and SQL on streaming data

Use low-level, high-control APIs with DStreams

Integrate Spark with Kafka, JDBC, Cassandra

Master advanced concepts including window functions and watermarking

Why take this course?

In this course, we will learn how to stream big data with Apache Spark 3. You'll write 1500+ lines of Spark code yourself, with guidance, and you will become a rockstar.

This course is for Spark & Scala programmers who now need to work with streaming data, or who need to process data in real time.

Why Spark in Scala:

  • it's blazing fast for big data

  • its demand has exploded

  • it's a highly marketable skill

  • it's well maintained, with dozens of high-quality extensions

  • it's a foundation for a data scientist

I like to get to the point and get things done. This course 

  1. deconstructs all concepts into the critical pieces you need

  2. selects the most important ideas and separates them into what's simple but critical and what's powerful

  3. sequences ideas in a way that "clicks" and makes sense throughout the process of learning

  4. applies everything in live code

The end benefits are still much greater:

  • a completely new mental model around data streaming

  • significantly more marketable resume

  • more enjoyable work - Spark is fun!

This course is for established programmers with experience with both Scala and Spark at least at the level of the Rock the JVM essential courses for Scala and Spark. I already assume a solid understanding of general programming fundamentals.

This course is NOT for you if

  • you've never written Scala or Spark code before

  • you don't have some essential parallel programming background (e.g. what's a process/a thread)

The course is comprehensive, but you'll always see me get straight to the point. So make sure you have a good level of focus and commitment to become a badass programmer.

I believe both theory and practice are important. That's why you'll get lectures with code examples, real life code demos and assignments, plus additional resources, instructions, exercises and solutions. At the end of the course, you'll have written thousands of lines of Spark.

I've seen that my students are most successful - and my best students work at Google-class companies - when they're guided, but not being told what to do. I have exercises waiting for you, where I offer my (opinionated) guidance but otherwise freedom to experiment and improve upon your code.

Definitely not least, my students are most successful when they have fun along the way!

So join me in this course and let's rock the JVM!

Screenshots

Apache Spark Streaming 3 with Scala | Rock the JVM - Screenshot_01Apache Spark Streaming 3 with Scala | Rock the JVM - Screenshot_02Apache Spark Streaming 3 with Scala | Rock the JVM - Screenshot_03Apache Spark Streaming 3 with Scala | Rock the JVM - Screenshot_04

Reviews

Dmitry
September 29, 2023
The topic is important, the explanations are detailed. I like the author's approach. However, there are some things that are overlooked by the author. For example, checkpointing and recovering from failures. I will have to read the documentation.
Artur
June 23, 2023
Great material, nicely presented. A few notes. DStreams are deprecated, I've never seen it in prod. Watermarking part is great, but I miss a few gotchas for advanced topics, which Spark+Kafka have a lot. With those it would be the best course
Viacheslav
April 7, 2023
Great course! Very elaborate and understandable explanation of watermarks! It's a pity that the course does not cover stateful stream processing with Spark. Some more advanced stream-stream joins, e.g. user impressions vs user clicks to identify user sessions, would also be beneficial. Nevertheless, very useful course!
Mrunal
March 22, 2023
I do like Daniel's teaching style and the examples he demonstrates. They cover lot many use cases and it's always enough for me to start on a project.
Swati
February 5, 2023
Spark streaming explained end to end with Hands-on, I would definitely recommend someone to follow this course on Spark Streaming.
Mikołaj
December 29, 2022
I liked the examples very much, as well as code. Very useful content and nice structuring of the whole course, I feel it will be very useful for me in the future projects.
Roman
December 23, 2022
Not enough practice compared to other RTJVM courses. And the whole course seem to be rushed through. Would be much better to have deeper dive into stream processing.
Venkata
April 8, 2022
it was an old course, we have many new releases of spark streaming and that we are missing in the course.
Vladan
February 22, 2022
I love Daniel's courses, yet I feel thy could be better if the lessons were split into shorter videos, some of the 20 to 30 minutes videos can be very hard to grasp.
Pinto
February 21, 2022
Very nice hands on ..the repetitions actually helped to register them in my head as similar structure to create or read and then transform and then write was used which was very easy to understand.
Amrendra
November 1, 2021
As always Daniel courses gives comprehensive insight and very clean and crisp explanation of underlying concepts.
Suffyan
November 1, 2021
It is a great course, and specially the code examples are excellent. The code examples really explain the concept well, and make sure it is well understood. One feedback to make this course better would be to add section about administration of streaming jobs, and include topics such as preparing for failure, saving state, loading state after restart etc. Adding those should make it a complete course about Spark Streaming.
Manpreet
October 21, 2021
Very thorough and detailed and great summary and take-away notes in the end. Very useful for my current projcet
Roderick
October 10, 2021
an amazing sequence of tutorial building the foundation. the instructor did an amazing job. he has a gift to share knowledge.
Cosmin
September 18, 2021
Great class and learnings, Daniel definitely knows the subject vey well and has the ability to explain it to others. highly recommended.

Charts

Price

Apache Spark Streaming 3 with Scala | Rock the JVM - Price chart

Rating

Apache Spark Streaming 3 with Scala | Rock the JVM - Ratings chart

Enrollment distribution

Apache Spark Streaming 3 with Scala | Rock the JVM - Distribution chart
2868462
udemy ID
3/13/2020
course created date
3/16/2020
course indexed date
Bot
course submited by