Real-time Credit card Fraud Detection using Spark 2.2

Real time Credit card Fraud detection using Spark Streaming, Spark ML, Kafka, Cassandra and Airflow

4.06 (742 reviews)
Udemy
platform
English
language
Software Engineering
category
instructor
Real-time Credit card Fraud Detection using Spark 2.2
4,837
students
3 hours
content
Nov 2019
last update
$64.99
regular price

What you will learn

Students will be able to build End to End Big data project using Spark, Kafka, Cassandra, Scala and Java

Why take this course?

Real-time Credit card Fraud Detection is implemented using Spark Kafka and Cassandra.

Spark ML Pipeline Stages like String Indexer, One Hot Encoder and Vector Assembler is used for Pre-processing

Machine Learning model is created using the Random Forest Algorithm

Data balancing is done using K-means Algorithm

Integration of Spark Streaming Job with Kafka and Cassandra

Exactly-once semantics is achieved using Spark Streaming custom offset management

Airflow Automation framework is used to automate Spark Jobs on Spark Standalone Cluster.

Screenshots

Real-time Credit card Fraud Detection using Spark 2.2 - Screenshot_01Real-time Credit card Fraud Detection using Spark 2.2 - Screenshot_02Real-time Credit card Fraud Detection using Spark 2.2 - Screenshot_03Real-time Credit card Fraud Detection using Spark 2.2 - Screenshot_04

Reviews

Marcos
July 19, 2023
Excellent, however is important to add subtitles in Spanish and other languages because help to understand technical information.
Panagiotis
February 18, 2023
Just starting this course... Nothing will be implemented in this course...? Not a good idea for a course you are asking people to pay you money. Most people have upvoted this course because it has allowed you to integrate java/scala, Kafka, and Cassandra. This course is a good afternoon course if you like an introduction to these technologies. Lastly, the instructor will use VirtualBox to integrate with the tech he mentions... No use of docker(not even included as extra)??? I would suggest updating this course to use docker. That way it will be easier to run since this is a code walkthrough course.
Bhushan
January 30, 2023
Great explaination! People having m1 macs should reconsider before buying as VirtalBox haev not yet added complete support for m1 chips. So, you cannot run the project on your local system. Still a great learning!
Daniel
December 21, 2021
I think this sample project is amazing for showing the big picture of a Big Data project, I liked the implementation and the explanation for each step. Only thing I would mention is that I wanted to know how an ML Algorithm determines if there's a fraud transaction or not, instead, we got that info already populated on the dataset. Nevertheless I think it's a minor detail given the value it brings to actually see all those tools being used together in an understandable way.
Samuel
June 9, 2021
I'm getting to understand what is KAFKA all about how it manages streams. How to build project , create database, active server , cleaning up for new restarting of project
Aviral
March 4, 2021
Since DStreams are obsolete now, so even after stating every detail very clearly in the videos these syntaxes or code constructs are of no use to me. But the whole architectural flow makes sense.
Ashish
October 16, 2020
This was like a demonstration of a project, few core concepts are missing which is required to build such project.
Roman
December 20, 2018
Topic of the course is interesting but the audio content or narratives are disappointing. Instead to delivery some value in narrative, author just repeats obvious things and commands executed, instead of just share scripts and files explaining why to execute. The good example of it is complete section 2 - "Real time fraud detection demonstration", the value from it - how to clone repos, import VM to virtual box and start things from intellij idea, section takes 1h for things which can be explained in 20-25 mins with support files and scripts. Because mentioned section is almost half of the course, in intro section there is also no special value, you can imagine this course as a walk through over the repos and how to start projects in them - you can do it for free on github and its readme.md's.
Chendi.Xue
November 26, 2018
I myself am a system engineer working in distributed system (development and optimization). I am looking for some use cases helping me to understand how spark being used in application level. So far for me, I think this course is clear and right to the point. It gives me a glance of a real world use case and is exactly what I am looking for.
Ravi
November 20, 2018
This course is dealing with a practical scenario end-to-end. It is giving implementation details of the use case detailing each of the tools and technologies involved. At once one can get the architectural overview of how this type of applications are designed in production and also the nuts-and-bolts details as well from the code walk-through etc.
Harikesh
November 18, 2018
Excellent course with very methodical agenda and very good explanation. Trainer seems to have very good practical understanding of the subject. This is really helping me in getting a sound understanding of Hadoop-Spark. Thanks a lot Pramod !!
Sudipta
November 14, 2018
I would like to thank Pramod for bringing up an end to end flow of an implementation of a real world project with the engagement of the Hadoop ecosystem. I was looking for this sort of flow earlier also, but no luck. I did attended other webinar's which Pramod had hosted for Spark and it was of overwhelming response. Thanks once again Pramod. Will wait for more of the similar pattern.
Pandiarajan
November 14, 2018
This course is really useful.You will get a real time experience in spark after you complete this course. Detail explanation on each & every section. Overall very useful!!!!!!!!!
Vijay
November 14, 2018
Course contains Prerequisites , brief descriptions on each components and how it is useful. Very much excited about end to end implementation of Fraud Detection
Avinash
November 14, 2018
I'm working on bigdata analytics, This course is very helpful, in-depth explanation course content is good.Excellent way of teaching

Charts

Price

Real-time Credit card Fraud Detection using Spark 2.2 - Price chart

Rating

Real-time Credit card Fraud Detection using Spark 2.2 - Ratings chart

Enrollment distribution

Real-time Credit card Fraud Detection using Spark 2.2 - Distribution chart

Related Topics

1542818
udemy ID
2/6/2018
course created date
1/2/2020
course indexed date
Lee Jia Cheng
course submited by