Apache Flink & Kafka End-to-end Streaming Project Hands-on

Python Big Data Internship Program: Real Time Streaming pipeline with Kafka, Flink, Hadoop HDFS, Elasticsearch & Kibana
3.74 (23 reviews)
Udemy
platform
English
language
Other
category
Apache Flink & Kafka End-to-end Streaming Project Hands-on
233
students
2 hours
content
Jan 2024
last update
$13.99
regular price

What you will learn

Kafka fundamentals: Master the key concepts and functionalities of Apache Kafka for efficient data ingestion and streaming.

Flink (better than Spark) for real-time processing: Learn how to leverage Apache Flink for real-time data processing and analytics in streaming pipelines.

Elasticsearch for indexing and search: Explore the capabilities of Elasticsearch for indexing and querying large volumes of streaming data in real time.

Visualization with Kibana: Use Kibana to create interactive visualizations and dashboards that provide insights into your streaming data pipeline.

Integrating Kafka and HDFS: Learn how to integrate Kafka with HDFS using Python to store streaming data efficiently and reliably.

Hands-on implementation: Get hands-on experience by building a Python-based solution that consumes Kafka data streams and stores them in HDFS

PyFlink for real-time processing: Utilize PyFlink for real-time data processing.

Pydoop for HDFS integration: Integrate HDFS with Python using Pydoop.

Kafka-Python for Kafka integration: Connect to Kafka and process streaming data using Kafka-Python.

Apache Flink Stream processing with Pyflink

End to End Real World Big Data Project : Stream processing pipeline

Screenshots

Apache Flink & Kafka End-to-end Streaming Project Hands-on - Screenshot_01Apache Flink & Kafka End-to-end Streaming Project Hands-on - Screenshot_02Apache Flink & Kafka End-to-end Streaming Project Hands-on - Screenshot_03Apache Flink & Kafka End-to-end Streaming Project Hands-on - Screenshot_04
5348732
udemy ID
5/26/2023
course created date
7/5/2023
course indexed date
Bot
course submited by