Skip to main content
  1. Posts/

Spark Streaming Hands On from/to Kafka

·1 min· loading · loading ·
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog
Table of Contents

Spark Streaming Hands On from/to Kafka
#

In this article, we will be developing a Spark Streaming application which will read data from Kafka, process, and write back to Kafka


Related

Airflow Introduction Pipeline
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog
Change Data Capture (CDC) Pipeline Implementation
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog
Elasticsearch Indexing and Kibana Dashboard with PySpark
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog
Optimizing Spark Applications
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog
Processing Complex Nested JSON File with Spark
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog
Submitting Spark Application
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog