↓ Skip to main content

Naci Simsek

Hey there.

This is where I share what I find useful along the way via the occasional blog post.

Feel free to look around, or click here to learn more about me.

Recent

Airflow Introduction Pipeline

Airflow Introduction Pipeline

1 min· loading · loading

Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog

Change Data Capture (CDC) Pipeline Implementation

Change Data Capture (CDC) Pipeline Implementation

1 min· loading · loading

Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog

Elasticsearch Indexing and Kibana Dashboard with PySpark

Elasticsearch Indexing and Kibana Dashboard with PySpark

1 min· loading · loading

Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog

Optimizing Spark Applications

Optimizing Spark Applications

1 min· loading · loading

Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog

Processing Complex Nested JSON File with Spark

Processing Complex Nested JSON File with Spark

1 min· loading · loading

Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog

Spark Streaming Hands On from/to Kafka

Spark Streaming Hands On from/to Kafka

1 min· loading · loading

Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog

Submitting Spark Application

Submitting Spark Application

1 min· loading · loading

Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog

Spark DataFrame Operations

Spark DataFrame Operations

1 min· loading · loading

Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog

Use PySpark for Data Clean up

Use PySpark for Data Clean up

1 min· loading · loading

Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog

Deploy Spark Cluster

Deploy Spark Cluster

1 min· loading · loading

Docker Spark Data Engineering Tutorial Spark Hive Mapreduce Postgres Catalog

Kafka Python Operations

Kafka Python Operations

1 min· loading · loading

Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog

Kafka Topics and Operations

Kafka Topics and Operations

1 min· loading · loading

Kafka Data Engineering Deployment Tutorial Kafka Topics Configuration Kubernetes Docker

Deploy Multi-Node Kafka Cluster on Kubernetes with KRaft Mode

Deploy Multi-Node Kafka Cluster on Kubernetes with KRaft Mode

10 mins· loading · loading

Kubernetes Kafka Data Engineering Tutorial Kafka Kubernetes Kraft Helm Aws Eks Intellij Persistent-Storage

Hive Partitioning and Bucketing

Hive Partitioning and Bucketing

15 mins· loading · loading

Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog

Hive Setup and Operations

Hive Setup and Operations

19 mins· loading · loading

Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog

Hadoop Cluster Deployment and Operations

Hadoop Cluster Deployment and Operations

11 mins· loading · loading

Docker Hadoop Data Engineering Tutorial Hdfs Yarn Mapreduce Datanode Namenode

Build Docker Images with Multiarch Support

Build Docker Images with Multiarch Support

3 mins· loading · loading

Docker Colima Microservices Tutorial Docker Colima Microservices Multiarchitecture Containers