↓Skip to main content
Naci Simsek
  1. Posts/

Use PySpark for Data Clean up

·1 min· loading · loading ·
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog
Table of Contents

Use PySpark for Data Clean up
#

In this article, we will be cleaning up a dirty data by using PySpark

Related

Airflow Introduction Pipeline
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog
Change Data Capture (CDC) Pipeline Implementation
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog
Elasticsearch Indexing and Kibana Dashboard with PySpark
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog
Optimizing Spark Applications
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog
Processing Complex Nested JSON File with Spark
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog
Spark Streaming Hands On from/to Kafka
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering Tutorial Hdfs Hive Mapreduce Postgres Catalog