↓Skip to main content
Naci Simsek
  1. Posts/

Use PySpark for Data Clean up

·1 min· loading · loading ·
Naci Simsek
Docker Hadoop Data Engineering tutorial hdfs hive mapreduce postgres catalog

Use PySpark for Data Clean up
#

In this article, we will be cleaning up a dirty data by using PySpark

Related

Airflow Introduction Pipeline
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering tutorial hdfs hive mapreduce postgres catalog
Change Data Capture (CDC) Pipeline Implementation
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering tutorial hdfs hive mapreduce postgres catalog
Elasticsearch Indexing and Kibana Dashboard with PySpark
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering tutorial hdfs hive mapreduce postgres catalog
Optimizing Spark Applications
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering tutorial hdfs hive mapreduce postgres catalog
Processing Complex Nested JSON File with Spark
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering tutorial hdfs hive mapreduce postgres catalog
Spark Streaming Hands On from/to Kafka
·1 min· loading · loading
Naci Simsek
Docker Hadoop Data Engineering tutorial hdfs hive mapreduce postgres catalog