do apache spark, pyspark, hive, airflow, kafka, pandas, etl

About this Service

Big Data Engineer with 10+ years of experience in Hadoop, Scala Spark, PySpark, Hive, Kafka, Databricks and Cloud platforms like AWS, GCP, Azure. Developed and scheduled highly efficient production ETL pipelines capable of handling on Terabytes of data.

I also have experience in software engineering with open source tools SQL, REST API, Apache Airflow.

If you're looking for someone to build pipeline from scratch or enhance or improve performance of existing pipelines, you're just a ping away from accomplishing it.