Senior Data Engineer

SUMMARY
Passionate data engineer with 6+ years of professional experience in database development, design and administration using TSQL and PostgreSQL . 3+ years of experience in
developing, testing and maintaining big data projects using Hadoop ecosystem and Apache Sparfi.

SKILLS

Programming Languages
SQL SparkSQL PySpark Data Frames
Scala HiveQL

Senior Data Engineer

10/2021 - Present
Big Data Technologies
Spark Sqoop Hadoop Kafka

Infohub (Supply Chain Datawarehouse) - UNICEF
•
Created T-SQL data views for PowerBI reports, saving 17 hours of manual work each
week.
•
Reduced data processing time by 50% by optimizing database queries and indexes.
•
Involved in optimization of existing algorithms in Hadoop using SparkSQL and Data Frames.
•
Defined schema and created HIVE tables (Managed and External) in HDFS.
•
Implemented Partitioning and Bucfieting in Hive using managed and external tables for
better performance.
•
Collaborated with cross-functional teams to identify and resolve data quality issues by
30%, using T-SQL.
•
Participated in Agile/SAFE planning 60= data feature requests.