PROJECTDETAILS:
Role : Associate Sr. Data Engineer
Worked on various projects, which deals with many subjects of Data Engineering. Moving SSIS pipelines to ADF and recreating SSIS pipelines in ADF as per the functionality. Worked on recreating many SSIS packages in ADF using many ADF activities like Lookup. Metadata, Foreach, If condition, Copy and Stored procedure activities. Worked on implementing Azure Databricks notebooks in ADF. Worked on moving and integrating many sources to move data to Synapse analytics. As part of transformations with Databricks, used Python and PySpark coding. As part of project got very basic knowledge on PySql, which I have now started to learn completely.
Technologies used : Azure data factory, Synapse analytics, Synapse DB’s , SSIS , Databricks,
Azure Logic apps.
Infosys
Role: Data Engineer
Worked on a project, where it requires Data iterations and applying triggering conditions on Data pipelines. Integrating of ADF and Azure cognitive search index to improve the searching from inner
databases.
Integrating ADF databases with PowerBI and fetching of useful insights in the form of Data Visualizations.
Technologies used : Azure Data Factory, C#, Cognitive Search, PowerBI, Application Insights,
Python