R. Pavan (RID : 1gdlal1m5xx)

  • Senior Consultant
  • Hyderabad, India

Rate

₹ 223,000 (Monthly)

Experience

8 Years

Availability

Immediate

Work From

Offsite

Skills

Azure Data FactoryAzure Databricks SQL Server

Description

  • Excellent knowledge of ADF building components –Integration Runtime, Linked Services, Data Sets, Pipelines, Activities
  • Designed and developed data ingestion pipelines from on-premises to different layers into the ADLS using Azure Data Factory (ADF V2)
  • Experience with integration of data from multiple data sources
  • Knowledge on Data Extraction from On-Premises Sources and Delta Extraction methods from Source Systems to ADLS
  • Extensively Worked on Copy Data activity
  • Worked on Get Metadata Activity, lookup, Store Procedure, Foreach, IF and execute Pipeline activities
  • Knowledge on Data Extraction from On-Premises Sources and Delta Extraction methods from Source Systems to ADLS
  • Implemented dynamic pipeline to extract the multiple files into multiple targets with the help of a single pipeline
  • Manage data recovery for Azure Data Factory Pipelines
  • POC using ADLCOPY to copy BLOB to ADLS and ADLS to ADLS
  • Pipeline execution methods (Debub vs Triggers)
  • Writing the SQL queries using Joins, Co-Related Queries, and Sub-Queries
  • Monitor and manage Azure Data Factory
  • Deployed the code with help of the CI/CD process.
  • Using python for data transformation techniques
  • Use filter () to return the rows that match a predicate,
  • aggregations using agg () and count Distinct ()
  • Compare the Data Frame and SQL query physical plans
  • Extensively used ETL methodology for supporting Data Extraction, Transformation, and processing of data from sources like (Oracle, SQL Server, Teradata) using Azure Data Factory into Azure Data Lake Storage
  • Experience with integration of data from multiple data sources
  • Involved in production support activities
  • Good team player with excellent communication and interpersonal skills
  • Play a key role in the development team
  • share on fb
  • share on x
  • share on linkedin
  • share on instagram
  • share on yt

Copyright© Cosette Network Private Limited All Rights Reserved

Submit Query icon