Arvind (RID : 14ppblmq1cmqu)

  • Senior Associate
  • Bengaluru, India

Rate

₹ 196,000 (Monthly)

Experience

7 Years

Availability

Immediate

Work From

Any

Skills

HadoopAWS CloudSparkScala CodeAzure DevopsJSONXMLCSV

Description

  • WorkExperience:

    Working as a Senior Associate withDeltacubes Technologiesfrom Nov’2021 to Till dateDesignation:SeniorAssociate

  • Integration/MigrationoftheSparkand ScalaCodetotransformdatafromAWS S3toRedshift.
  • Creating and Managing job through Amazon Glue Studio to transform the data from Source to Target.
  • Can create job through AWS Glue(Serverless Integration service)) data catalog and can schedule the scripts.
  • Scheduled AWS Crawlers to read data from S3 Buckets and loading the Metadata to AWS Glue.
  • Used AWS CloudWatch to create the event when the crawlers jobs get succeeded and successfully load data from S3 to Redshift.
  • Redshifthasbothmergeandraw layer.
  • Rawlayer will havealltheduplicatedataandmergelayer willhaveonlytheuniqueentrythathasbeenhandledinthe code.
  • DataloadhappensthroughtheSparkJarcreationandsubmissioninAWSEMRCluster.AWS S3isalsousedversioning thedata incaseofdeleteintheoriginalfile.
  • Have also Migrated the data from On-premises to AWS Cloud Services.
  • Used ETL Transformation for IICS for data Migration from Teradata to Snowflake.
  • Used PowerCenter for designing the mapping , tasks and Task flow in IICS.
  • share on fb
  • share on x
  • share on linkedin
  • share on instagram
  • share on yt

Copyright© Cosette Network Private Limited All Rights Reserved

Submit Query icon