AWS Principal Data Architect – Hadoop Migration

  • No. of positions: 10
  • Chennai
  • Last Active Date : 01 Aug, 2024

Budget

₹183,000 - ₹305,000 (Monthly)

Experience

5 to 12 Years

Work From

Onsite

Job Duration

Long-Term

Required Skills

AWSData ArchitectHadoop DWH Workload

Job Description

Exp-10 yrs

 

CTC- 22 lpa

 

WE NEED MIN 5 YRS RELEVANT EXP

 

  1. AWS Developers with 5-8 yrs exp- upto 25-27 lpa

 

  1. AWS Architect with 10+ yrs exp.- upto 35 lpa

 

 

Please don’t send Devops engineers

 

 

Job Description

AWS Principal Data Architect – Hadoop Migration

 

 

We are seeking an experienced AWS Principal Data Architect to lead the migration of Hadoop DWH workloads from on-premise to AWS EMR. As an AWS Data Architect, you will be a recognized expert in cloud data engineering, developing solutions designed for effective data processing and warehousing requirements of large enterprises. You will be responsible for designing, implementing, and optimizing the data architecture in AWS, ensuring highly scalable, flexible, secured and resilient cloud architectures solving business problems and helps accelerate the adoption of our client’s data initiatives on the cloud.

Key Responsibilities:

  1. Lead the migration of Hadoop workloads from on-premise to AWS-EMR stack.
  2. Design and implement data architectures on AWS, including data pipelines, storage, and security.
  3. Collaborate with cross-functional teams to ensure seamless migration and integration.
  4. Optimize data architectures for scalability, performance, and cost-effectiveness.
  5. Develop and maintain technical documentation and standards.
  6. Provide technical leadership and mentorship to junior team members.
  7. Work closely with stakeholders to understand business requirements, and ensure data architectures meet business needs.
  8. Work alongside customers to build enterprise data platforms using AWS data services  like Elastic Map Reduce (EMR), Redshift, Kinesis, Data Exchange, Data Sync, RDS , Data Store, Amazon MSK, DMS, Glue, Appflow, AWA Zero-ETL, Glue Data Catalog, Athena, Lake Formation, S3, RMS, Data Zone, Amazon MWAA, APIs Kong
  9. Deep understanding of Hadoop components, conceptual processes and system functioning and relative components in AWS EMR and other AWS services.  Good experience on Spark-EMR
  10. Experience in Snowflake/Redshift
  11. Good idea of AWS system engineering aspects of setting up CI-CD pipelines on AWS using Cloudwatch, Cloudtrail, KMS, IAM IDC, Secret Manager, etc
  12. Extract best-practice knowledge, reference architectures, and patterns from these engagements for sharing with the worldwide AWS solution architect community

 

 

 

Basic Qualifications:

 

  1. 10+ years of IT experience with 5+ years of experience in Data Engineering and 5+ years of hands-on experience in AWS Data/EMR Services (e.g. S3, Glue, Glue Catalog, Lake Formation)
  2. Strong understanding of Hadoop architecture, including HDFS, YARN, MapReduce, Hive, HBase.
  3. Experience with data migration tools like Glue, Data Sync.
  4. Excellent knowledge of data modeling, data warehousing, ETL processes, and other Data management systems.
  5. Strong understanding of security and compliance requirements in cloud.
  6. Experience in Agile development methodologies and version control systems.
  7. Excellent communication an leadership skills.  Ability to work effectively across internal and external organizations and virtual teams.
  8. Deep experience on AWS native data services including Glue, Glue Catalog, EMR, Spark-EMR, Data Sync, RDS, Data Exchange, Lake Formation, Athena,
  9. AWS Certified Data Analytics – Specialty.
  10. AWS Certified Solutions Architect – Professional.
  11. Experience on Containerization and serverless computing.
  12. Familiarity with DevOps practices and automation tools.
  13. Experience in Snowflake/Redshift implementation is additionally preferred.

 

Preferred Qualifications:

 

  1. Technical degrees in computer science, software engineering, or mathematics
  2. Cloud and Data Engineering background with Migration experience.

 

Other Skills:

 

  • A critical thinker with strong research, analytics and problem-solving skills
  • Self-motivated with a positive attitude and an ability to work independently and or in a team
  • Able to work under tight timeline and deliver on complex problems.
  • Must be able to work flexible hours (including weekends and nights) as needed.
  • A strong team player
Submit Query icon