Module Lead - Data Engineer

Location – Hyderabad or Bangalore

Job/Role Description

Experience – 6 to 8 Years

Analyse user needs to identify and recommend technical requirements that align with project objectives.

Confer with management and development teams to prioritize needs, resolve conflicts, and determine solutions.

Evaluate code to ensure validity, proper structure, compliance with standards, and compatibility across platforms.

Identify, locate, and acquire data needed for projects, ensuring data curation as required.

Periodically collaborate with stakeholders to manage change and drive projects to completion.

Write, test, and debug serverless software applications on the AWS platform.

Detail the design of user interfaces, applications, and database services for effective solutions.

Review and contribute to high-level design and architecture discussions, offering valuable insights.

Configure environments, Data pipelines, and Infrastructure-as-Code (terraform) for efficient development and deployment.

Perform thorough code reviews to ensure adherence to standards and code quality.

Take responsibility for delivering comprehensive technical documentation.

Collaborate with cross-functional teams including product management, QA, and operations to ensure project success.

Primary Skills (Must have)

Python, Spark, Data Engineering, Data Ingestions, deep understanding of IAM Roles, glue catalog, MWAA Airflow, SQL

Key Skills: Python, Spark