AWS Data Engineer at Mindera - Chennai, India

Mindera is seeking an experienced AWS Data Engineer to join our team in Chennai, Tamil Nadu, India. This role involves designing, building, and optimizing scalable data pipelines and analytics solutions. The ideal candidate will possess strong hands-on experience with cloud-based data platforms, big data processing, and analytics engineering best practices.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines utilizing AWS EMR, PySpark, and Python.
• Collaborate closely with analytics and business teams to construct reliable and high-performance data models.
• Optimize data processing workflows for enhanced performance, reliability, and cost-efficiency.
• Ensure data quality, integrity, and consistency across all data platforms.
• Implement Continuous Integration and Continuous Deployment (CI/CD) practices for data pipelines using modern DevOps tools.
• Work collaboratively using version control systems and adhere to best engineering practices.

Must-Have Skills

• Extensive experience with Amazon Web Services (AWS), particularly AWS EMR.
• Proficiency in Python and PySpark development.
• Strong SQL and analytical skills.
• Experience with data pipeline orchestration and associated tooling.
• Working knowledge of GitHub for version control.
• Experience with Jenkins or similar CI/CD tools.
• Familiarity with dbt (data build tool).

Good-to-Have Skills

• Experience with Infrastructure-as-Code tools such as Terraform.
• Advanced hands-on expertise with dbt.
• Exposure to cloud cost optimization strategies and data governance principles.

Nice to Have

• Experience working in Agile development environments.
• Excellent communication and stakeholder collaboration skills.

What We Offer

• The opportunity to work on large-scale, modern data platforms.
• A collaborative and engineering-driven company culture.
• Competitive compensation and benefits package.