TechOps

EY is seeking a Senior Data Engineer to join our TechOps - CloudOps team in Gurgaon, India. In this role, you will be instrumental in managing and optimizing large-scale data architectures, ensuring seamless data flow from diverse sources, and maintaining production systems for critical business insights. You will play a key part in our Analytics Production Support team, ensuring end-to-end data integrity and coordinating with global stakeholders across India and Mexico. This position requires a proactive approach to incident management, including handling Major Incident Management (MIM) bridges, and flexibility to work within a 24x7x365 support model.

Your primary responsibilities will include managing and maintaining ETL/ELT data pipelines for high availability and performance, resolving data quality issues within SLA parameters, and proactively monitoring systems for potential failures such as Databricks job issues. You will also be responsible for monitoring and maintaining AWS data services, including S3, DMS, Step Functions, and Lambda, to ensure efficient data loading. Conducting root cause analysis for major and recurring incidents, proposing permanent solutions, and identifying automation opportunities to enhance operational efficiency are also key aspects of this role. You will take ownership of support tickets, manage major incidents with regulatory compliance in mind, and escalate complex issues effectively. Additionally, you will mentor junior team members through structured training plans.

To succeed in this role, you should possess a minimum of 4 years of experience in Data Analytics, with a strong focus on supporting ETL data pipelines using Databricks and AWS Services. Proficiency in Databricks and PySpark for debugging and root cause analysis is essential. You should have proven experience in a Production Support environment and be comfortable working within a 24x7 support model. A strong understanding of relational SQL databases, data engineering programming languages like Python, distributed data technologies such as PySpark, cloud platform deployment tools (e.g., Kubernetes), and AWS cloud services (Lambda, S3, DMS, Step Functions, Event Bridge, Cloud Watch, RDS) is required. Familiarity with Databricks/ETL processes and ITIL principles is also expected. Excellent communication, problem-solving, and troubleshooting skills are crucial, as is the ability to thrive in a dynamic environment and adapt to evolving business needs. Commitment to continuous integration and delivery principles is a plus.

Familiarity with tools and technologies such as Power BI, Informatica Intelligent Cloud Services (IICS), and Tidal will be considered an added advantage. We encourage proactive learning and cross-skilling within our innovative team. A Databricks Associate Certification and ITIL 4 Foundation Level Certification are advantageous.

EY Global Delivery Services (GDS) offers a dynamic, global delivery network with opportunities for continuous learning, success defined by you, transformative leadership, and a diverse and inclusive culture. We provide the tools and flexibility to make a meaningful impact your way, empowering you to be the leader the world needs. Join us to build an exceptional experience for yourself and contribute to building a better working world.