Senior Consultant

EY is seeking a Senior Consultant in Tech Consulting, specializing as a Data Engineer, for their Pune (Mumbai, MH, IN, 400028) office. This role requires 5+ years of experience.

The opportunity involves joining EY's data engineering team as a Data Engineer. The primary focus will be on developing and optimizing big data processing and analytics solutions using Apache Spark and Scala. You will collaborate with data scientists, analysts, and other developers to build scalable and reliable data transformation systems.

Key Responsibilities include designing, building, and maintaining high-performance data processing pipelines with Apache Spark and Scala. You will develop ETL processes for ingesting, transforming, and storing large volumes of data from diverse sources. Optimizing Spark jobs for performance and cost efficiency, and collaborating with cross-functional teams to understand data requirements and deliver business-aligned solutions are crucial. The role also involves writing clean, maintainable, and well-documented code, ensuring data quality, implementing data governance standards, and troubleshooting data pipeline issues. Staying updated with the latest big data technologies and contributing to the data platform's evolution is expected.

Required Technical Skills: Proven experience with Apache Spark and Scala programming, strong understanding of distributed computing principles and big data architectures. Experience with Hadoop ecosystem components (HDFS, YARN, Hive, etc.) is a plus.

Qualifications: Bachelor’s degree in Information Technology, Computer Science, Management Information Systems, or equivalent work experience. Soft Skills: Strong communication and collaboration abilities, with the capacity to influence across teams. Minimum of 5 years of experience in data engineering.

The ideal candidate will possess a practical, problem-solving approach, delivering insightful and practical solutions. We seek individuals who are agile, curious, mindful, adaptable, and creative.