EY - GDS Consulting - AI And DATA -...
Responsibilities
Qualifications & Requirements
Experience Level: Senior Level
Full Job Description
Join EY's GDS Consulting team in Kolkata, West Bengal, as an AI and Data specialist focusing on Azure Databricks. We are seeking a skilled Data Engineer with expertise in Databricks and Python scripting to elevate our ETL (Extract, Transform, Load) processes. You will play a key role in designing, building, and maintaining scalable data pipelines, developing robust ETL processes to ingest and transform data, and collaborating with cross-functional teams to deliver data engineering solutions aligned with business objectives.
Key responsibilities include writing and optimizing Python scripts for data manipulation, ensuring data quality and integrity through best practices, and monitoring/troubleshooting ETL processes. You will also be responsible for documenting data engineering processes and staying abreast of industry advancements. This role offers an innovative and dynamic work environment with a strong emphasis on delivering high-quality data solutions and the opportunity to contribute to impactful projects with a diverse team of data professionals.
- Responsibilities: Design, build, and maintain scalable data pipelines using Databricks and Python. Develop ETL processes for data ingestion and transformation. Collaborate with teams to gather requirements and deliver data engineering solutions. Write and optimize Python scripts for ETL tasks. Ensure data quality and integrity. Monitor and troubleshoot ETL processes. Document data engineering processes and architectures. Stay current with data engineering trends.
- Qualifications: Bachelor's degree in Computer Science, Information Technology, or a related field. Minimum 2 years of experience in data engineering, focusing on Databricks and Python scripting for ETL. Strong understanding of data warehousing concepts and experience with SQL/NoSQL databases. Proficiency in Python and data engineering libraries. Experience with cloud platforms (AWS, Azure) and big data technologies is a plus. Excellent problem-solving skills and attention to detail. Ability to work independently and collaboratively.
Company
EY
EY is a global leader dedicated to building a better working world. We foster an inclusive culture and provide the global scale, support, and technology for our people to thrive and achieve their full...