
Senior Data Engineer
Responsibilities
Qualifications & Requirements
Experience Level: Senior Level
Full Job Description
Senior Data Engineer - Python - Chennai, India
Join NielsenIQ's Connect Technology team and build cutting-edge technology that drives global business decisions. You will be instrumental in developing our new Connect platform, a unified, global, open data ecosystem built on Microsoft Azure. Our clients worldwide depend on the data and insights from Connect to fuel their innovation and growth.
As a Senior Data Engineer, you will collaborate with a team of highly skilled technologists passionate about leveraging and advancing technologies such as Python, Pyspark, SQL, Hive, Databricks, and Airflow. Our infrastructure is managed using robust DevOps pipelines, including Azure, Kubernetes, GitHub Actions, and Git.
Responsibilities:
- Develop, troubleshoot, debug, and enhance applications, with Python and SQL as primary development languages.
- Build new backend functionalities in close collaboration with the frontend team.
- Contribute to the expansion of the NRPS scope.
Qualifications:
Must-haves:
- 5-10 years of relevant software engineering experience.
- Strong proficiency in Python.
- Solid understanding of Big Data technologies, including Python, Pyspark, SQL, Hive, and Airflow.
- Proficiency in SQL.
Good-to-haves:
- Experience with Scala and Databricks.
- Experience with Linux and KSH.
- Familiarity with DevOps tools like Git, GitHub Actions, and Docker.
- Experience in the Retail Domain.
- Excellent English communication skills, enabling effective collaboration with cross-functional technology teams and business stakeholders.
- Minimum Bachelor's degree in Computer Science, Computer Engineering, or a related field.
Company
NielsenIQ
NielsenIQ: Global Leader in Consumer IntelligenceNielsenIQ is a premier global measurement and data analytics company. We offer the most comprehensive and reliable insights into consumer and market be...