Senior Data Engineer

Experian is seeking a Senior Data Engineer to join our team in Hyderabad, India. In this role, you will be instrumental in designing, developing, and supporting robust ETL data pipeline solutions, primarily within the AWS environment.

Key Responsibilities:

• Design, develop, and maintain scalable ETL processes to extract meaningful insights from large and complex datasets.
• Collaborate with a team to build and support our data warehouse, implementing solutions using PySpark for processing structured and unstructured data.
• Play a crucial role in developing a semantic layer through the creation of ETLs and virtualized views.
• Partner with Engineering teams to discover and integrate new data sources into our environment.
• Support and troubleshoot existing ETL processes written in SQL, and leverage third-party APIs with Python, resolving production issues effectively.
• Utilize strong SQL skills to understand and resolve complex existing SQL queries.
• Apply hands-on experience with Apache Airflow or equivalent tools (such as AWS MWAA) for orchestrating data pipelines.
• Create and maintain report specifications and process documentation for required data deliverables.
• Act as a liaison between business and technical teams to achieve project objectives and deliver cross-functional reporting solutions.
• Troubleshoot and resolve data, system, and performance-related issues.
• Communicate effectively with business partners, technical teams, and management to gather requirements, articulate data deliverables, and present technical designs.

Qualifications:

• Completed graduation in BE/B.Tech.
• 6 to 9 years of experience in Data Engineering development.
• 5 years of experience in Python scripting.
• 8 years of experience in SQL, with 5+ years in Data Warehousing.
• 5 years of experience in Agile development methodologies.
• 3 years of experience working with cloud platforms.
• 3 years of experience with the AWS ecosystem, including Redshift, EMR, S3, and MWAA.
• Proficiency in CI/CD tools such as Jenkins or GitLab.

Experian fosters a culture that celebrates individuality and innovation. We are committed to our people agenda, focusing on DEI, work-life balance, professional development, authenticity, collaboration, wellness, and recognition. Our award-winning approach to people management has been recognized by Fortune's World's Best Workplaces™ 2024, Great Place To Work™ in 24 countries, and Glassdoor's Best Places to Work 2024.

Experian is an Equal Opportunity and Affirmative Action employer. We believe that a diverse workforce drives our success. Everyone can thrive at Experian and bring their authentic selves to work, regardless of gender, ethnicity, religion, color, sexuality, physical ability, or age. Please inform us of any disability or special needs requiring accommodation.

#LI-Onsite

Benefits include comprehensive family well-being benefits, enhanced medical benefits, and paid time off, prioritizing employee work-life balance, health, safety, and wellbeing.