Senior Data Engineer

Role Overview

We are seeking a passionate Azure Data Engineer with over 4 years of expertise to join AB InBev GCC in Bengaluru. This role focuses on leveraging GenAI solutions and Azure services to drive growth for critical business functions including operations, finance, people, and technology.

Purpose of the Role

You will play a pivotal part in designing, building, and optimizing scalable data pipelines while integrating AI-driven solutions to enhance our data capabilities. We look for individuals with passion, talent, curiosity, and an undying love for beer!

Key Tasks & Accountabilities

• Data Pipeline Development: Design and implement efficient ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Databricks (ADB). Ensure high performance and scalability.
• Relational Database Management: Work with relational databases to structure and query data efficiently; design, optimize, and maintain database schemas.
• Programming and Scripting: Write, debug, and optimize Python, PySpark, and SQL code. Develop reusable components for processing large datasets.
• Data Quality and Governance: Implement validation, cleansing, monitoring mechanisms ensuring compliance with best practices.
• Performance Optimization: Identify bottlenecks in data processing/storage on Azure services to optimize resource utilization.
• Collaboration: Work closely with cross-functional AI, analytics, and product teams. Document processes effectively.

Qualifications & Skills

• Bachelor's degree in Computer Science or related field.
• 4+ years of data engineering experience.
• Proficiency in Azure Data Factory (ADF) and Databricks (ADB).
• Expertise in relational databases, advanced SQL, Python, PySpark.
• Familiarity with GenAI solutions is a plus; knowledge of machine learning pipelines and workflows required.
• Experience with CI/CD pipelines for data workflows preferred.