Data Engineer

Policybazaar.com, a leading fintech player and India's largest insurance marketplace, is seeking an experienced Data Engineer for its Gurugram, India, location. This permanent role offers the opportunity to work on key projects including OLAP data modeling, data warehousing, and building cloud-based ETL pipelines. You will leverage AWS technologies such as EMR, Lambda, S3, SQS, EC2, and Glue, alongside orchestration tools like Airflow and Kubernetes. The role emphasizes learning and applying best practices throughout the development lifecycle, including coding standards, code reviews, source management, build processes, testing, and operations.

Key responsibilities include:

• Designing and implementing data models for OLAP and warehousing.
• Developing and maintaining ETL pipelines on cloud platforms.
• Utilizing AWS services for data engineering tasks.
• Orchestrating data workflows with Airflow and Kubernetes.
• Collaborating with business stakeholders to understand requirements and deliver actionable data insights for pattern recognition and anomaly detection.

Required qualifications include 1-3 years of data engineering experience, proficiency in SQL and NoSQL databases, practical knowledge of Linux/Unix shell scripting, and experience with at least one programming language like Python or Javascript. Preferred qualifications include experience with emerging technologies like Kafka and ClickHouse, column-oriented data, big data technologies (Hadoop, Hive, Spark, EMR), non-relational databases, and distributed systems for data storage and computing.