Data Engineer
Full Job Description
Role Overview
We're passionate about building seamless digital experiences powered by robust and intelligent data systems. We are on the lookout for a Data Engineer - Senior to architect and maintain high-performance data platforms that fuel decision-making and innovation.
If you enjoy designing scalable pipelines, optimizing data systems, and leading with technical excellence, you'll thrive in our fast-paced, outcome-driven culture located in New Delhi.
Key Responsibilities
- Take ownership of building reliable, secure, and scalable data infrastructure from streaming pipelines to data lakes.
- Design and manage Apache Airflow pipelines for high-volume sensor, satellite, and third-party data ingestion.
- Build and optimize Apache Spark workloads for batch processing, geospatial analytics, and large-scale aggregations.
- Develop and maintain PostgreSQL, TimescaleDB, PostGIS, and DuckDB-based data solutions.
- Implement efficient data ingestion, transformation, and bulk-loading pipelines in air-gapped environments using Docker.
- Create technical documentation, data models, and operational runbooks to ensure data quality and lineage observability.
Requirements
You must have 6+ years of experience in Data Engineering with strong proficiency in Python, SQL, Airflow, Spark, and PostgreSQL. Experience with geospatial/time-series data is essential.
Benefits & Culture
- Top-Tier Work Setup: Premium MacBook and accessories provided.
- Flexible Schedules: Flexible working hours, emergency work-from-home days, and utility support.
- Growth Opportunities: Conferences, courses, certifications funded; dedicated educational allowance.
- Rewards & Care: Family-first culture with maternity/paternity leaves, birthday vouchers (Amazon/BookMyShow), quarterly bonuses for performance, and weekend work incentives.
Company
Spark Eighteen
Spark Eighteen (GKM IT) is a premier player in the Indian IT services sector, specializing in building seamless digital experiences through robust data systems.Their engineering teams are renowned for...