Senior Data Engineer

About the Role

We are seeking a Senior Data Engineer (APAC Region) based in Pune Division, Maharashtra, India. The ideal candidate will be responsible for designing, building, and operating scalable data pipelines on the Databricks platform.

Key Responsibilities:

• Data Pipeline Development & Operations: Develop end-to-end workflows from ingestion to consumption; implement robust error handling and monitoring; optimize performance via efficient Spark job design;
  
• Legacy Code Modernization: Refactor legacy code to PySpark, migrate ETL processes to ELT patterns, ensure data integrity during migration,
  
• Data Engineering Excellence: Implement quality checks, maintain Delta Lake tables, develop reusable frameworks, and adhere to CI/CD best practices;
  
• Collaboration & Mentorship: Work cross-functionally with architects, analysts, and infrastructure teams; mentor junior engineers on PySpark/Databricks.