Senior Data Engineer

About the Role

We are seeking a Senior Data Engineer with strong practical experience in data engineering and pipeline development. The ideal candidate will possess deep expertise in Python, SQL, Delta Lake, Apache Spark/PySpark, and cloud platforms like Microsoft Azure or Databricks.

Key Responsibilities:

• Design and develop robust ETL/ELT patterns for data ingestion and transformation pipelines.
• Leverage lakehouse architectures (Delta tables) to manage relational and non-relational data sources effectively.
• Optimize performance through advanced data modeling, partitioning, indexing, and governance strategies.
• Integrate enterprise systems via REST APIs and file-based interfaces while ensuring high-quality data standards.
• Collaborate using Git and CI/CD practices to streamline deployment workflows.

Preferred Skills:

• Familiarity with Microsoft Fabric, Azure Data Factory, OneLake, and enterprise data warehouse concepts (dimensional modeling).
• Experience with streaming technologies like Kafka and event-driven architectures.
• Proficiency in infrastructure automation for cloud deployment.