Data Engineer

About The Role

As a Data Engineer, you will design, develop, and maintain robust data solutions for data generation, collection, and processing. Your responsibilities will include creating efficient data pipelines, ensuring high data quality, and implementing comprehensive ETL (extract, transform, and load) processes for seamless data migration and deployment across various systems. You will collaborate with cross-functional teams to thoroughly understand data requirements and deliver effective, business-aligned solutions. Additionally, you will be involved in troubleshooting complex data issues and optimizing data workflows to significantly enhance efficiency and performance.

Roles & Responsibilities

• Expected to be a Subject Matter Expert (SME).
• Collaborate with and manage the team to perform assigned tasks effectively.
• Take responsibility for team decisions and project outcomes.
• Engage with multiple teams and contribute to key strategic decisions.
• Provide innovative solutions to problems affecting their immediate team and across multiple teams.
• Mentor junior team members to enhance their technical skills and knowledge base.
• Continuously evaluate and improve data processes to ensure optimal performance and scalability.

Professional & Technical Skills

Must-Have Skills:

• Proficiency in Databricks Unified Data Analytics Platform.

Good-to-Have Skills:

• Experience with Apache Spark and data warehousing solutions.
• Strong understanding of data modeling and database design principles.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Familiarity with programming languages such as Python or Scala for data processing.

Additional Information

The candidate should have a minimum of 7.5 years of overall experience, with at least 5 years of dedicated experience in the Databricks Unified Data Analytics Platform. A 15-year full-time education is required. This position is based at our Pune office.