Data Engineer (Middle/Senior) ID42376

As a Middle/Senior Python & Data Engineer at AgileEngine in India, you will enhance data quality and accelerate integration test cycles within the climate data platform. You'll develop and maintain Python-based workflows, robust validation frameworks, and automation pipelines while collaborating with cross-functional teams to deliver high-quality climate data products. This role offers hands-on experience with Airflow, Pandas, Kubernetes, and Azure.

Key Responsibilities:

• Develop, test, and maintain the Python-based data processing framework.
• Scrutinize and enhance the Data Quality Framework.
• Design and maintain the technical components of release processes.
• Socialize and communicate release processes with multiple stakeholders.
• Lead the integration testing process to improve stability and reliability.

Required Skills:

• 4+ years of experience in Python engineering with expertise in building and automating data workflows.
• Experience with Azure cloud services.
• Proficiency with Airflow, Pandas, and Kubernetes (K8s).
• Upper-intermediate English level.

Preferred Skills:

• Experience with PySpark, Databricks, Data Lakes, and Parquet.
• Knowledge of RDBMS concepts.
• Familiarity with data quality checks and analytical thinking.
• Experience in designing and maintaining testing frameworks.

Benefits:

• Remote work & Local connection: Work remotely and connect with your team through periodic meet-ups.
• Legal presence in India: Full local compliance with a structured work environment.
• Competitive Compensation in INR: Competitive salary in INR with budgets for growth, education, and wellness.
• Innovative Projects: Leverage the latest tech for world-recognized clients.

AgileEngine, an Inc. 5000 company, specializes in crafting award-winning software for Fortune 500 brands and innovative startups across diverse industries. We are recognized as leaders in application development and AI/ML, fostering a people-first culture that has earned us multiple Best Place to Work awards. Join us to grow, make an impact, and collaborate with a team that values care and innovation.