Azure Data Engineer - SQL / Python

Forward Eye Technologies is seeking a skilled Azure Data Engineer with expertise in SQL and Python to join our team. This role involves designing, developing, and implementing robust ETL pipelines for continuous integration and deployment. You will collaborate with data scientists and engineers to define data requirements and optimize data solutions. Key responsibilities include ensuring data quality through cleansing, mapping, and transformation, automating tasks with production-standard code, and loading transformed data into various storage and reporting structures. You will also be responsible for extracting data, troubleshooting data warehouse issues, implementing best practices for pipeline building and governance, and ensuring compliance with security and data privacy standards. A strong focus will be placed on solution design using Microsoft Azure services.

Key Responsibilities:

• Design, develop, and implement ETL pipelines for continuous integration and deployment.
• Collaborate with data scientists and engineers to understand data requirements and optimize data solution processes.
• Ensure data is cleansed, mapped, transformed, and optimized for storage and use.
• Automate tasks and deploy production-standard code with unit testing, continuous integration, and versioning.
• Load transformed data into data warehouses, high-speed indexes, real-time reporting systems, and analytics applications.
• Build data pipelines to consolidate data.
• Extract data, troubleshoot, and maintain the data warehouse.
• Implement best practices for pipeline building and governance.
• Troubleshoot and resolve issues related to pipeline deployment and performance.
• Ensure compliance with security and data privacy standards.
• Solution design using Microsoft Azure services and other tools.

Required Skills and Experience:

• 2-3 years of experience in Azure Data Analytics, Synapse, and DevOps.
• Proficiency in programming languages such as Python, SQL, Py-Spark, and Spark-SQL.
• Experience with Azure services including ADLS, Synapse, Stream Analytics, SQL DW, Analysis Services, Serverless Architecture, and ARM Templates.
• Experience with cloud platforms like Azure, AWS, and their respective services.
• Knowledge of CI/CD pipelines, automation tools, and version control systems like Git.
• Strong problem-solving skills and ability to troubleshoot complex issues.
• Experience with monitoring tools.
• Ability to work collaboratively in cross-functional teams.

Nice to Have:

• Data Engineer certification from Azure or AWS.
• Experience with Azure Synapse Studio, Data Bricks, or Fabric.
• Familiarity with agile software development lifecycles (SCRUM, Kanban, etc.).

Locations: Mumbai, Bengaluru, Delhi/NCR, Hyderabad, Ahmedabad, Pune, Chennai, Kolkata.