Azure Databricks ETL Pipeline Speci...

We are seeking an Azure Databricks ETL Pipeline Specialist with DevOps expertise to join our team in Mumbai. In this role, you will be instrumental in building and managing robust ETL workflows utilizing Azure Databricks and Azure Data Factory. You will also develop and implement automation and deployment pipelines, leveraging Azure DevOps and Jenkins for continuous integration and delivery.

Key responsibilities include working with containerization and orchestration technologies like Kubernetes and Docker, developing scripts and applications using Python, Java, and Spark, and managing both SQL and NoSQL databases for efficient data storage and processing. Maintaining version control and fostering team collaboration through Git is essential. You will also support Linux/Unix environments, troubleshoot infrastructure challenges, and ensure the high availability, scalability, and optimal performance of our cloud-based systems.