Azure Databricks ETL Pipeline Speci...

We are seeking an Azure Databricks ETL Pipeline Specialist with DevOps experience to join our team. This role involves designing, developing, and maintaining robust data pipelines utilizing Azure Databricks. You will collaborate closely with cross-functional teams to define and prioritize project requirements. A key responsibility will be developing and ensuring the accuracy, integrity, and consistency of ETL processes. The ideal candidate will be adept at troubleshooting and resolving data pipeline failures or errors promptly, and continuously optimizing data pipeline performance for improved efficiency, scalability, and reliability. Furthermore, you will be responsible for implementing and maintaining best practices for CI/CD, monitoring, and automation. Ensuring adherence to all security and regulatory standards across data operations is paramount. Participation in code reviews and providing technical mentorship to team members will also be expected. This permanent position offers an opportunity to work with advanced cloud technologies and contribute to critical data initiatives.