Senior DevOps Engineer

Role Overview

We are seeking a Senior DevOps Engineer to support Data Operations Engineering at our new Pune IT Innovation Hub. You will own the operational backbone of global data platforms across AWS and Azure, including Databricks and Snowflake environments.

Your Impact Areas:

• Build modular Terraform components for cloud provisioning (Databricks workspaces, networking, Unity Catalog).
• Design automated GitLab CI/CD pipelines with approval gates and controlled promotions.
• Monitor data quality, own first-line response to production alerts, and automate remediation runbooks.
• Build end-to-end observability across Databricks, Snowflake, and orchestration services using tools like Datadog or Grafana.
• Containerize workloads on Docker/Kubernetes (EKS/AKS) and migrate Apache Airflow to managed Kubernetes environments.
• Embed security operations: secrets management, least-privilege access, encryption key policies, and audit logging.
• Drive cloud cost optimization through attribution, right-sizing, tagging standards, and anomaly alerting.

Required Qualifications:

• Bachelor's in CS/Engineering with 5+ years of experience in DevOps/SRE/cloud infrastructure.
• Hands-on experience administering workloads on AWS and Azure (identity, networking, storage).
• Expertise in Terraform for modular reusable infrastructure across multiple environments.
• Proven design/maintenance of CI/CD pipelines using GitLab CI with environment promotion strategies.
• Strong proficiency with Docker, Kubernetes (EKS/AKS), and running CI runners on these platforms.
• Operating Apache Airflow: DAG deployment, scheduling, backfills, pools, failure recovery.
• Solid Linux sysadmin skills, shell scripting, troubleshooting, and observability tooling.

Nice to Have:

• Databricks/Snowflake administration experience (Asset Bundles, Unity Catalog).
• Keyless authentication via OIDC or IRSA.
• Azure Data Factory, ADLS Gen2, Key Vault, Entra ID expertise.
• Certifications in AWS/Azure/Kubernetes/Terraform.

About the Team

You will exercise judgment on complex platform problems with general direction focused on end results. Participation in an on-call rotation may be required to support 24/7 platform reliability.