
AI/ML DevOps Engineer
Responsibilities
Qualifications & Requirements
Experience Level: Mid Level
Full Job Description
NTT DATA is seeking an experienced AI/ML DevOps Engineer to join our team in Noida, Chennai, Bengaluru, Pune, or Uttar Pradesh, India. This role is integral to designing, building, and maintaining Infrastructure-as-Code (IaC) templates using Terraform to provision and manage Azure AI/ML services for various application teams. You will combine engineering expertise in Terraform, CI/CD pipelines, Azure Kubernetes Service (AKS), and security with coordination skills, including Kanban flow management, cross-team alignment, and risk/issue tracking, to expedite secure and repeatable AI workload deployments onto the bank's Azure AI Platform. Key responsibilities include engineering IaC modules and reusable Terraform templates for provisioning Azure AI/ML resources such as Azure OpenAI/AI Studio, Azure ML, Cognitive Search, Key Vault, Storage, and networking. You will automate deployment pipelines using Azure DevOps or GitHub Actions, integrating features like plan/apply, policy checks, environment promotion, secret management, approvals, and drift detection. A significant focus will be on establishing access and identity management using Microsoft Entra ID patterns, including app registrations, group/role management, and RBAC, to support both application teams and automation initiatives. Experience with AKS-based deployments and platform integrations for AI services running on Kubernetes is essential. You will also be responsible for hardening and governing the platform by embedding guardrails through Azure Policy, role assignments, private endpoints, implementing tagging and FinOps practices, and establishing logging/monitoring baselines. Scripting proficiency in Python or Bash for IaC tooling and deployment helpers is required, along with experience in codifying policies and controls using tools like OPA/Conftest and Azure Policy as Code, and managing cost governance tags.
Company
NTT DATA
NTT DATA is a global leader in business and technology services, generating $30 billion in revenue and serving 75% of the Fortune Global 100. We are dedicated to accelerating client success and foster...