
AI/ML DevOps Engineer
Responsibilities
Qualifications & Requirements
Experience Level: Mid Level
Full Job Description
NTT DATA is seeking an experienced AI/ML DevOps Engineer to join their team in Noida, Chennai, Bengaluru, Pune, or Uttar Pradesh, India. This hands-on role focuses on designing, building, and maintaining Infrastructure-as‑Code (IaC) using Terraform to provision and manage Azure AI/ML services. The position requires a blend of engineering expertise in Terraform, CI/CD pipelines (Azure DevOps/GitHub Actions), Azure Kubernetes Service (AKS), and security, alongside coordination skills for Kanban flow, cross-team alignment, and risk management. The goal is to enable safe, repeatable deployments of AI workloads and onboard application teams to the bank's Azure-based AI Platform.
Key responsibilities include:
- Developing IaC modules and reusable Terraform templates for provisioning Azure AI/ML resources such as Azure OpenAI/AI Studio, Azure ML, Cognitive Search, Key Vault, Storage, and networking components.
- Automating deployment pipelines for planning, applying changes, policy checks, and environment promotions, integrating secrets management, approvals, and drift detection.
- Implementing access and identity solutions using Microsoft Entra ID patterns, including app registrations, groups, roles, and Role-Based Access Control (RBAC) for application teams and automation. A strong understanding of Entra ID security is essential.
- Supporting AKS-based deployments and platform integrations, including ingress, image management, namespaces, and quotas for AI services running on Kubernetes.
- Enhancing security and governance by embedding guardrails such as Azure Policy, role assignments, private endpoints, tagging strategies for FinOps, and establishing logging/monitoring baselines.
- Utilizing Python or Bash scripting for IaC tooling and deployment assistance.
- Experience with codifying policies and controls using tools like OPA/Conftest and Azure Policy as Code, along with cost governance tagging, is required.
Company
NTT DATA
NTT DATA is a global business and technology services leader, recognized by its presence in 75% of the Fortune Global 100. With a strong commitment to accelerating client success and fostering positiv...