EY - GDS Consulting - AI and DATA -...

Join EY's Global Delivery Services (GDS) Consulting team in Bengaluru as a Senior Responsible AI Engineer. In this role, you will lead the engineering efforts for AI governance, safety, and compliance. This involves operationalizing LLMOps/Agentic Ops, implementing robust security and privacy controls, and developing evaluation frameworks and ethical guardrails for production AI systems. Your responsibilities will range from policy definition to practical code implementation, covering frameworks, controls, tooling, documentation, red teaming, and continuous evaluation.

Key responsibilities include establishing and managing LLMOps/Agentic Ops practices (lifecycle, approvals, versioning, observability, incident response) integrated with platform tooling. You will define and enforce governance and security controls for PII protection, data residency, model access, content safety, and defense against jailbreaking/prompt injection, integrating with enterprise security systems. Building LLM evaluation pipelines for groundedness, toxicity, bias, and robustness, along with quality gates for pre-production and post-deployment monitoring, is crucial. You will also implement guardrails and ethical measures through policy-as-code, allow/deny lists, safety filters, and red teaming harnesses, ensuring compliant documentation such as model cards and data sheets. Furthermore, you will contribute production-grade Python libraries, policies, and APIs for easy adoption by product teams and collaborate with platform teams on AWS/Azure controls.

Must-have skills include expertise in LLMOps/Agentic Ops patterns and tooling, governance and security (including threat modeling for LLMs, privacy, and access controls), LLM evaluation frameworks (human and automatic metrics, evaluation harnesses), guardrails/ethics techniques, incident playbooks, Python, AWS/Azure, and API development for governance services.

A good-to-have skill is familiarity with RAG/advanced agentic AI to guide safe design choices.

Qualifications include a B.Tech/M.Tech/MS in Computer Science/Electrical Engineering or equivalent, with 4+ years of experience in Responsible AI Engineering.