LLM Operations Engineer

Accenture is seeking an LLM Operations Engineer in Bengaluru, India, to leverage cloud-native services and tools for scalable and efficient deployment of Large Language Models (LLMs). The role involves monitoring LLM performance, addressing operational challenges, and ensuring compliance and security standards in AI operations. Key responsibilities include contributing to solutions, assisting in developing best practices for LLM operations, and collaborating with data scientists and engineers to optimize model performance. This position requires proficiency in LLMs, and experience with Prompt Engineering and Generative AI is beneficial. A strong understanding of cloud-native services, deployment strategies, monitoring tools, and AI compliance/security standards is essential. A minimum of 2 years of experience in LLMs and 15 years of full-time education are required. This is a permanent position based at our Bengaluru office.