LLM Operations Engineer

Accenture is seeking an experienced LLM Operations Engineer for its Bengaluru/Bangalore, India operations. This role focuses on deploying, monitoring, and optimizing Large Language Models (LLMs) within a cloud-native environment. You will be responsible for ensuring the scalable and efficient deployment of LLMs, actively monitoring their performance, and addressing operational challenges. A key aspect of this position involves maintaining compliance with security standards in AI operations. The ideal candidate will work collaboratively with cross-functional teams, contribute to the development of best practices for LLM operations, and assist in optimizing model performance. This is a permanent role requiring a strong understanding of cloud-native services, deployment strategies, LLM proficiency, and familiarity with monitoring tools. Experience in Prompt Engineering and Generative AI is considered a strong asset. A minimum of 2 years of experience in LLMs is required, along with 15 years of full-time education.