Staff Machine Learning Engineer - AI Agents Engineering

ServiceNow is seeking a Staff Machine Learning Engineer to join our AI Agents Engineering platform team in Hyderabad, India. This role is pivotal in shaping the future of conversational AI by developing enterprise-level platforms powered by advanced natural language processing and Large Language Models (LLMs).

You will lead the design, development, and implementation of AI-driven solutions, focusing on key areas such as agent reasoning, memory, orchestration, and evaluation. This position demands both deep technical expertise and strategic leadership, requiring you to guide solution architecture, mentor engineers, and drive innovation.

The ideal candidate is a strategic thinker, sharp problem solver, and hands-on technologist passionate about building scalable, high-performance AI solutions.

Key Responsibilities

• Lead the design and architecture of Agentic AI solutions, including agent reasoning, memory, and orchestration pipelines.
• Own end-to-end solution delivery: design, development, optimization, and deployment of AI/ML systems ensuring scalability, reliability, and performance.
• Build and refine AI applications using modern frameworks (LangChain, LangGraph, OpenAI/Anthropic SDKs/APIs), with a strong focus on prompt engineering and pipeline optimization.
• Provide technical leadership: mentor engineers, review code, set best practices, and foster a culture of innovation and collaboration.
• Collaborate closely with data scientists, product managers, architects, and leadership to translate business requirements into impactful technical solutions.
• Stay at the forefront of emerging LLM/Agentic AI advancements, integrating new techniques into the platform.
• Share insights internally and externally through blogs, presentations, or papers to advance thought leadership in LLM and Agentic AI.

Qualifications

• Experience with methods of training and fine-tuning large language models, such as distillation, supervised fine-tuning, and policy optimization.
• 8+ years of experience designing and implementing complex enterprise applications, with proven success in conversational AI and NLP platforms.
• Experience developing LLM-based features. Prompt engineering experience is a plus.
• Strong development skills in Java and Python for production-grade AI systems.
• Expertise in LLM powered applications, including LangChain, LangGraph, and OpenAI/Anthropic APIs.
• Deep understanding of Agentic reasoning pipelines, evaluation frameworks, and advanced NLP techniques.
• Strong problem-solving abilities with a bias for action, customer-first mindset, and ability to thrive in fast-paced environments.
• Analytical expertise in evaluating model performance, optimizing inference costs, and improving system efficiency.
• Proven ability to translate complex AI concepts into business value and communicate effectively with technical and non-technical stakeholders.
• Experience providing technical leadership and guiding successful AI/ML engineering projects.
• Bonus: Publications, technical blogs, or open-source contributions in LLM/AI.
• Experience with AI Productivity tools such as Cursor, Windsurf, etc., is a plus.