Staff Machine Learning Engineer

Staff Machine Learning Engineer at ServiceNow - Hyderabad, India

ServiceNow is seeking a Staff Machine Learning Engineer to join our AI Agents Engineering platform team in Hyderabad, India. In this pivotal role, you will lead the design, development, and implementation of advanced AI-driven solutions, shaping the future of conversational AI and enterprise-level platforms powered by natural language processing and Large Language Models (LLMs).

This position demands both deep technical expertise and strategic leadership. You will be instrumental in guiding solution architecture, mentoring fellow engineers, and driving innovation in critical areas such as agent memory, orchestration, and evaluation. The ideal candidate is a strategic thinker, a sharp problem solver, and a hands-on technologist passionate about building scalable, high-performance AI solutions.

Key Responsibilities:

• Lead the design and architecture of Agentic AI solutions, encompassing agent reasoning, memory, and orchestration pipelines.
• Oversee end-to-end solution delivery, including design, development, optimization, and deployment of AI/ML systems, ensuring scalability, reliability, and performance.
• Build and refine AI applications utilizing modern frameworks like LangChain, LangGraph, and SDKs/APIs from OpenAI/Anthropic, with a strong emphasis on prompt engineering and pipeline optimization.
• Provide technical leadership through mentoring engineers, conducting code reviews, establishing best practices, and fostering a culture of innovation and collaboration.
• Collaborate closely with data scientists, product managers, architects, and leadership to translate business requirements into impactful technical solutions.
• Stay abreast of emerging LLM/Agentic AI advancements and integrate new techniques into the platform.
• Share insights internally and externally through blogs, presentations, or papers to contribute to thought leadership in LLM and Agentic AI.

Qualifications:

• Extensive experience with methods for training and fine-tuning large language models, including distillation, supervised fine-tuning, and policy optimization.
• 8+ years of experience in designing and implementing complex enterprise applications, with a proven track record in conversational AI and NLP platforms.
• Demonstrated experience in developing LLM-based features and prompt engineering.
• Strong development proficiency in Java and Python for production-grade AI systems.
• Expertise in LLM-powered applications, including familiarity with LangChain, LangGraph, and OpenAI/Anthropic APIs.
• Deep understanding of Agentic reasoning pipelines, evaluation frameworks, and advanced NLP techniques.
• Exceptional problem-solving abilities, a bias for action, a customer-first mindset, and the capacity to thrive in fast-paced environments.
• Analytical expertise in evaluating model performance, optimizing inference costs, and enhancing system efficiency.
• Proven ability to translate complex AI concepts into business value and communicate effectively with both technical and non-technical stakeholders.
• Experience providing technical leadership and guiding successful AI/ML engineering projects.
• Bonus: Publications, technical blogs, or open-source contributions in the LLM/AI space.
• Nice to have: Experience with AI Productivity tools such as Cursor, Windsurf, etc.