Senior Machine Learning Engineer

Senior Machine Learning Engineer - Agentic Engineering Platform

ServiceNow is seeking a Senior Machine Learning Engineer to join our Agentic Engineering platform team in Hyderabad, India. In this role, you will be instrumental in designing, developing, and optimizing AI and Generative AI (GenAI) solutions. You will focus on building scalable LLM-powered applications, with an emphasis on agent memory, orchestration, and evaluation frameworks, to drive the next generation of AI agents.

This position is ideal for highly motivated engineers passionate about hands-on coding, tackling complex challenges, and leveraging cutting-edge AI/ML technologies to deliver significant business value.

Key Responsibilities

• Design, implement, and optimize LLM pipelines utilizing frameworks such as LangChain, LangGraph, and APIs from OpenAI/Anthropic.
• Develop clean, efficient, and scalable code in Python and Java, adhering to best practices in ML engineering and enterprise application development.
• Create and refine prompt engineering strategies and agent reasoning workflows to enhance accuracy and reliability.
• Build and maintain robust evaluation frameworks for measuring model performance, including custom metrics for agent instructions and reasoning.
• Debug, profile, and optimize inference pipelines for latency and cost efficiency at scale.
• Collaborate effectively with data scientists and product teams to translate business requirements into technical solutions.
• Engage in end-to-end development, from initial prototyping through to production deployment within enterprise environments.
• Continuously research and apply the latest advancements in LLMs, agentic AI, and orchestration frameworks.

Qualifications

• Minimum of 5 years of hands-on experience in ML/AI engineering, with a proven track record in building and deploying AI/GenAI applications.
• Proficiency in Python (including ML libraries and GenAI/LLM frameworks) and Java (for enterprise application development and OOP).
• Practical experience with LLM frameworks like LangChain and LangGraph, as well as vendor SDKs/APIs (e.g., OpenAI, Anthropic).
• Strong skills in prompt engineering and designing agentic reasoning pipelines.
• Solid understanding of ML evaluation techniques and experience in implementing model monitoring and metrics.
• Demonstrated ability to debug and optimize inference pipelines for performance and cost-effectiveness.
• Excellent problem-solving abilities and experience working in fast-paced, agile development environments.
• Bonus: Experience with AI productivity tools (e.g., Cursor, Windsurf).
• Bonus: Experience with methods for training and fine-tuning large language models (e.g., distillation, supervised fine-tuning, policy optimization).
• Bonus: Contributions to open-source projects, technical blogs, or publications in the LLM/GenAI space.