Software Engineer II - GenAI / LLM Engineer at Blue Yonder, Bengaluru / Bangalore, India

Blue Yonder is seeking a talented Software Engineer II with a specialization in Generative AI (GenAI) and Large Language Models (LLMs) to join our team in Bengaluru / Bangalore, India. This is a permanent, full-time position focused on building intelligent, multi-agent applications for supply chain automation at scale.

About the Role:

This full-stack AI engineering role requires hands-on experience with LLM orchestration frameworks, Retrieval-Augmented Generation (RAG) pipelines, context graphs, and the Azure AI ecosystem. You will collaborate closely with product engineers, data scientists, and platform architects to design and deploy production-grade GenAI capabilities across Blue Yonder's comprehensive supply chain platform.

Key Responsibilities:

• Design, build, and maintain LLM-powered application components with a focus on clean code, engineering standards, and robust test coverage.
• Develop and optimize Retrieval-Augmented Generation (RAG) pipelines, encompassing chunking strategies, vector store management, embedding tuning, and retrieval relevance evaluation.
• Construct and maintain multi-agent orchestration workflows using frameworks like LangChain or LangGraph, managing inter-agent communication, tool use, memory, and state.
• Implement context graph solutions to enhance semantic understanding and cross-entity reasoning within supply chain domains.
• Design and integrate Azure AI services, including Azure OpenAI, Azure AI Search, Azure Machine Learning, and other Azure PaaS components.
• Actively participate in agile ceremonies such as backlog grooming, sprint planning, daily stand-ups, and retrospectives.
• Contribute to the development of prompt engineering best practices, LLM evaluation frameworks, and guardrail strategies for hallucination mitigation.
• Analyze the impact of GenAI component changes on downstream agents, dependent services, and end-customer experiences.
• Incorporate information security, responsible AI principles, and data privacy considerations into all development work.
• Identify and troubleshoot production issues with LLM agents, providing detailed context (traces, prompts, token usage) for escalation.
• Plan and execute routine changes to agent configurations, prompt templates, and model version upgrades autonomously.
• Independently resolve incidents within defined GenAI service functions, including model fallback and latency issues.
• Handle service requests related to agent onboarding, tool integration, and knowledge base updates.

What We Are Looking For:

• 2-5 years of overall software engineering experience, with at least 1-2 years specifically focused on GenAI / LLM application development.
• Strong proficiency in Python and/or TypeScript/JavaScript for building both backend and frontend AI-powered services.
• Hands-on experience with LangChain and/or LangGraph for agentic orchestration, tool usage, and memory management.
• A solid understanding of RAG architecture, including document ingestion, chunking, embedding models, vector databases (e.g., Azure AI Search, Weaviate, Pinecone), and reranking techniques.
• Experience building or working with multi-agent systems, encompassing agent routing, orchestrator/worker patterns, and inter-agent handoffs.
• Working knowledge of the Azure AI ecosystem, including Azure OpenAI Service, Azure AI Search, Azure Functions, Azure Container Apps, and related services.
• Familiarity with context graphs, knowledge graphs, or graph-based retrieval methods for improving LLM reasoning capabilities.
• Experience with prompt engineering techniques such as system prompt design, few-shot prompting, and chain-of-thought prompting.
• Understanding of LLM evaluation strategies, including hallucination detection, faithfulness scoring, and output quality metrics.

Blue Yonder is an equal opportunity employer and values diversity at our company. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.