Delivery AI Software Engineer

Role Overview

Boston Consulting Group is seeking an AI Software Engineer for their Delivery team. This role involves working closely with consulting teams on advanced topics like GenAI, Agentic Systems, and web application development to deliver value across products and practice areas.

You'll Do:

• Collaborate with teams to gather requirements, design, develop, and support software solutions for client needs.
• Create robust proprietary code following security best practices and high reusability standards.
• Design enterprise-grade GenAI features using full-stack architectures rather than standalone demos.
• Build modular AI services in Python (FastAPI/Flask/Django) wrapping LLM APIs exposed via REST.
• Develop Retrieval-Augmented Generation (RAG) pipelines including chunking, embeddings, vector search, and re-ranking.
• Create agentic workflows with tool/function calling, multi-step orchestration, memory management, and human-in-the-loop checkpoints.
• Integrate AI inference into React or Angular applications using UX patterns like streaming responses and graceful degradation.
• Treat evaluation as engineering by defining success criteria, building test sets, and instrumenting logging/tracing for cost controls.
• Apply Responsible AI practices including prompt injection defense, PII handling, output validation, and audit trails.
• Gather business requirements from demanding stakeholders through thought partnership.
• Synthesize insights via sophisticated packaging (PPTs/charts) to communicate with consulting teams.
• Mentor juniors on advanced software concepts and lead technical trainings for cohorts.

Technical Skills:

Must Have:
- Python frameworks: Django, Flask, FastAPI
Frontend: React, Angular, TypeScript, HTML5, CSS3
Database: SQL (Postgres)
Testing: Mockito, Junit, Jest; Unit & Integration testing
UI Libraries: Material UI or Ant Design component libraries
LLM APIs: Azure OpenAI preferred; OpenAI, Anthropic acceptable
Orchestration/Frameworks: LangChain/LangGraph, AutoGen, CrewAI, Semantic Kernel,
Evaluation Tools: LangSmith, Langfuse, Azure AI evaluation tooling

Good to Have:
DevOps: CI/CD pipelines, Docker containers.
Cloud Infra: Kubernetes deployments on Azure/GCP/
NoSQL DBs (MongoDB), HighCharts/D3.js for charting.

• OOPs concepts and responsive UI design

Requirements:

• Bachelor's or Master's degree in Computer Science/Technology.
• At least 2-4 years of end-to-end web application development experience, preferably in a commercial services or consulting organization.
• Strong problem-solving skills and excellent communication abilities.

#BCGXjob#LI-NT1