Software Engineer II

JPMorgan Chase & Co. is seeking a Software Engineer II with MLOps expertise to join their Employee Platform team in Hyderabad / Secunderabad, Telangana. This role focuses on designing, building, and managing production-grade machine learning and Generative AI solutions to address significant business challenges.

Key Responsibilities:

• Develop and maintain end-to-end MLOps pipelines for automated deployment, scaling, and lifecycle management of ML and GenAI models, ensuring robust workflows from data ingestion to model serving.
• Architect and manage secure, scalable AWS environments for ML/GenAI workloads using Terraform for infrastructure as code.
• Support and drive the deployment of GenAI projects, including those utilizing large language models, RAG architectures, and agentic frameworks. Optimize model performance through prompt engineering.
• Design and develop agentic workflows and AI agents using orchestration frameworks like LangChain, LangGraph, CrewAI, or AutoGen.
• Implement comprehensive monitoring strategies to track model performance, detect drift, and ensure the operational health of deployed models, including setting up alerts for anomalies.
• Collaborate with data scientists, software engineers, and business stakeholders to translate requirements into production-ready solutions, communicating technical details effectively to diverse audiences.
• Ensure all developed solutions comply with industry regulations and organizational standards, prioritizing data security and privacy throughout the lifecycle.

Required Skills and Experience:

• Formal training or certification in software engineering or machine learning, with at least 2 years of applied experience.
• Strong understanding of MLOps and DevOps principles, with hands-on experience in CI/CD pipelines and model deployment automation.
• Working knowledge of AWS services relevant to ML/AI workloads.
• Proficiency in Terraform for cloud infrastructure management.
• Demonstrated experience with GenAI projects, including LLMs, prompt engineering, and RAG pipelines.
• Experience in designing and developing agentic workflows and AI agents using frameworks such as LangChain, LangGraph, CrewAI, or AutoGen.
• Strong programming skills in Python or a similar language.
• Experience with ML serving frameworks like FastAPI, TensorFlow Serving, or PyTorch.
• Familiarity with experiment tracking tools (e.g., Weights & Biases) and model registries (e.g., MLflow).
• Experience with deployment strategies like A/B testing and canary releases, and containerization technologies (Docker, Kubernetes/EKS).
• Experience with Databricks features such as Asset Bundles, Feature Store, Unity Catalog, Delta Live Tables, and Model Serving endpoints.

Preferred Skills:

• Experience with fine-tuning pre-trained models (including LLMs) using techniques like LoRA, QLoRA, PEFT, or full fine-tuning.
• Familiarity with feature store platforms (e.g., Feast, SageMaker Feature Store).

This is a permanent position offering an opportunity to work on cutting-edge AI and ML technologies within a leading financial institution.