Software Engineer SQA

Boston Scientific is seeking a Software Engineer SQA specializing in AI/ML Products in Gurgaon, India. This role is pivotal in ensuring the reliability and usability of AI-driven healthcare solutions, including machine-learning models and LLM pipelines, guaranteeing safe, accurate, and coherent outcomes.

Key responsibilities include developing and executing test plans for AI/ML features such as chatbots, recommendation engines, RAG search, and copilots. The engineer will design and maintain automation frameworks using tools like Selenium, Cypress, Playwright, and PyTest for UI, API, and model-level testing. They will implement evaluation harnesses with frameworks like LangSmith, RAGAS, and LangTest to assess relevance, hallucination, fairness, and toxicity. The role involves end-to-end validation of RAG pipelines, monitoring post-deployment AI performance for drift, regression, and latency, and collaborating with MLOps teams for incident triage. Close collaboration with product managers, data scientists, and engineers is expected for defining outcomes and edge cases. The engineer will also document test results, manage defects, and drive root-cause analysis.

Required qualifications include over 6 years of software quality assurance or test-automation experience, specifically with AI/ML products. Proficiency in Python or JavaScript and experience with RESTful API testing (Postman, Swagger) are essential. Hands-on experience with automation tools such as Selenium, Cypress, Playwright, or PyTest is required, along with knowledge of LLM evaluation frameworks (LangSmith, RAGAS) and vector database APIs. A strong understanding of QA processes, including test planning, regression testing, CI/CD integration, and defect lifecycle management, is crucial.

Preferred qualifications include experience testing RAG or agentic AI workflows at scale, familiarity with monitoring solutions for model and data drift (e.g., Vertex AI, Azure Monitor, Fiddler), exposure to ethical AI or bias-testing methodologies, and a background in healthcare or other regulated domains.