I
Inxite-out•6h ago
Indeed

Senior Quality Analyst

Kolkata, West Bengal
Full Time
Senior Level

Auto Apply to 50+ AI Matched Senior Quality Analyst Jobs

Use Auto Apply Agents to Bulk Apply jobs with ATS Optimised Resumes, find verified Insider Connections for jobs at Inxite-out

Full Job Description

SDET (Software Development Engineer in Testing) – Senior Automation QA & Manual Testing

Experience: 8+ Years
Employment Type: Full-Time / Hybrid
Department: FSD
Designation: Senior Specialist – FSD QA

About Us

InxiteOut Pvt. Ltd. specializes in building next-generation AI-powered applications that solve real-world business problems. We are expanding our QA team to ensure our AI systems are robust, secure, and aligned with user expectations.


Key Responsibilities

  • Demonstrate strong knowledge of Python for scripting and automation.
  • Configure and test complex AI/ML products and systems.
  • Lead the quality assurance strategy and establish comprehensive automation frameworks from scratch.
  • Manage and mentor junior QA engineers, guiding them in test automation and AI system validation.
  • Own functional and non-functional testing across distributed systems.
  • Be responsible for API, integration, acceptance, system, and end-to-end (E2E) testing.
  • Lead test planning, design of test cases, and execution for web, API, and AI-based systems.
  • Design and maintain regression test suites to ensure full coverage.
  • Collaborate with Full Stack Developers, Data Scientists, and AI Engineers to define test strategies specifically for LLM-based features.
  • Own testing of specific AI behaviors including:
- Hallucination detection and factual accuracy verification
- Consistency in prompt-response pairs
- Validation of Retrieval-Augmented Generation (RAG) flows

Collaboration & Methodologies

  • Work closely with developers, product owners, and other QA engineers within Agile teams.

Must-Have Skills:

  • Functional Testing Expertise:- Advanced REST API testing using tools like Postman or REST Assured.- Proficiency in Integration, Acceptance, E2E, Smoke, Sanity, and System Testing.
  • Non-Functional Testing Foundation:- Performance and Load Testing capabilities.- Stress and Security Testing proficiency.
  • Testing Methods Mastery:- Black-box, White-box, and Grey-box testing techniques.
    • Fully own the regression testing lifecycle.
Automation & Coding Skills:- Expertise in automation frameworks such as Selenium, Playwright, Cypress, and TestNG.- Strong scripting/coding skills in Python (preferred), Java, or JavaScript.
Demonstrate familiarity with containerized environments including Docker and Kubernetes.

Good-to-Have (AI Testing Focus)

  • Direct exposure to testing AI/ML products and systems.
  • Experience integrating automated tests into CI/CD pipelines using GitHub Actions, GitLab, or Azure DevOps.- Hands-on experience with dedicated AI testing tools or custom frameworks.
  • Familiarity with evaluating LLM (Large Language Model) outputs for quality.
  • Proven experience validating RAG-based architecture and flows.
  • Understanding of hallucination detection metrics and prompt tuning techniques.
  • Experience conducting safety audits for AI applications.
  • Collaboration history with Full Stack, Data Science, Data Engineering, and DevOps teams.

Qualifications

  • Bachelor’s or Master's degree in Computer Science, Engineering, or a related field.
  • Certifications in testing (e.g., ISTQB) or security (e.g., OWASP) are considered a plus.

Company

I

Inxite-out

InxiteOut Pvt. Ltd. is a leading technology company specializing in building next-generation AI-powered applications designed to solve real-world business problems.Headquartered in Kolkata, West Benga...

Kolkata, West Bengal
Posted on Indeed

Practice this interview

A voice mock interview for Senior Quality Analyst (Automation & Manual) at Inxite-out, with questions from this job description and your resume, and a scored report afterwards.

Set up interview