Software QA Engineer – AI Evaluatio...

About the Job: Software QA Engineer – AI Evaluation (Remote)

Role Overview

JustHr is seeking experienced Software QA / Test Engineers for an exclusive AI training & evaluation project. This is a contractor role offering $90/hour.

Your Responsibilities

• Evaluate AI-generated software and technical outputs.
• Design comprehensive test cases covering functional and edge-case scenarios.
• Identify defects and provide clear, actionable feedback to improve AI systems.

Requirements

• Solid experience as a Software QA / SDET or Test Engineer.
• Proficiency in both manual and automation testing frameworks (Selenium, Playwright, Cypress, Appium, Postman, Jira, etc.).
• Mandatory: Prior paid experience specifically in AI training/evaluation, annotation, labeling, RLHF, or model response evaluation.
• Strong English communication skills with exceptional attention to detail.

Note

This is strictly a software QA role. Deep AI/ML development expertise is not required; however, proven experience in evaluating and improving AI systems through testing is essential. Immediate availability is preferred.