AI Quality Engineer

About the Role: AI Quality Engineer at Micromonic, India

Micromonic, a pioneer in domain-driven AI systems, is seeking a talented AI Quality Engineer for a full-time, remote position. You will play a crucial role in shaping and implementing quality engineering practices for our cutting-edge AI-driven systems, with a strong emphasis on evaluating model behavior, performance, and overall reliability.

Your responsibilities will include developing and executing comprehensive test strategies for machine learning and LLM-based applications. This involves rigorously validating model outputs, identifying and mitigating hallucinations, and assessing accuracy, consistency, and potential biases. You will be instrumental in building scalable quality frameworks, defining key evaluation metrics, and ensuring the highest standards of product quality through both automated testing and human-in-the-loop evaluation methodologies.

Collaboration is key to this role. You will work closely with cross-functional teams, including engineering, data science, and product management, to guarantee the development of robust, reliable, and responsible AI systems. Furthermore, you will proactively identify quality risks, champion continuous improvement initiatives, and contribute significantly to the operational excellence of our AI products.

Key Responsibilities:

• Design and implement quality engineering practices for AI/ML systems.
• Develop and execute test strategies for ML and LLM applications.
• Validate model outputs, detect hallucinations, and assess accuracy, consistency, and bias.
• Build scalable quality frameworks and define evaluation metrics.
• Ensure product quality through automated and human-in-the-loop evaluations.
• Collaborate with engineering, data science, and product teams.
• Identify and mitigate quality risks.
• Contribute to operational excellence and continuous improvement.

Qualifications:

• Proven experience in Quality Engineering, QA, and testing, with exposure to AI/ML systems preferred.
• Strong understanding of AI/ML evaluation, including output validation, metrics, and performance analysis.
• Experience designing test strategies for AI systems, considering edge cases and failure modes.
• Familiarity with LLMs, prompt evaluation, and issues such as hallucination and bias.
• Knowledge of responsible AI principles (fairness, transparency, safety).
• Excellent analytical and problem-solving skills.
• Strong communication and cross-functional collaboration abilities.
• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Experience with test automation, scripting, or evaluation tools is a plus.

Join Micromonic in India and be part of a team that's defining the future of responsible and coherent enterprise AI.