Staff Product Development Engineer

We are hiring a Staff Product Development Engineer (AI Production Engineering) to serve as the technical lead for Model Evaluation Systems. In this role, you will define measurable quality standards for AI-powered ad platforms, architect automated regression detection pipelines, and establish benchmarking frameworks across multiple model providers.

Key responsibilities include:

• Evaluation Architecture: Create structured evaluation frameworks, drive reproducible workflows, and define promotion criteria (Eval Beta GA) to ensure production-ready AI models.
• Governance & Quality Control: Partner with leadership to set safety standards for hallucination scoring, design prompt drift detection mechanisms, and formalize engineering-controlled quality gates for releases.
• Engineering Automation:Build scalable pipelines integrated with CI/CD, design automated A/B testing systems, maintain structured evaluation datasets, and align benchmarks with real-world production behavior.
• Cross-Functional Influence: Serve as the technical authority for AI quality standards, influence model selection decisions, mentor engineers on testing methodologies, and provide recommendations during certification reviews.