Sr/Lead AI Harness Engineer

About the Role

Join FICO's world-class engineering team as a Sr/Lead AI Harness Engineer. You will be at the heart of "Harness Engineering," a new discipline designed to solve the bottleneck caused by rapid AI code generation.

The Opportunity

In this hands-on technical role, you will build and own the controls that make up the harness—the environment guiding agents toward correct, maintainable output. Your focus is on systems engineering: designing guides, feedback sensors (like custom linters), running steering loops to prevent recurring errors, and ensuring quality gates are met before production release.

What You'll Contribute

• Build Feedforward Guides:Create agent instruction files, reusable skills, architectural rules, reference docs, and codemods that help agents succeed on the first try.
• Build Feedback Sensors:Develop custom linters, static analysis tools, structural fitness tests, verification loops, and LLM-as-judge reviewers to catch issues early.
• Run the Steering Loop:Engineer controls that stop repeated mistakes by agents and keep repository knowledge (docs, specs) legible to prevent drift.
• Quality Gating & Observability:Contribute to release criteria, LLM testing for safety thresholds, and observability tracking metrics like cost per PR, time-to-merge, review velocity, and defect escape rates.

Evaluation Criteria

You will assess the stability, scalability, interoperability, and performance of harness components while continually learning new techniques in agent-augmented engineering to mentor junior team members.