Dice•11h ago
Career Pages
Remote Backend Engineer
United States
Contract
Senior Level
200-300/hr
Full Job Description
Role Overview
Turing (via Dice) seeks an experienced Software Engineering Evaluator to build high-quality datasets essential for training, benchmarking, and advancing large language models. You will curate code examples, correct errors in AI-generated software, evaluate model outputs, and develop Python-based agents and verification tools alongside top researchers.
Key Responsibilities
- Curate production-grade code samples primarily in Python, with additional work spanning JavaScript (ReactJS), C/C++, Java, Rust, and Go.
- Evaluate and refine AI-generated solutions to ensure efficiency, scalability, and reliability against industry benchmarks.
- Build automated agents and verification tools that assess solution quality and identify error patterns within the software engineering lifecycle.
- Hypothesize on critical steps including prototyping, architecture design, API development, production implementation, monitoring, and operational maintenance to evaluate model capabilities.
Must-Have Qualifications
- Proven experience building production systems at high-scale organizations (e.g., Google, Microsoft, Amazon).
- Strong expertise in Python with deep knowledge of frameworks and best practices for scalable software deployment.
- Demonstrated ability to assess code quality through rigorous review and debugging processes.
Company
Dice
Dice is a leading career marketplace specifically designed for technology professionals seeking opportunities in software development, engineering, and data science.
United States
Posted on Career Pages
Practice this interview
A voice mock interview for Remote Backend Engineer (Python/FastAPI) at Dice, with questions from this job description and your resume, and a scored report afterwards.
Set up interview