Remote Python Engineer

About the Projects

We are engineering high-quality LLM evaluation and training datasets focused on realistic software development scenarios. Our approach involves building verifiable Software Engineering (SWE) tasks derived from public repository histories using a synthetic methodology with human-in-the-loop validation, expanding dataset coverage across various programming languages, difficulty levels, and task types.

About the Role

We seek experienced software engineers at the Tech Lead level who possess deep familiarity with high-quality public GitHub repositories. This role demands hands-on engineering contributions including development environment automation, issue triaging, and rigorous evaluation of test coverage and quality.

Why Join Us?

Turing is accelerating the future of AI-assisted software development. You will be at the forefront of evaluating how Large Language Models (LLMs) interact with real code, influencing industry standards while blending practical engineering with cutting-edge AI research as a remote contractor.

Day-to-Day Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries relevant to LLM training.
• Set up and configure complex code repositories, including Dockerization and environment automation.
• Evaluate unit test coverage and quality metrics systematically.
• Modify and run local codebases to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to design challenges that identify repository issues difficult for current LLMs.
• Lead junior engineers on collaborative projects as needed.

Tech Stack & Skills

• Mandatory: Minimum 3+ years of overall experience; Strong proficiency in Python (or similar); Expertise with Git, Docker, and software pipeline setup; Ability to navigate complex codebases comfortably.
• Nice-to-Have: Prior involvement in LLM research/evaluation projects or building developer tools/automation agents.