Remote Python Engineer

About the Projects: We are developing LLM evaluation and training datasets to enable LLMs to tackle realistic software engineering challenges. A key approach involves creating verifiable software engineering tasks using public repository histories and a human-in-the-loop synthetic method, while broadening dataset coverage across various programming languages and difficulty levels.

About the Role: We are seeking experienced software engineers, ideally at a tech lead level, with a strong understanding of high-quality public GitHub repositories to contribute to this project. This role requires hands-on software engineering, including automating development environments, triaging issues, and evaluating test coverage and quality.

Why Join Us? Turing is a rapidly growing AI company at the forefront of accelerating AI systems. You will have the opportunity to evaluate LLM performance with real code, shaping the future of AI-assisted software development. This role offers a unique blend of practical software engineering and AI research.

Day-to-Day Responsibilities:

• Analyze and triage GitHub issues from trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate the coverage and quality of unit tests.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to identify and select challenging repositories and issues for LLMs.
• Potentially lead junior engineers in collaborative project efforts.

Required Skills:

• Minimum of 3 years of overall professional experience.
• Strong proficiency in at least one of the following languages: Python.
• Expertise with Git, Docker, and basic software pipeline setup.
• Ability to comprehend and navigate complex codebases.
• Comfortable running, modifying, and testing real-world projects locally.
• Experience contributing to or evaluating open-source projects is a significant advantage.

Nice to Have:

• Previous involvement in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Freelancing With Turing:

• Work in a fully remote environment.
• Opportunity to engage with cutting-edge AI projects for leading LLM companies.

Offer Details:

• Commitments Required: Minimum 4 hours per day, totaling at least 20 hours per week, with 4 hours of overlap with PST. Flexible options for 20, 30, or 40 hours per week.
• Employment Type: Contractor assignment (no medical or paid leave benefits).
• Contract Duration: 3 months; expected start date is next week.

After applying, you will receive an email with a link to access the portal and complete your profile. Refer talented individuals at turing.com/referrals to earn rewards.