Remote Software Engineer

About the Job:

We are building datasets for Large Language Model (LLM) evaluation and training, specifically designed to enable LLMs to tackle realistic software engineering challenges. A key approach involves creating verifiable software engineering tasks derived from public repository histories using a synthetic, human-in-the-loop methodology. This project aims to broaden dataset coverage across various task types, programming languages, and difficulty levels.

About the Role:

Turing is seeking experienced software engineers, ideally at a Tech Lead level, who possess a strong understanding of high-quality public GitHub repositories to contribute to this innovative project. This role demands hands-on software engineering, including automating development environments, triaging issues, and evaluating test coverage and code quality.

Why Join Turing?

As one of the fastest-growing AI companies globally, Turing is at the forefront of advancing and deploying powerful AI systems. You will have the unique opportunity to influence the future of AI-assisted software development by evaluating how LLMs interact with real-world code. This position offers a compelling blend of practical software engineering and cutting-edge AI research.

A Typical Day:

• Analyze and triage GitHub issues from popular open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate the quality and coverage of unit tests.
• Modify and execute codebases locally to assess LLM performance in bug-fixing tasks.
• Collaborate with researchers to identify and design challenging repositories and issues for LLMs.
• Potential to lead junior engineers on collaborative projects.

Required Skills:

• A minimum of 3 years of overall software engineering experience.
• Strong proficiency in at least one of the following languages: Go.
• Expertise with Git, Docker, and fundamental software pipeline setup.
• Ability to comprehend and navigate complex codebases.
• Comfortable with running, modifying, and testing real-world projects locally.
• Experience contributing to or evaluating open-source projects is advantageous.

Nice to Have:

• Prior involvement in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Freelancing with Turing:

• Work in a fully remote setting.
• Opportunity to engage with leading LLM companies on state-of-the-art AI projects.

Offer Details:

• Commitments Required: A minimum of 4 hours per day and 20 hours per week, with at least 4 hours of overlap with Pacific Standard Time (PST). Available commitment options are 20, 30, or 40 hours per week.
• Employment Type: Contractor assignment (Note: This role does not include medical benefits or paid leave).

After applying, please check your email for a login link to our portal to complete your profile. Refer amazing talent at turing.com/referrals and earn rewards.