Remote Rust Engineer

About the Projects: We are developing datasets for LLM evaluation and training, specifically designed to enable LLMs to tackle realistic software engineering challenges. A key approach involves synthetically creating verifiable software engineering tasks, informed by public repository histories and refined with human feedback. We aim to broaden dataset coverage across various programming languages and difficulty levels.

About the Role: We seek experienced software engineers, at a tech lead level, who are adept with high-quality public GitHub repositories. This role requires hands-on software engineering, including automating development environments, triaging issues, and evaluating test coverage and quality.

Why Join Us? Be part of Turing, a fast-paced AI company at the forefront of advancing and deploying AI systems. You will gain direct experience in evaluating LLM performance with real code, influencing the future of AI-assisted software development. This is a unique chance to merge practical software engineering with cutting-edge AI research.

Day-to-Day Responsibilities:

• Analyze and triage GitHub issues from popular open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate the quality and coverage of unit tests.
• Modify and run codebases locally to assess LLM capabilities in bug-fixing tasks.
• Collaborate with researchers to identify and select challenging repositories and issues for LLMs.
• Potentially lead junior engineers in collaborative project efforts.

Required Skills:

• Minimum of 3 years of overall professional experience.
• Strong proficiency in at least one of the following languages: Rust.
• Expertise with Git, Docker, and basic software pipeline setup.
• Ability to comprehend and navigate complex codebases.
• Comfortable running, modifying, and testing real-world projects locally.
• Previous contributions to or evaluation of open-source projects are advantageous.

Nice to Have:

• Prior involvement in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Working with Turing:

• Fully remote work environment.
• Opportunity to engage with cutting-edge AI projects for leading LLM companies.

Offer Details:

• Commitment: Minimum 4 hours per day, 20 hours per week, with a 4-hour overlap with PST. Options for 20, 30, or 40 hours per week are available.
• Employment Type: Contractor assignment (no medical or paid leave benefits).
• Contract Duration: 3 months, with an expected start date next week.

Upon applying, you will receive an email with a login link to complete your profile on our portal.