Remote Rust Engineer

About the Project: We are developing datasets for Large Language Model (LLM) evaluation and training, focusing on realistic software engineering challenges. Our approach involves creating verifiable software engineering (SWE) tasks derived from public repository histories using a synthetic, human-in-the-loop methodology. This initiative aims to expand dataset coverage across various programming languages, difficulty levels, and task types.

About the Role: We are seeking experienced software engineers, at a tech lead level, with a strong understanding of high-quality public GitHub repositories to contribute to this project. The role requires hands-on software engineering, including automation of development environments, issue triaging, and evaluation of test coverage and quality.

Why Join Us? As part of Turing, a leading AI company, you will be at the forefront of evaluating LLM interactions with real code, shaping the future of AI-assisted software development. This is a unique opportunity to merge practical software engineering with cutting-edge AI research.

Day-to-Day Responsibilities:

• Analyze and triage GitHub issues from trending open-source libraries.
• Configure and set up code repositories, including Dockerization.
• Evaluate the quality and coverage of unit tests.
• Modify and execute codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to identify challenging repositories and issues for LLMs.
• Potentially lead junior engineers in collaborative project efforts.

Required Skills:

• Minimum 3+ years of overall software engineering experience.
• Strong proficiency in at least one of the following languages: Rust.
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfortable running, modifying, and testing real-world projects locally.
• Experience contributing to or evaluating open-source projects is a plus.

Nice to Have:

• Previous experience in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Working with Turing:

• Fully remote work environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer Details:

• Commitment: Minimum 4 hours per day, 20 hours per week, with a 4-hour overlap with PST. Options for 20, 30, or 40 hours per week.
• Employment Type: Contractor assignment (no medical/paid leave).
• Contract Duration: 3 months (expected start date next week).

Please complete your profile via the login link provided in the confirmation email after applying.