Remote JavaScript Developer
Full Job Description
About the Role
We are seeking experienced software engineers, at a tech lead level, proficient with high-quality public GitHub repositories, to join our project focused on building LLM evaluation and training datasets. These datasets will train Large Language Models (LLMs) to handle realistic software engineering challenges. Our approach involves creating verifiable Software Engineering (SWE) tasks synthetically, incorporating human-in-the-loop processes, and expanding dataset coverage across various programming languages and difficulty levels.
This role requires hands-on software engineering, including automating development environments, triaging issues, and evaluating test coverage and quality. You will analyze and triage GitHub issues from trending open-source libraries, set up and configure code repositories with Dockerization, and evaluate unit test coverage. You will also modify and run codebases locally to assess LLM performance in bug-fixing scenarios and collaborate with researchers to identify challenging repositories and issues for LLMs. Opportunities exist to lead junior engineers on projects.
Why Join Us?
Turing is a leading AI company at the forefront of accelerating the advancement and deployment of powerful AI systems. You will be instrumental in evaluating how LLMs interact with real code, shaping the future of AI-assisted software development. This is a unique opportunity to combine practical software engineering with AI research.
Required Skills
- Minimum 3+ years of overall experience
- Strong proficiency in JavaScript / TypeScript
- Expertise with Git, Docker, and basic software pipeline setup
- Ability to comprehend and navigate complex codebases
- Comfort running, modifying, and testing real-world projects locally
- Experience contributing to or evaluating open-source projects is a plus
Nice to Have
- Previous involvement in LLM research or evaluation projects
- Experience building or testing developer tools or automation agents
Perks of Freelancing With Turing
- Work in a fully remote environment.
- Opportunity to collaborate on cutting-edge AI projects with leading LLM companies.
Offer Details
- Commitments Required: At least 4 hours per day and a minimum of 20 hours per week, with a 4-hour overlap with PST. We offer flexibility with 20, 30, or 40 hours per week.
- Employment type: Contractor assignment (no medical/paid leave).
Company
Turing
Turing is a rapidly expanding AI company dedicated to advancing and deploying sophisticated AI systems. We collaborate with leading AI laboratories to enhance frontier model capabilities in areas such...