Remote JavaScript Developer

About the Job

This project focuses on creating LLM evaluation and training datasets to improve LLM capabilities in realistic software engineering scenarios. A key approach involves generating verifiable software engineering tasks from public repository histories, utilizing a synthetic method with human oversight, while broadening dataset coverage across various programming languages and difficulty levels.

About the Role

We are seeking experienced software engineers, ideally at a tech lead level, with a strong understanding of high-quality public GitHub repositories to contribute to this project. Responsibilities include hands-on software engineering, automating development environments, triaging issues, and evaluating test coverage and quality.

Why Join Us?

Turing is a leader in the AI space, rapidly advancing AI systems. Join us at the forefront of evaluating LLM interactions with code, shaping the future of AI-assisted software development. This role offers a unique blend of practical software engineering and AI research.

Day-to-Day Responsibilities

• Analyze and triage GitHub issues from trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate the quality and coverage of unit tests.
• Modify and execute codebases locally to assess LLM performance in bug-fixing tasks.
• Collaborate with researchers to identify challenging repositories and issues for LLMs.
• Potentially lead junior engineers in project collaboration.

Required Skills

• Minimum 3 years of overall professional experience.
• Strong proficiency in JavaScript / TypeScript.
• Expertise with Git, Docker, and basic software pipeline setup.
• Ability to comprehend and navigate complex codebases.
• Comfortable running, modifying, and testing real-world projects locally.
• Previous experience contributing to or evaluating open-source projects is advantageous.

Nice to Have

• Prior involvement in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Freelancing With Turing

• Work in a fully remote environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer Details

• Commitments Required: A minimum of 4 hours per day and 20 hours per week, with a 4-hour overlap with PST. Flexible time commitment options: 20, 30, or 40 hours per week.
• Employment Type: Contractor assignment (no medical or paid leave provided).

After applying, you will receive an email with a login link to access the portal and complete your profile. Refer amazing talent at turing.com/referrals and earn rewards.