Remote JavaScript Engineer
Full Job Description
We are developing Large Language Model (LLM) evaluation and training datasets to enable LLMs to tackle realistic software engineering challenges. A key approach involves creating verifiable software engineering tasks synthetically, incorporating human feedback, and broadening dataset coverage across various programming languages and difficulty levels. We are seeking experienced software engineers, ideally at a tech lead level, with a strong understanding of high-quality public GitHub repositories to contribute to this project. This role requires hands-on software engineering, including automating development environments, triaging issues, and assessing test coverage and quality. Join us at Turing, a leader in AI, to influence the future of AI-assisted software development by evaluating LLM interactions with code. This is a unique opportunity to combine practical software engineering with AI research. Daily tasks include analyzing and triaging GitHub issues from popular open-source libraries, setting up and configuring code repositories (including Dockerization), evaluating unit test coverage and quality, modifying and running codebases locally to test LLM performance in bug-fixing scenarios, and collaborating with researchers to identify challenging repositories and issues for LLMs. There are also opportunities to lead junior engineers.
Required Skills: Minimum 3 years of overall experience, strong JavaScript/TypeScript proficiency, Git, Docker, basic software pipeline setup, ability to understand complex codebases, comfort with running, modifying, and testing projects locally. Experience with open-source contributions or evaluations is a plus.
Nice to Have: Prior involvement in LLM research or evaluation projects, experience building or testing developer tools or automation agents.
Perks: Fully remote work, opportunity to collaborate on cutting-edge AI projects with leading LLM companies.
Offer Details: Commitment of at least 4 hours per day, minimum 20 hours per week, with 4 hours overlap with PST. Employment type: Contractor assignment.
Company
Turing
Turing is a rapidly expanding AI company focused on advancing and deploying sophisticated AI systems. We collaborate with leading AI labs to enhance model capabilities in areas such as reasoning, codi...