JavaScript Developer

About The Role

We are seeking experienced software engineers at the tech lead level to join our innovative team focused on developing large language model (LLM) evaluation and training datasets. This role involves working on projects that aim to improve the capabilities of LLMs in understanding and solving realistic software engineering problems.

You will play a pivotal role in analyzing high-quality public repositories, automating development environments, and assessing the performance of LLMs in various coding scenarios. Your expertise will directly contribute to creating verifiable software engineering tasks based on real-world data, expanding dataset coverage across different programming languages and difficulty levels.

Qualifications

The ideal candidate will possess a minimum of three years of professional experience in software engineering, with strong proficiency in JavaScript and TypeScript. You should have a solid understanding of version control systems like Git, containerization tools such as Docker, and experience with setting up and maintaining software pipelines.

Familiarity with complex codebases, ability to run, modify, and test real-world projects locally, and experience contributing to open-source projects are highly desirable. Candidates with previous involvement in LLM research or evaluation projects, or those who have built or tested developer tools, will have an added advantage. A proactive, detail-oriented mindset and excellent collaboration skills are essential for success in this role.

Responsibilities

• Analyze and triage issues across trending open-source repositories on GitHub to identify challenges relevant to LLM evaluation.
• Set up and configure development environments, including Dockerization and environment management, to facilitate efficient testing and development.
• Evaluate unit test coverage and quality within codebases to ensure robustness and reliability.
• Modify, run, and debug codebases locally to assess and improve LLM performance in bug-fixing and code comprehension tasks.
• Collaborate closely with research teams to design and select repositories and issues that push the boundaries of current LLM capabilities.
• Lead and mentor junior engineers, fostering a collaborative environment and ensuring project milestones are achieved effectively.

Benefits

Joining Turing offers the flexibility of a fully remote work environment, allowing you to work from anywhere while contributing to groundbreaking AI projects. You will have the opportunity to collaborate with leading experts in the AI and software engineering fields, gaining valuable experience in cutting-edge research and development.

Turing provides a competitive compensation structure aligned with your skills and experience, along with the chance to work on innovative projects that have a global impact. The company also encourages continuous learning and professional growth through various training and development initiatives, ensuring you stay at the forefront of technological advancements.