Software Engineer

We are seeking an experienced Software Engineer at the Tech Lead level to join our dynamic team focused on large language model (LLM) evaluation and training datasets. Your primary role will be building high-quality datasets to enable LLMs to tackle realistic software engineering problems. You should have a strong background in analyzing public GitHub repositories, automating development environments, and evaluating code quality. You will develop synthetic software engineering tasks based on repository histories, enhancing dataset diversity across programming languages and difficulty levels. This role offers a unique blend of practical software engineering and AI research.

Responsibilities

• Analyze and triage issues across trending open-source repositories on GitHub, identifying challenging tasks for LLMs.
• Set up and configure development environments, including Dockerization and environment management.
• Evaluate unit test coverage and assess code quality to ensure dataset robustness.
• Modify, run, and test codebases locally to evaluate LLM performance in bug-fixing and code understanding scenarios.
• Collaborate closely with AI researchers to design datasets and identify repositories that can push the boundaries of current LLM capabilities.
• Lead and mentor junior engineers, fostering a collaborative environment for project success.

Qualifications

• Minimum of three years of professional experience in software engineering.
• Proficiency in at least one programming language (e.g., Ruby).
• Strong familiarity with version control systems (e.g., Git).
• Experience with containerization tools (e.g., Docker) and software pipeline setup.
• Ability to understand and navigate complex codebases, run and modify projects locally, and evaluate code quality.
• Experience with open-source contributions or evaluations is a plus.
• Automation, testing skills, and familiarity with AI or LLM research are advantageous.

Benefits

• Fully remote work environment, allowing flexibility to work from anywhere.
• Opportunity to work on pioneering AI projects with leading LLM companies.
• Flexible schedule with options for part-time or full-time commitments.
• Part of a global community of talented professionals dedicated to innovation in AI technology.

Turing is an equal opportunity employer committed to diversity and inclusion.