Remote Python Engineer

About the Projects: Join a cutting-edge initiative building large-scale LLM evaluation and training datasets focused on realistic software engineering challenges. The project utilizes synthetic approaches with human-in-the-loop to create verifiable Software Engineering (SWE) tasks, expanding coverage across programming languages and difficulty levels.

The Role: We seek an experienced Tech Lead-level Python Engineer proficient in high-quality open-source ecosystems. You will drive hands-on engineering work including environment automation, issue triaging for major libraries, test quality evaluation, and local codebase modification to assess LLM performance in bug-fixing scenarios.

Day-to-Day Responsibilities:

• Analyze and prioritize GitHub issues across trending open-source repositories.
• Configure development environments, including Dockerization and dependency setup.
• Evaluate unit test coverage and overall code quality.
• Modify and run complex codebases locally to benchmark LLM capabilities.
• Collaborate with research teams to identify challenging repository/issue pairs for model training.
• Potentially lead junior engineers on collaborative projects.

Tech Stack & Requirements:

• Minimum 3+ years of professional experience (Mid-to-Senior level).
• Strong proficiency in Python and Git workflows.
• Expertise with Docker and software pipeline automation.
• Able to navigate complex, legacy codebases independently.

Nice-to-Have: Background in LLM research/evaluation or building developer tools.
Engagement Details:This is a remote contractor assignment requiring 4+ hours daily (minimum 20 hrs/week) with overlap into PST. The contract duration is initially set for 3 months.