Python Systems Software Engineer | ...

Role Overview

Hirely is recruiting experienced Python software engineers for a remote, task-based opportunity focused on building datasets that teach AI agents to reason about real-world software codebases. You will build challenging codebase-exploration tasks around production Python repositories.

• Investigate unfamiliar systems and understand runtime behavior
• Develop questions and evaluation criteria that test deep engineering reasoning
• Cover widely deployed Python codebases including Django, Twisted, Scrapy, SymPy, mypy, pip, coverage.py, mitmproxy, Certbot, Tornado, Werkzeug, sqlfluff, and Meson

Key Responsibilities

• Select tasks from a pre-validated pool of Python repositories pinned to specific git commits.
• Explore repositories until you understand the relevant subsystem, including associated PR and issue history.
• Rewrite engineering questions to challenge advanced coding agents while remaining well-defined and answerable.
• Adjust rubrics and foils to reward correct reasoning and reject plausible but incorrect answers.
• Document completed work in the task README.
• Submit tasks for expert review and address reviewer feedback.

Qualifications

To succeed, you should have:

• 3+ years of professional software engineering experience with substantial production Python experience.
• The ability to navigate large, unfamiliar Python codebases and explain their runtime behavior.
• A strong understanding of relevant Python internals: import machinery, descriptors, metaclasses, async and event loops, packaging, C-extension boundaries.
• Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant.
• Precise written English, as the questions and evaluation rubrics are a core part of the work.
• Comfort working with Git at commit level, containerized environments, and command-line tooling.

Working Details

The role is fully remote and asynchronous. Expert team leads operate across US, India, and Nigeria time zones. Time is tracked with Insightful, and platform access is provisioned through Okta. Onboarding includes identity verification, a background check, signed Terms of Work and CIIAA, a tax form, and a short calibration quiz.

Compensation

Payment is $130 per approved task. Each task is reviewed by a second engineer and a super reviewer before acceptance.