Remote Python Senior Software Engin...
Full Job Description
Position Overview
We are seeking a Senior-level Software Engineer for a remote contract role. This is not a traditional production coding position; instead, you will evaluate the quality of interactions with modern AI coding agents (e.g., OpenAI Codex, Claude Code) to ensure they exhibit strong engineering judgment.
Compensation & Hours
- Rate: $100-$200/hour based on experience and location.
- Schedule: 10-20 hours/week, flexible.
This role requires assessing AI-generated coding interactions end-to-end. You will judge whether outputs are useful, correct at a high level, and aligned with best engineering practices. Your focus is on evaluating reasoning quality, explanation clarity, and overall interaction feel rather than just syntax correctness.
Key Responsibilities
- Evaluate AI coding agents in real-world scenarios to determine if responses make sense.
- Distinguish between levels of response quality (e.g., rating 2 vs. 4).
- Provide clear, opinionated written feedback on what worked and what felt misleading.
- Help define standards for 'great' engineering interactions using tools like Cursor and Claude Code.
Requirements
- Senior or Staff-level engineer experience (or equivalent).
- Strong background in TypeScript/JavaScript or Python.
- Hands-on familiarity with OpenAI Codex, Claude Code, or Cursor.
- Able to evaluate code without executing it line-by-line.
- B2+ level English proficiency for detailed written feedback and video explanations.
Nice-to-Have
- Experience in prompt design or evaluation workflows.
- Mentoring senior engineers or defining engineering standards.
Engagement Process: One take-home evaluation exercise followed by a recorded Loom walkthrough. No traditional interview.
Note: Eligibility may vary based on location as some regions are not supported by the client.
Company
G2i
About G2iG2i serves as the engineering layer powering AI training, enabling frontier AI labs to build more capable models.Expert Training Data: We provide rigorous evaluations and custom reinforcement...