Software Engineer - AI Research Annotation
Full Job Description
Software Engineer - AI Research Annotation
Location: Global Remote
Type: Hourly Independent Contractor
Hours: 15-25/week (flexible up to 40)
Join leading AI labs by applying your software engineering expertise to improve model reasoning. Review real-world coding tasks and document problem-solving processes.
About the Project
Support the development of advanced AI coding capabilities through structured dataset creation. Work with authentic software engineering scenarios from open-source repositories to capture realistic developer thought processes.
Detailed Responsibilities
- Review AI-generated code trajectories on SWE-bench style tasks
- Reconstruct step-by-step reasoning explaining solution approaches
- Annotate decision points, debugging strategies, and technical choices
- Use full codebase context (issues, tests, PRs) for accurate documentation
- Ensure annotations reflect authentic software engineering practices
Technical Requirements
- 2+ years hands-on software development experience
- Strong proficiency in Python, JavaScript/TypeScript, or similar languages
- Experience debugging complex codebases and resolving issues
- Familiarity with Git workflows, pull requests, and issue tracking
- Ability to articulate technical reasoning clearly in writing
Project Structure
- Duration: 1-2 months with extension opportunities
- Start: Immediate onboarding
- Onboarding: Resume review + 15-minute AI technical interview
- Pace: Self-scheduled within weekly commitment minimum
- Payment: Weekly via Stripe/Wise
Ideal Background
- Computer Science/Software Engineering degree (Bachelor's+)
- Experience with open-source contributions or repository analysis
- Understanding of software development lifecycles and testing
- Comfort working with technical documentation and specifications
Success Profile
Top performers receive rate increases and priority for future AI research projects. Join a cohort of experienced engineers shaping next-generation coding AI. Apply Now: Upload resume + complete brief technical screening. All qualified software engineers welcome regardless of background.
Company
Keystone Recruitment
Keystone Recruitment helps build great companies by identifying pivotal talent. We focus on long-term placements and cultural alignment, ensuring candidates become essential parts of your company's su...