Java Backend Engineer

About The Role

We are seeking experienced Tech Lead level Software Engineers to join our dynamic team working on Large Language Model (LLM) evaluation and training datasets. This position offers an exciting opportunity to influence the future of AI-assisted software development by working closely with researchers on impactful projects that expand dataset coverage across various programming languages.

Key Responsibilities

• Analyze and triage GitHub issues trending in open-source libraries to identify challenges for LLM evaluation.
• Set up, configure code repositories, manage Dockerization, dependencies, and CI/CD pipelines tailored to global development teams (including India).
• Assess unit test coverage and quality, providing insights for optimization of AI-generated code.
• Modify and run complex open-source codebases locally to evaluate LLM performance in bug-fixing scenarios relevant to diverse tech stacks like Java.
• Collaborate with research teams globally to design repositories that effectively test LLM capabilities.
• Lead, mentor junior engineers, and ensure project milestones are met in a fully remote setup accessible from anywhere, including India.
• Document processes and best practices for ongoing knowledge sharing across distributed teams.