Job Summary
We are seeking an experienced software engineer to contribute to our project focused on building LLM evaluation and training datasets.
* You will analyze and triage GitHub issues across trending open-source libraries, set up and configure code repositories, and evaluate unit test coverage and quality.
* Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
* Opportunities to lead a team of junior engineers to collaborate on projects.
Key Responsibilities
* Strong experience with at least one of the following languages: Python, JavaScript, Java, Go, Rust, C/C++, C#, or Ruby.
* Experience working with well-maintained, widely-used repositories with 500+ stars.
* Proficiency with Git, Docker, and basic software pipeline setup.
* Able to understand and navigate complex codebases.
* Comfortable running, modifying, and testing real-world projects locally.
Benefits
* Work in a fully remote environment.
* Opportunity to work on cutting-edge AI projects with leading LLM companies.
Requirements
* 20 hours per week commitment with some overlap with PST.
* Contractor assignment (no medical/paid leave).
What We Offer
* Competitive compensation.
* Opportunities for growth and professional development.