Senior Software Engineer - AI and Open-Source Collaboration
We are seeking a skilled software engineer to collaborate on evaluating and training large language models. This project involves analyzing public GitHub repositories, triaging issues, and evaluating test coverage and quality.
About the Role:
* Evaluate and contribute to open-source projects, focusing on high-quality public repositories with 500+ stars.
* Develop automation tools and scripts to streamline workflows and improve codebases.
* Analyze complex codebases and identify areas for improvement, collaborating with researchers to design and identify challenging tasks for large language models.
* Work in a remote environment, contributing to cutting-edge AI projects with leading companies.
Responsibilities:
* Triaging GitHub issues across trending open-source libraries.
* Setting up and configuring code repositories, including Dockerization and environment setup.
* Evaluating unit test coverage and quality.
* Modifying and running codebases locally to assess large language model performance in bug-fixing scenarios.
Requirements:
* Strong experience with at least one of the following languages: Python, JavaScript, Java, Go, Rust, C/C++, C#, or Ruby.
* Experience working with well-maintained, widely-used repositories with 500+ stars.
* Proficiency with Git, Docker, and basic software pipeline setup.
* Ability to understand and navigate complex codebases.
* Comfortable running, modifying, and testing real-world projects locally.
Preferred Qualifications:
* Previous participation in large language model research or evaluation projects.
* Experience building or testing developer tools or automation agents.