Software Engineer for AI-Driven Project
We are looking for a skilled software engineer to contribute to our AI-driven project. The ideal candidate will have experience working with high-quality public GitHub repositories and be able to analyze and triage issues across trending open-source libraries.
About the Project
Our project involves building LLM evaluation and training datasets to train LLMs to work on realistic software engineering problems. We are looking for someone who can help us identify and verify SWE tasks based on public repository histories in a synthetic approach with human-in-the-loop.
About the Role
As a software engineer on this project, you will be responsible for hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality. You should have experience working with well-maintained, widely-used repositories with 500+ stars and be proficient in Git, Docker, and basic software pipeline setup.
Responsibilities
* Analyze and triage GitHub issues across trending open-source libraries.
* Set up and configure code repositories, including Dockerization and environment setup.
* Evaluate unit test coverage and quality.
* Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
* Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
Requirements
* Strong experience with at least one of the following languages: Python, JavaScript, Java, Go, Rust, C/C++, C#, or Ruby.
* Experience working with well-maintained, widely-used repositories with 500+ stars.
* Proficiency with Git, Docker, and basic software pipeline setup.
* Ability to understand and navigate complex codebases.
* Comfortable running, modifying, and testing real-world projects locally.
Benefits
As a contractor, you will have the opportunity to work in a fully remote environment and collaborate with leading LLM companies. You will also have the chance to participate in cutting-edge AI projects and gain experience working with AI-assisted software development tools.