Senior Software Engineer for AI-Assisted Development
We are looking for experienced software engineers to contribute to our project evaluating how Large Language Models (LLMs) interact with real code.
As a Senior Software Engineer, you will be responsible for analyzing and triaging GitHub issues across trending open-source libraries, setting up and configuring code repositories, evaluating unit test coverage and quality, and modifying and running codebases locally to assess LLM performance in bug-fixing scenarios.
Key Responsibilities:
* Analyze and triage GitHub issues across trending open-source libraries.
* Set up and configure code repositories, including Dockerization and environment setup.
* Evaluate unit test coverage and quality.
* Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
* Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
Required Skills and Qualifications:
* Strong experience with at least one of the following languages: Python, JavaScript, Java, Go, Rust, C/C++, C#, or Ruby.
* Experience working with well-maintained, widely-used repositories with 500+ stars.
* Proficiency with Git, Docker, and basic software pipeline setup.
* Ability to understand and navigate complex codebases.
* Comfortable running, modifying, and testing real-world projects locally.
Benefits:
* Work in a fully remote environment.
* Opportunity to work on cutting-edge AI projects with leading LLM companies.
Offer Details:
* Commitment required: 20 hours per week with some overlap with PST.
* Employment type: Contractor assignment (no medical/paid leave).
* Duration of contract: 1 month with expected start date as next week.