Software Engineer for AI Research
">
We are seeking a skilled software engineer to contribute to our project evaluating and training Large Language Models (LLMs). The ideal candidate will have experience working with high-quality public GitHub repositories and can collaborate with researchers to design and identify challenging repositories and issues for LLMs.
">
The role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality. You will analyze and triage GitHub issues across trending open-source libraries, set up and configure code repositories, and evaluate unit test coverage and quality.
">
* Main Responsibilities:
* Analyze and triage GitHub issues across trending open-source libraries.
* Set up and configure code repositories, including Dockerization and environment setup.
* Evaluate unit test coverage and quality.
* Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
* Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
">
Requirements:
">
* Strong experience with at least one of the following languages: Python, JavaScript, Java, Go, Rust, C/C++, C#, or Ruby.
* Experience working with well-maintained, widely-used repositories with 500+ stars.
* Proficiency with Git, Docker, and basic software pipeline setup.
* Ability to understand and navigate complex codebases.
* Comfortable running, modifying, and testing real-world projects locally.
">
About the Role:
">
This is a unique opportunity to blend practical software engineering with AI research. As a member of our team, you will have the chance to work on cutting-edge AI projects with leading LLM companies and contribute to the advancement of AI-assisted software development.
">
Benefits:
">
* Work in a fully remote environment.
* Opportunity to work on exciting AI projects.
">
Duration: 1 month with expected start date as next week.