Senior Software Engineer - AI-Powered Software Development
About the Role
We are seeking a skilled Senior Software Engineer to join our team and contribute to the development of high-quality evaluation and training datasets for Large Language Models (LLMs). You will be working at the intersection of software engineering, open-source ecosystems, and frontier AI.
Key Responsibilities:
* Collaborate with AI researchers to design and implement evaluation and training datasets.
* Evaluate model-generated code responses using a structured ranking system.
* Review and compare code diffs for correctness, quality, style, and efficiency.
* Maintain high consistency and objectivity across evaluations.
Required Skills and Qualifications
* 7+ years of professional software engineering experience in top-tier product companies.
* Strong fundamentals in software design, coding best practices, and debugging.
* Excellent ability to assess code quality, correctness, and maintainability.
* Proficient with code review processes and reading diffs in real-world repositories.
* Exceptional written communication skills to articulate evaluation rationale clearly.
Engagement Details
* Commitment: ~20 hours/week.
* Type: Contractor.
* Duration: 1 month (potential extensions based on performance and fit).