Job Description
We are seeking professionals with analytical and detail-oriented skills to test and evaluate AI-generated content.
The ideal candidate will rigorously assess AI outputs for vulnerabilities, risks, and compliance with safety, ethical, and quality standards.
Key Responsibilities
* Conduct Red Teaming exercises to identify harmful or unsafe outputs from large language models.
* Evaluate and stress-test AI prompts across multiple domains to uncover potential failure modes.
* Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.
* Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
* Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
* Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
* Document findings, edge cases, and vulnerability reports with high clarity and structure.
Requirements
* Proven experience in AI red teaming, LLM safety testing, or adversarial prompt design.
* Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI.
* Strong background in Quality Assurance, content review, or test case development for AI/ML systems.
* Understanding of LLM behaviors, failure modes, and model evaluation metrics.
* Excellent critical thinking, pattern recognition, and analytical writing skills.
* Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
Preferred Qualifications
* Prior work with teams focused on LLM safety initiatives.
* Experience in risk assessment, red team security testing, or AI policy & governance.
* Background in linguistics, psychology, or computational ethics is a plus.
Next Steps
To proceed further in the evaluation process, you will need to complete two assessments:
1. Subject-matter assessment evaluating your linguistic and analytical skills.
2. Versant English Proficiency Test focusing on spoken and written English proficiency; a C1 or C2 level is required.
Once both assessments are successfully completed, you will be eligible for onboarding. You will also receive an invitation to our internal job platform where all project onboarding, communication, and documentation are managed.
How to Apply
Please share your resume at: ******