Job Description
We are seeking analytical professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us test and evaluate AI-generated content to identify vulnerabilities and ensure compliance with safety and quality standards.
The role involves conducting Red Teaming exercises, evaluating AI prompts, developing test cases, and collaborating with data scientists to report risks and suggest mitigations. Strong critical thinking and analytical writing skills are required.
A strong background in Quality Assurance, content review, or test case development for AI/ML systems is necessary. Experience in risk assessment, red team security testing, or AI policy & governance is a plus.
Key Responsibilities:
* Conduct Red Teaming exercises to identify adversarial outputs from large language models.
* Evaluate and stress-test AI prompts across multiple domains.
* Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential.
* Collaborate with data scientists to report risks and suggest mitigations.
* Perform manual QA and content validation across model versions.
* Create evaluation frameworks and scoring rubrics for prompt performance.
Requirements:
* Proven experience in AI red teaming, LLM safety testing, or adversarial prompt design.
* Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI.
* Strong background in Quality Assurance, content review, or test case development for AI/ML systems.
* Excellent critical thinking, pattern recognition, and analytical writing skills.
Preferred Qualifications:
* Prior work with teams involved in LLM safety initiatives.
* Experience in risk assessment, red team security testing, or AI policy & governance.
Next Steps:
To proceed further in the evaluation process, complete two assessments: Assessment Test and Language test. Once both are successfully completed, you will be eligible for onboarding.
Action Required: Register on XConnect platform. Please take a few minutes to complete your profile. All project onboarding, communication, and documentation are managed through this platform.