Improve AI-Generated Content with Our Team
We are seeking highly analytical and detail-oriented professionals to join our team. The ideal candidate will help us rigorously test and evaluate AI-generated content.
Job Description:
Our goal is to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards. This involves conducting thorough evaluations of AI-generated content across multiple domains.
* Conduct Red Teaming exercises to identify adversarial outputs from large language models.
* Evaluate and stress-test AI prompts to uncover potential failure modes.
* Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.
* Collaborate with data scientists and safety researchers to report risks and suggest mitigations.
* Perform manual QA and content validation across model versions.
Key Responsibilities:
Red Teaming Expertise:
As a Red Teaming Expert, you will be responsible for identifying adversarial outputs and developing strategies to mitigate them. You will also collaborate with other experts to develop and implement robust testing protocols.
Prompt Evaluation Expertise:
As a Prompt Evaluation Expert, you will be responsible for designing and evaluating AI prompts to identify potential failure modes. You will work closely with data scientists and safety researchers to develop and implement effective testing protocols.
Requirements:
* Proven experience in AI red teaming or LLM safety testing.
* Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI.
* Strong background in Quality Assurance, content review, or test case development for AI/ML systems.
* Excellent critical thinking, pattern recognition, and analytical writing skills.
Preferred Qualifications:
* Experience in risk assessment, red team security testing, or AI policy & governance.
* Background in linguistics, psychology, or computational ethics.
If you have a passion for improving AI-generated content and a strong background in the relevant fields, we encourage you to apply.