AI Evaluation Analyst
We are seeking detail-oriented and analytically minded individuals to evaluate AI system outputs across multiple modalities.
* Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety.
* Identify subtle errors, hallucinations, or biases in AI responses.
* Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs.
* Provide detailed written feedback, tagging, and scoring of outputs to ensure consistency across the evaluation team.
* Collaborate with project managers and quality leads to meet accuracy, reliability, and turnaround benchmarks.