Job Title: English Language Specialist
Job Description
Immerse yourself in the world of AI system evaluations, where nuance and attention to detail are paramount. As a Multimodal GenAI Evaluation Analyst, you will be responsible for assessing the outputs generated by Large Language Models (LLMs) across various modalities, including text, image captions, video descriptions, and multimodal prompts.
* Evaluate the quality of LLM outputs against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety.
* Identify subtle errors, hallucinations, or biases in AI responses and apply domain expertise to resolve ambiguous or unclear outputs.
* Provide detailed written feedback, tagging, and scoring of outputs to ensure consistency across the evaluation team.
* Collaborate with Project Managers and Quality Leads to meet accuracy, reliability, and turnaround benchmarks.
Required Skills and Qualifications
To excel in this role, you should possess a strong understanding of language and multimodal communication, with experience working with data annotation tools and software platforms.
* Bachelor's degree or equivalent educational qualification.
* 1+ years of experience in data annotation, LLM evaluation, content moderation, or related AI/ML domains.
* Demonstrated ability to adapt quickly to changing project directions and fast-paced work environments.
* Prior experience creating or annotating complex data specifically for Large Language Model (LLM) training is a plus.