Job Title: Expert Language Assessor
About the Role:
iMerit seeks detail-oriented and analytically minded professionals to evaluate AI system outputs across different modalities: text, image, video, and multimodal interactions.
Responsibilities:
* Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts).
* Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety.
* Identify subtle errors, hallucinations, or biases in AI responses.
* Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs.
* Provide detailed written feedback, tagging, and scoring of outputs to ensure consistency across the evaluation team.
* Collaborate with Project Managers and Quality Leads to meet accuracy, reliability, and turnaround benchmarks.
Requirements & Skills:
* Bachelor's degree/ diploma or equivalent educational qualification.
* 1+ years of experience in data annotation, LLM evaluation, content moderation, or related AI/ML domains.
* Demonstrated experience working with data annotation tools and software platforms.
* Strong understanding of language and multimodal communication (instruction following in image generation, fact-checking, narrative coherence in video, etc.).
* Ability to adapt quickly to changing project directions and fast-paced work environments.
Your Benefits:
This role offers opportunities for professional growth and development. As an expert language assessor, you will contribute to refining evaluation guidelines and collaborate with cross-functional teams to achieve high-quality results.