Job Title: Content Strategist
Our organization seeks highly analytical and detail-oriented professionals with hands-on experience in testing AI-generated content to ensure quality, safety, and ethical standards.
Key Responsibilities:
* We are looking for a candidate who can conduct thorough evaluations of large language models to identify vulnerabilities and potential risks.
* The ideal candidate should be able to assess the accuracy, bias, and toxicity of AI responses across various domains including finance, healthcare, and security.
* This position requires a professional who can develop test cases to evaluate the performance and safety compliance of AI-generated responses.
* The selected candidate must collaborate with data scientists, researchers, and engineers to report findings and suggest mitigations.
* A strong background in manual QA and content validation is required to ensure factual consistency and adherence to guidelines.
* Creating evaluation frameworks and scoring rubrics for prompt performance and safety compliance is an essential part of this role.
Documenting findings and edge cases with clarity and structure is crucial for success in this position.