Note: The job is a remote job and is open to candidates in USA. LegalTrustAI is seeking a Quality Assurance Analyst to evaluate and provide structured feedback on AI-generated responses. The role involves assessing outputs from language learning models and contributing to research projects aimed at improving AI systems.
Responsibilities
- Review and assess outputs from LLMs against structured evaluation guidelines, identifying errors, gaps in reasoning, and areas for improvement
- Write clear, precise, and well-evidenced written rationales that go beyond surface-level observations
- Apply consistent, honest judgment including critical assessments when evaluating model-generated content
- Follow detailed task guidelines with strict attention to detail and accurate, reproducible scoring
Skills
- Strong experience in legal analysis, critical reading, or structured written evaluation within a professional or academic context
- Strong experience in identifying nuance, implicit meaning, and logical gaps across complex written material
- Strong experience producing high-quality written work independently, without reliance on AI writing tools
- Native English fluency required
- Bachelor's degree from a globally ranked institution
Benefits
- Flexible / Self-scheduled
Company Overview