Note: The job is a remote job and is open to candidates in USA. LegalTrustAI is seeking a Research Analyst to evaluate and provide structured written feedback on responses generated by LLMs. The role involves reviewing AI outputs, applying critical assessments, and ensuring high-quality evaluations to improve AI systems.
Responsibilities
- Review and assess outputs from LLMs against structured evaluation guidelines, identifying errors, gaps in reasoning, and areas for improvement
- Write clear, precise, and well-evidenced written rationales that go beyond surface-level observations
- Apply consistent, honest judgment including critical assessments when evaluating model-generated content
- Follow detailed task guidelines with strict attention to detail and accurate, reproducible scoring
Skills
- Strong experience in legal analysis, critical reading, or structured written evaluation within a professional or academic context
- Strong experience in identifying nuance, implicit meaning, and logical gaps across complex written material
- Strong experience producing high-quality written work independently, without reliance on AI writing tools
- Native English fluency required
- Bachelor's degree from a globally ranked institution
Company Overview