Note: The job is a remote job and is open to candidates in USA. Sequencing is a company focused on redefining how people understand themselves through their DNA. They are seeking an AI Bioinformatics Benchmarking Engineer to build and operate evaluation and validation infrastructure for AI systems, ensuring their reliability and correctness through automated testing and validation processes.
Responsibilities
- Build and run automated evaluation pipelines for AI outputs end-to-end
- Expand regression datasets that cover variant normalization, transcript ambiguity, and disease-level mapping
- Execute large-scale validation runs across curated VCF datasets, track performance over time, and surface accuracy regressions the moment they appear
- Grow a structured question bank using and related datasets, encoding the edge cases that matter most
- Ship automated regression tests for every AI release and build dashboards that make variant-level and case-level accuracy visible to the whole team
- Partner with engineering to wire validation directly into CI/CD, and diagnose and document failure modes as they emerge
Skills
- Degree in Bioinformatics, Computational Biology, Genetics, or a related field
- Deep, hands-on experience with VCFs and real-world genomic datasets
- Fluency with ClinVar, dbSNP, HGVS standards, and transcript mapping
- A track record building evaluation frameworks or testing pipelines, Langfuse or similar
- Experience evaluating LLM-based systems and standing up automated QA at scale
Benefits
- Comprehensive medical, dental, and vision insurance coverage
- 401(k) with company matching
- Paid time off (PTO)
- Paid volunteer time off
- Fully remote work with home office stipend
- Parental bonding leave
- Clinical-grade whole genome sequencing for you and your family (private and confidential)
Company Overview