About this role
About GenMD
GenMD is a Stanford spin-off building AI and data infrastructure for healthcare. We grew out of years of work inside Stanford Medicine, alongside world-class researchers and clinicians, and we now work with health systems and data partners on large longitudinal datasets: claims, health records, imaging and clinical notes. We make that data usable for researchers and frontier AI, while patient privacy stays protected.
We're just coming out of stealth, already revenue-generating and well funded. We're intentionally small, move fast, and are focused on building something fundamental. Our CEO is a former Associate Director of AI at Stanford Medicine. See how we work: https://genmd.ai/careers
About the role
We're building clinical benchmarks and training data that teach AI models to reason like clinicians. We need practicing and recently practicing medical experts to review real-world clinical cases, label them and judge model outputs. Your clinical judgment directly shapes how frontier AI models are measured and improved.
What you'll do
- Review de-identified patient records, clinical notes and model responses, and label them against clear guidelines.
- Write and refine grading rubrics and reference answers for clinical reasoning tasks.
- Grade AI model outputs for accuracy, safety and clinical usefulness, and explain where and why a model went wrong.
- Flag ambiguous cases and help improve labeling guidelines with the GenMD team.
What we're looking for
- MD, DO, NP, PA, PharmD, RN or equivalent clinical credential, with direct patient-care experience.
- Specialty experience is welcome (e.g. internal medicine, emergency medicine, radiology, oncology, primary care).
- Careful, consistent and comfortable writing clear explanations.
- Reliable availability of a few hours per week; fully remote.
Compensation
$100 – $175 per hour, depending on credential and specialty.