Clinical Medicine Domain Expert
Listing checked August 29, 2026 · pay as published by Mercor
Overview
A leading AI lab's GenAI team needs a practicing clinician to shape how frontier models reason about real clinical work. You will audit medical knowledge tasks for clinical soundness, write the instruction specs and golden solutions that set the standard for correctness, and design benchmarks that track model improvement. This full-time W-2 role runs through Cincinnatus LLC, with placement inside the client's own tools and workflows. Expect a hybrid schedule in the Bay Area, with on-site days each week, so local residency or a self-funded relocation is required.
What You'll Do5
- 1Audit clinical knowledge tasks and model outputs for missing behaviors, thin reasoning, unsafe recommendations, and answers that would not survive clinical scrutiny.
- 2Write instruction specifications and golden solutions that define correct responses to complex clinical problems.
- 3Design new clinical tasks and evaluation sets that reflect how medicine is actually practiced, including building medicine-specific skills and tools with the research team.
- 4Collaborate with client researchers and specialists in adjacent fields to keep evaluation standards consistent and translate tacit clinical judgment into explicit criteria.
- 5Deliver precise written feedback that helps non-clinician team members understand why a model answer is clinically weak or dangerous.
Requirements8
- 1MD or DO from an accredited medical school and a completed residency in a recognized specialty.
- 2At least four years of post-residency clinical practice in a defined specialty; residency and fellowship training do not count.
- 3Active, unrestricted medical license in at least one U.S. state and board certification in your specialty.
- 4Genuine specialization in a clinical field such as internal medicine, oncology, radiology, emergency medicine, surgery, psychiatry, or a medical subspecialty.
- 5Progression to a senior level like Attending Physician, Medical Director, Division Chief, Associate or full Professor, or Chief Medical Officer, with real ownership of clinical decisions.
- 6Hands-on professional experience using large language models and the ability to distinguish well-reasoned answers from plausible-sounding wrong ones.
- 7Available to commit 40 hours per week for an initial six-month engagement.
- 8Based in the Bay Area or willing to relocate there at your own cost; able to work on-site multiple days per week.
Who Should Apply
The ideal candidate is a board-certified physician with at least four years of independent post-residency practice and a genuine specialty that shows up in daily decisions. This role is not for residents, fellows, or generalists who lack a strong clinical identity, and it will not work for physicians who cannot come on-site in the Bay Area multiple days per week. Candidates who cannot commit to a 40-hour workweek for six months or who have only used LLMs recreationally will not move forward. Rejection often follows when applicants list '4+ years experience' but cannot prove it with board certification and a current unrestricted license, or when they describe AI experience without concrete examples of evaluating model outputs.
Salary Insight
The rate is $70-$110 per hour, which lands at the senior end for clinical advisory work because it demands board certification, four plus years of post-residency practice, and real AI fluency. The final offer depends on your specialty and the depth of your LLM evaluation experience.
Pay and demand for AI Training roles
AggregatedTypical pay
$70/hour
This role
$70–$110/hr
Most AI Training roles pay $40–$100 per hour. This role's pay falls inside that range.
Based on 1,047 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,197
- Listed in last 30 days
- 450
- Remote
- 98%
Hiring most right now: micro1 (353) · SME Careers (253) · Mercor (145)
Most requested skills · share of roles
- ai training13%
- ai evaluation12%
- llm evaluation12%
- data annotation9%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$70–110/hr
Required Skills
Application Tip
Submit two or three written critiques of AI-generated clinical answers, showing exactly why each one would fail in a real patient encounter. Name your board certification and your years of independent practice at the top of your resume, and list any experience building evaluation sets or instruction guidelines.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
AfterQuery
VerifiedMedical MD Expert - Remote Contract Role
AfterQuery, a YC-backed startup, needs practicing or recently graduated physicians to build and grade the clinical material that trains its medical AI. You will write case studies and decision scenarios drawn from real practice, then score how model outputs hold up against clinical guidelines and standard care. The work sits at the meeting point of medical education and digital health, with roughly 20 hours a week on a remote, asynchronous schedule. Cases you design directly shape whether these systems give sound advice when clinicians and patients rely on them.
Micro1
VerifiedMedical Doctor - Physician Expert
micro1 is looking for Medical Doctor - Physician Experts to support a customer's advanced healthcare project. You will apply your clinical knowledge to help train next-generation AI systems, shaping how models learn and reason through high-quality, real-world input. No prior AI experience is needed. Your domain expertise in diagnostic analysis, medicine, and healthcare protocols is what matters. You will analyze patient and operational data to improve healthcare outcomes and inform the development of intelligent systems that support medical decision-making and workflow improvements.
AfterQuery
VerifiedMedical Expert - AI Clinical Reasoning Contract
AfterQuery brings physicians, nurses, PAs and other clinicians into a remote contract role on its Medicine team. You will write tough clinical prompts and score AI answers for accuracy and sound medical reasoning. The work touches clinical diagnosis, treatment planning, pharmacology and patient safety. Plan for 40 hours each week at $50 to $200 per hour, with an assessment before anyone reviews your application.
Mercor
VerifiedPhysician (MD/DO) - Remote Clinical AI Evaluation
Mercor maintains a shared pool of residency-trained physicians who take on non-clinical work building and judging clinical AI systems. Your clinical judgment feeds into grading-criteria development, clinical dialogue evaluation, and structured annotation, the raw material that decides how a model gets measured. The role carries no patient care and no live diagnostic duty. Matching happens after onboarding and depends on your specialty, availability, and interest, so you can rotate between workstreams as priorities shift. Physicians set the standard these systems are held to, and here you write it.
Turing
VerifiedResident Medical Specialist (MD/DO)
This remote role places licensed physicians at the center of AI evaluation for clinical reasoning. You will design test scenarios, assessment frameworks, and gap analyses for medical AI systems, collaborating directly with AI researchers. The engagement is flexible and can fit around your clinical schedule, requiring up to 30 hours per week over a one-month contract, with possible extensions based on performance. Your hands-on medical judgment will shape how AI models handle real-world diagnostic and management problems.
Mercor
VerifiedMedical Expert (M.D./D.O.) - Remote Part-Time
Mercor keeps this listing open for physicians who want to shape how frontier AI models handle clinical reasoning. The work fits around your practice: you might write a clinical vignette from a real case, complete with presentation, labs, and imaging, then supply the attending-level answer used as a reference. Other projects ask you to grade model output on diagnostic reasoning, checking whether a differential follows a sensible order, whether the model anchors on a first impression, and whether the proposed workup matches guidelines. You also flag recommendations that read well in a textbook but fail the patient in front of you because of comorbidities, contraindications, or access limits. Projects start on short notice, so Mercor draws from this pool when client demand matches your specialty.