
Physician AI Medical Content Evaluator
Listing checked October 20, 2026 · pay as published by Handshake AI
Key details
- Pay
- Up to $110/hr
- Location
- RemoteUnited States
- Job type
- Part-Time
- Posted
- March 12, 2026
Overview
Handshake AI needs licensed physicians to shape how future AI models handle complex medical questions. You will write challenging clinical questions, supply evidence-based reference answers, and judge model outputs for medical accuracy, reasoning, and safety. The role runs as a remote, asynchronous fellowship, so you set your own hours. Most contributors log 5 to 20 hours each week, with no minimum requirement. You join as a 1099 independent contractor and receive payment through Stripe for each completed task.
What You'll Do6
- Write demanding medical questions that reflect your clinical specialty and real patient scenarios.
- Draft clear reference answers with supporting evidence and step-by-step clinical reasoning.
- Review AI-generated medical responses for factual correctness, logic, and completeness.
- Flag errors, missing details, and unsafe recommendations in AI output.
- Score model performance on complex cases and explain the reasoning behind each score.
- Send targeted feedback that helps the model improve at handling nuanced medical topics.
Requirements6
- MD or DO degree from an accredited medical school.
- Active medical license or a prior license in good standing.
- Deep clinical knowledge across your area of practice.
- Strong written communication skills with the ability to explain complex medical ideas in plain language.
- Experience in medical education, research, or clinical writing (preferred).
- US work authorization.
Who Should Apply
Licensed physicians who enjoy teaching, writing, and dissecting clinical reasoning will fit this project well. The role suits specialists and primary care doctors who can craft tough questions and defend answers with evidence. If you lack a current or prior medical license in good standing, or you do not hold US work authorization, this project will not move forward. Candidates often score low when they submit general medical knowledge instead of specialty-specific examples or when their written answers lack clear support from guidelines and literature. A physician who wants a fixed full-time schedule with steady hours may find this independent contractor setup less suitable.
Salary Insight
Pay reaches up to $110.00 per hour. For project-based AI training work that calls for a licensed MD or DO, this rate sits at the high end and matches physicians with strong clinical writing skills or niche specialty knowledge. Handshake AI pays per task through Stripe each week. The listing sets no minimum hours, and most contributors work 5 to 20 hours per week, so total earnings depend on how many tasks you complete.
Pay and demand for AI Training roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
Up to $110/hr
Taken from the listing itself.
Typical pay · estimated
$68/hour
Median of 1,181 similar roles that publish pay · 299 publish only a top rate; those count at the rate they gave
Most AI Training roles pay $38–$95 per hour. This role's pay sits above that range.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,366
- Listed in last 30 days
- 726
- Remote
- 98%
Hiring most right now: micro1 (340) · SME Careers (253) · Mercor (204)
Most requested skills · share of roles
- ai evaluation15%
- llm evaluation13%
- data annotation13%
- ai training13%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to Handshake AI’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
Handshake AIPhysicians
AfterQueryMedical Expert - AI Clinical Reasoning Contract
SME CareersMedical AI Content Expert for Remote Contract Work
AfterQueryMedical MD Expert - Remote Contract Role
SME CareersMedical Doctor Specialist for AI Content Review
Mercor
