General Physician
Listing checked October 8, 2026 · pay as published by Mercor
Overview
Mercor pairs experienced physicians with a leading AI lab to check how well health AI models handle diagnosis, clinical reasoning, and care workflows. You will review model outputs, score how each answer aligns with accepted medical practice, and write feedback that helps researchers see where a model fails. The work is part-time at 20 or more hours each week and runs for six weeks, with an immediate start. Candidates need an MD or DO, an active unrestricted US license, completed residency, and a current patient-facing practice.
What You'll Do8
- 1Review AI-generated diagnoses, case summaries, and care plans for medical accuracy and safety.
- 2Compare each model response with expert clinical judgment and assign scores based on accepted standards.
- 3Write structured notes that explain where the model succeeds, where it misses key details, and why.
- 4Identify failure modes that could lead to patient harm and document them for the research team.
- 5Provide feedback on clarity, safety, and clinical rigor in the model's written output.
- 6Work with AI researchers through asynchronous channels to support model improvements.
- 7Apply your specialty knowledge to cases involving primary care, internal medicine, or hospital-based care.
- 8Track your review work against project deadlines and maintain consistent scoring.
Requirements8
- 1MD or DO degree from an accredited medical school.
- 2Active, unrestricted US medical license.
- 3Completed residency.
- 4Current practice with direct patient care.
- 53 or more years of post-residency experience in your current role preferred.
- 6Practice in primary care, general internal medicine, family medicine, emergency medicine, or critical care.
- 7Keen attention to detail and strong written communication.
- 8Located in the US.
Who Should Apply
The role suits a licensed physician who still sees patients and has at least three years of post-residency work in primary care, internal medicine, family medicine, emergency medicine, or critical care. You should enjoy writing precise evaluations and feel comfortable scoring another clinician's reasoning against accepted standards. The project is less suitable for physicians who have stopped direct patient care, who hold a license with restrictions, or whose specialty falls outside the listed areas. Applications often lose points when the resume does not show an active, unrestricted US license or does not make the current practice setting clear. Another common issue is leaving out residency completion dates or post-residency years, which reviewers use to confirm fit.
Salary Insight
The posting lists $150.00 per hour. That rate is typical for practicing US physicians with post-residency experience who review clinical AI outputs, and it reflects the specialized medical judgment this project requires. Because the engagement is part-time at 20 or more hours per week for six weeks, your total compensation depends on the number of approved hours you work.
Pay and demand for AI Training roles
AggregatedTypical pay
$70/hour
This role
$150/hr
Most AI Training roles pay $37–$95 per hour. This role's pay sits above that range.
Based on 965 similar roles that publish pay · 300 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,094
- Listed in last 30 days
- 412
- Remote
- 98%
Hiring most right now: micro1 (291) · SME Careers (253) · Handshake AI (132)
Most requested skills · share of roles
- ai training15%
- ai evaluation13%
- llm evaluation12%
- data annotation11%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$150/hr
Required Skills
Application Tip
Before the 25-minute interview, prepare a short summary of your license state and number, residency completion date, current practice setting, and weekly patient care hours. Name the exact specialty from the listed areas, such as internal medicine or emergency medicine, and give one or two examples of how you evaluate clinical accuracy or patient safety in your current work.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedMedical Expert (M.D./D.O.) - Remote Part-Time
Mercor keeps this listing open for physicians who want to shape how frontier AI models handle clinical reasoning. The work fits around your practice: you might write a clinical vignette from a real case, complete with presentation, labs, and imaging, then supply the attending-level answer used as a reference. Other projects ask you to grade model output on diagnostic reasoning, checking whether a differential follows a sensible order, whether the model anchors on a first impression, and whether the proposed workup matches guidelines. You also flag recommendations that read well in a textbook but fail the patient in front of you because of comorbidities, contraindications, or access limits. Projects start on short notice, so Mercor draws from this pool when client demand matches your specialty.
Mercor
VerifiedMedical Expert - Remote AI Evaluation & Review
Mercor recruits health professionals who can supply the medical judgment that top AI research teams cannot generate on their own. The medicine pool is an open call, not a single opening, so it remains live while projects start on short notice. When a project launches, you may write a case from your practice with the presentation, workup, constraints, and reference answer that sets the standard for grading a model's attempt. You may also review model output for clinical reasoning, checking whether the differential follows a sensible order, whether a guideline applies to the patient, and whether the care plan is safe to carry out. Mercor sets rates per project, and most work is remote and part-time.
Mercor
VerifiedPhysician Talent Network
Mercor is building a network of physicians who want to shape the future of AI in medicine. As a member, you'll work on contract projects for leading AI labs, helping train and evaluate models using your clinical expertise. This is an ongoing talent pool — you apply once, and when a relevant project arises (typically 15-30 hours per week), you'll be considered. Fully remote and $110–$250/hour.
Handshake AI
VerifiedPhysician AI Medical Content Evaluator
Handshake AI needs licensed physicians to shape how future AI models handle complex medical questions. You will write challenging clinical questions, supply evidence-based reference answers, and judge model outputs for medical accuracy, reasoning, and safety. The role runs as a remote, asynchronous fellowship, so you set your own hours. Most contributors log 5 to 20 hours each week, with no minimum requirement. You join as a 1099 independent contractor and receive payment through Stripe for each completed task.
AfterQuery
VerifiedMedical MD Expert - Remote Contract Role
AfterQuery, a YC-backed startup, needs practicing or recently graduated physicians to build and grade the clinical material that trains its medical AI. You will write case studies and decision scenarios drawn from real practice, then score how model outputs hold up against clinical guidelines and standard care. The work sits at the meeting point of medical education and digital health, with roughly 20 hours a week on a remote, asynchronous schedule. Cases you design directly shape whether these systems give sound advice when clinicians and patients rely on them.
Mercor
VerifiedClinical Medicine Domain Expert
A leading AI lab's GenAI team needs a practicing clinician to shape how frontier models reason about real clinical work. You will audit medical knowledge tasks for clinical soundness, write the instruction specs and golden solutions that set the standard for correctness, and design benchmarks that track model improvement. This full-time W-2 role runs through Cincinnatus LLC, with placement inside the client's own tools and workflows. Expect a hybrid schedule in the Bay Area, with on-site days each week, so local residency or a self-funded relocation is required.