
Licensed Physicians - Medical Content Reviewer
Listing checked October 23, 2026 · pay as published by Braintrust
Key details
- Pay
- $100/hr
- Location
- Onsite · Alabama, USA; Alaska, USA; Albany, NY, USA +48 moreUnited States
- Job type
- contract
- Posted
- October 29, 2026
Overview
Mindrift, part of Toloka, connects specialists with project-based AI work for major tech companies, and this engagement sits squarely in medical AI evaluation. You read EHR vignettes that come with a question, a proposed answer, and a trap option built to mislead, then judge how well the item survives scrutiny. Coverage spans diagnosis and treatment across cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems. Three blind reads happen first, then a physician adjudication step resolves disagreements. Expect about 10-20 hours per week while a project is active.
What You'll Do8
- Assess clinical EHR vignettes that pair a patient scenario with a question, a proposed answer, and a misleading trap option.
- Rate each vignette for accuracy and completeness, and flag stems that give the correct answer away.
- Decide whether the proposed answer is clinically correct and whether a grader can score it the same way twice.
- Test whether the reasoning chain reaches its conclusion from vignette facts alone.
- Repair faulty reasoning traces and attach a short written rationale to each correction.
- Score trap quality on diagnosis and treatment items across the major body systems.
- Finish blind reviews before adjudication and submit work by the project deadline.
- Meet the listed acceptance criteria so completed tasks count toward payment.
Requirements7
- MD or DO degree with an active, unrestricted license from a US state board, verifiable with that board.
- Board certification or a completed residency program, along with recent direct patient care.
- Broad multi-system diagnostic and treatment experience gained in internal, family, emergency, or hospital medicine.
- Confident clinical reasoning across differential diagnosis, next-step management, and evidence-based guidelines.
- Written English at C1 level or above.
- Residence in one of the eligible US states listed in the posting.
- Current, hands-on practice as a physician.
Preferred Qualifications4
- Prior work on medical AI evaluation
- Experience reviewing clinical content or exam questions
- Medical annotation or QA background
- Attending-level practice
Who Should Apply
Practicing US physicians who still see patients and can weigh a differential across many organ systems will settle into these reviews fast. The work suits internists, family physicians, and emergency or hospital medicine doctors who want part-time, project-based income alongside clinical duties.
Salary Insight
The posted rate is $100.00 per hour, which sits well above most clinical review and annotation contracts and reflects the active license and current practice bar. Hours depend on project scope, so total earnings follow the 10-20 hours per week an active project tends to involve.
Pay and demand for Healthcare & Medical roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
$100/hr
Taken from the listing itself.
Typical pay · estimated
$66/hour
Median of 1,168 similar roles that publish pay · 300 publish only a top rate; those count at the rate they gave
Most Healthcare & Medical roles pay $38–$92 per hour. This role's pay sits above that range.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,300
- Listed in last 30 days
- 674
- Remote
- 98%
Hiring most right now: micro1 (340) · SME Careers (253) · Mercor (199)
Most requested skills · share of roles
- ai evaluation15%
- data annotation13%
- ai training12%
- llm evaluation12%
Figures from Healthcare & Medical roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to Braintrust’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
SME CareersMedical Doctor Specialist for AI Content Review
Handshake AIPhysician AI Medical Content Evaluator
BraintrustEmergency Medicine Physician - AI Evaluation
MercorGeneral Physician
MercorMedical Expert (M.D./D.O.) - Remote Part-Time
Turing
