
Emergency Medicine Physician - AI Evaluation
Listing checked October 27, 2026 · pay as published by Braintrust
Key details
- Pay
- $135/hr
- Location
- Remote · United States onlyUnited States
- Job type
- contract
- Posted
- October 31, 2026
Overview
Turing builds evaluation work for advanced AI systems, and this project puts practicing emergency physicians at the center of it. You will design clinical tasks and longitudinal chart scenarios that test how well a model handles emergency decision-making, patient safety and handoffs to EMS. Every case needs reference answers and a rubric another reviewer can apply and reach the same verdict. Emergency medicine judgment drives the work, and clinical reasoning, documentation quality and chart review get graded against your benchmarks. The contract runs about 12 weeks, with a target start of November 2, 2026.
What You'll Do5
- Build demanding clinical tasks, longitudinal chart scenarios, reference answers and scoring rubrics around emergency decision-making, patient safety and EMS handoffs.
- Reconstruct fragmented records, flag contradictions and missing actions, then judge the clinical reasoning, documentation quality and safety behind each response.
- Apply structured rubrics, weigh feedback from specialists and revise cases across calibration rounds.
- Test model output against conclusions a clinician can defend, and correct cases that fall short.
- Review other contributors' work, settle ambiguous clinical or rubric questions and hold quality standards steady across the project.
Requirements5
- At least 8 years of relevant professional experience, with current practice or practice inside the last three years.
- An active physician license plus board certification or a recognized credential appropriate to emergency medicine.
- A relevant healthcare degree or equivalent practical experience.
- Strong clinical reasoning, chart review, documentation and written communication, with conclusions you can defend on clinical grounds.
- Comfort following standardized rubrics, absorbing critique and working through review and calibration cycles.
Preferred Qualifications2
- Familiarity with US clinical guidelines, payer policies, regulatory requirements and healthcare workflows.
- Experience with AI evaluation, clinical content or assessment development, expert review or quality improvement.
Who Should Apply
Board-certified emergency physicians who still see patients, or did within the past three years, and want a hand in how AI handles clinical judgment. Eight or more years in the ED, sharp chart-review habits and comfort writing rubric-based assessments fit this project.
Salary Insight
The role pays USD 135 per hour. Contract rates for physician review work in AI evaluation vary widely, and this figure matches the board-certified, eight-plus-year profile the project asks for. At 20 or 40 hours per week over 12 weeks, the engagement covers roughly 240 to 480 paid hours.
Pay and demand for AI Training roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
$135/hr
Taken from the listing itself.
Typical pay · estimated
$65/hour
Median of 1,151 similar roles that publish pay · 300 publish only a top rate; those count at the rate they gave
Most AI Training roles pay $38–$92 per hour. This role's pay sits above that range.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,284
- Listed in last 30 days
- 668
- Remote
- 98%
Hiring most right now: micro1 (329) · SME Careers (253) · Mercor (200)
Most requested skills · share of roles
- ai evaluation15%
- data annotation13%
- ai training12%
- llm evaluation12%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to Braintrust’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
AfterQueryEMT Expert - Remote Contract AI Evaluation
BraintrustLicensed Physicians - Medical Content Reviewer
BraintrustClinical Pharmacist - AI Evaluation
Handshake AIPhysicians
Handshake AIPhysician AI Medical Content Evaluator
Mercor
