Braintrust
BraintrustVerified listing

Emergency Medicine Physician - AI Evaluation

135/hr
Remote · United States only
contract
Posted October 31, 2026
Not sure you qualify? Match your resume

Listing checked October 27, 2026 · pay as published by Braintrust

Key details

Pay
$135/hr
Location
Remote · United States onlyUnited States
Job type
contract
Posted
October 31, 2026

Overview

Turing builds evaluation work for advanced AI systems, and this project puts practicing emergency physicians at the center of it. You will design clinical tasks and longitudinal chart scenarios that test how well a model handles emergency decision-making, patient safety and handoffs to EMS. Every case needs reference answers and a rubric another reviewer can apply and reach the same verdict. Emergency medicine judgment drives the work, and clinical reasoning, documentation quality and chart review get graded against your benchmarks. The contract runs about 12 weeks, with a target start of November 2, 2026.

What You'll Do5

  • Build demanding clinical tasks, longitudinal chart scenarios, reference answers and scoring rubrics around emergency decision-making, patient safety and EMS handoffs.
  • Reconstruct fragmented records, flag contradictions and missing actions, then judge the clinical reasoning, documentation quality and safety behind each response.
  • Apply structured rubrics, weigh feedback from specialists and revise cases across calibration rounds.
  • Test model output against conclusions a clinician can defend, and correct cases that fall short.
  • Review other contributors' work, settle ambiguous clinical or rubric questions and hold quality standards steady across the project.

Requirements5

  • At least 8 years of relevant professional experience, with current practice or practice inside the last three years.
  • An active physician license plus board certification or a recognized credential appropriate to emergency medicine.
  • A relevant healthcare degree or equivalent practical experience.
  • Strong clinical reasoning, chart review, documentation and written communication, with conclusions you can defend on clinical grounds.
  • Comfort following standardized rubrics, absorbing critique and working through review and calibration cycles.

Preferred Qualifications2

  • Familiarity with US clinical guidelines, payer policies, regulatory requirements and healthcare workflows.
  • Experience with AI evaluation, clinical content or assessment development, expert review or quality improvement.

Who Should Apply

Board-certified emergency physicians who still see patients, or did within the past three years, and want a hand in how AI handles clinical judgment. Eight or more years in the ED, sharp chart-review habits and comfort writing rubric-based assessments fit this project.

Salary Insight

The role pays USD 135 per hour. Contract rates for physician review work in AI evaluation vary widely, and this figure matches the board-certified, eight-plus-year profile the project asks for. At 20 or 40 hours per week over 12 weeks, the engagement covers roughly 240 to 480 paid hours.

Pay and demand for AI Training roles

Market estimates from live NearSkill listings — separate from this job's published terms.

Aggregated

This role · as published

$135/hr

Taken from the listing itself.

Typical pay · estimated

$65/hour

Median of 1,151 similar roles that publish pay · 300 publish only a top rate; those count at the rate they gave

Most AI Training roles pay $38–$92 per hour. This role's pay sits above that range.

Typical rangeMedian payThis role

Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.

Live similar roles
1,284
Listed in last 30 days
668
Remote
98%

Hiring most right now: micro1 (329) · SME Careers (253) · Mercor (200)

Most requested skills · share of roles

  • ai evaluation
    15%
  • data annotation
    13%
  • ai training
    12%
  • llm evaluation
    12%

Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.

Compare your resume against these roles

Required skills

Emergency MedicineClinical ReasoningChart ReviewClinical DocumentationPatient SafetyEms HandoffsClinical GuidelinesRubric DevelopmentAI EvaluationQuality ImprovementHealthcare WorkflowsMedical LicensingBoard CertificationAssessment DevelopmentExpert Review

How applying works

  1. 1. Pre-screen on NearSkill

    A quick application on NearSkill checks your fit against this role.

  2. 2. Finish on the employer’s site

    We hand you to Braintrust’s official application page to complete the form.

  3. 3. Wait for a response

    The employer’s hiring team reviews applications and gets back to you.

Share:

Similar jobs

Open roles that match this listing's skills and level.

View all AI Training jobs