EMT Expert - Remote Contract AI Evaluation
Listing checked October 29, 2026 · pay as published by AfterQuery
Key details
- Pay
- $53/hr
- Location
- Remote
- Job type
- contract
- Posted
- August 27, 2026
Overview
AfterQuery assembles the expert evaluation data that frontier AI labs use to test how models reason in real professional work, and this contract role puts your road experience at the center of that loop. You will draft prehospital scenarios that run from dispatch through handoff, then judge model responses on protocol accuracy and scene safety. Each reference answer has to carry the field reasoning behind a call, which is how advice that sounds right but would hurt someone on scene gets caught. The work runs async with no shifts, no station time, and a floor of 10 hours each week.
What You'll Do5
- Draft realistic prehospital scenarios that open at dispatch and close with the handoff to receiving care.
- Write reference answers that lay out the field reasoning behind every protocol decision, not just the final call.
- Score model output for protocol accuracy and for how well it keeps the scene safe.
- Flag responses that read well but carry advice a provider should never follow on a live call.
- Hold each scenario to BLS scope and current assessment practice so the evaluation matches what crews actually face.
Requirements5
- NREMT certification backed by an active EMT license in your state.
- Two or more years of field work on a 911 or interfacility service.
- Depth in patient assessment, BLS protocols and scene management.
- Written English clear enough for another provider to follow your reasoning from dispatch to handoff.
- At least 10 hours of availability each week, with no ceiling on the upper end.
Who Should Apply
EMTs with 911 or interfacility miles behind them who can explain why a protocol call held up on scene. High volume urban system time, FTO or CE instructor work, AEMT certification or active paramedic school enrollment all strengthen a file.
Salary Insight
$53.00/hr sits mid-band against the posted $40 to $65 range, and the final number tracks your experience rather than dropping after you start. Pay lands weekly through Stripe for hours you log as an independent contractor.
Pay and demand for AI Training roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
$53/hr
Taken from the listing itself.
Typical pay · estimated
$68/hour
Median of 1,169 similar roles that publish pay · 299 publish only a top rate; those count at the rate they gave
Most AI Training roles pay $38–$95 per hour. This role's pay falls inside that range.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,351
- Listed in last 30 days
- 719
- Remote
- 98%
Hiring most right now: micro1 (331) · SME Careers (253) · Mercor (201)
Most requested skills · share of roles
- ai evaluation15%
- llm evaluation13%
- data annotation13%
- ai training13%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to AfterQuery’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
AfterQueryParamedic Expert - Remote Contract (ALS)
BraintrustEmergency Medicine Physician - AI Evaluation
AfterQueryMedical Expert - AI Clinical Reasoning Contract
AfterQueryElectrician Expert - Remote Contract Role
AfterQueryRespiratory Therapist Expert
Turing