STEM PhD Expert for AI Reasoning & Evaluation
Listing checked October 27, 2026 · pay as published by Braintrust
Key details
- Pay
- $50–150/hr
- Location
- Remote · United States; Canada; Argentina +5 moreArgentina, Australia, Canada, United Kingdom, Mexico +3 more
- Job type
- contract
- Openings
- 50
- Posted
- October 29, 2026
Overview
Outlier seeks PhD-level experts to train and evaluate advanced AI models across machine learning, computer science, engineering, statistics, physics, and mathematics. The contract runs remote with flexible hours and a short-term window through the end of June, with a possible extension based on project needs. You will review AI-generated text in your field, mark where the model reasons well or fails, and help raise the bar on technical answers. The work also includes data annotation and ranking of model responses, so your academic judgment feeds straight into model quality.
What You'll Do5
- Assess domain-specific text from AI models for factual accuracy and relevance to your field.
- Write and answer questions tied to machine learning and AI topics.
- Score and rank model responses against domain standards.
- Flag subtle errors in technical reasoning and explain what went wrong.
- Review AI-generated explanations in your specialty for gaps, unsupported claims, and faulty logic.
Requirements3
- A completed PhD or one in its final stages in machine learning, AI, computer science, engineering, statistics, mathematics, physics, or a related quantitative field.
- Strong analytical and critical-thinking skills, including the ability to catch subtle errors in technical reasoning.
- Fluent written English and a clear writing style for complex technical ideas.
Preferred Qualifications3
- Research experience in academia or industry
- Prior work with data annotation or AI model evaluation
- Experience reviewing or publishing research papers
Who Should Apply
The role suits a PhD candidate or recent PhD in machine learning, computer science, engineering, statistics, mathematics, or physics who can spot errors in technical reasoning and write clear English. Research experience, paper review work, or prior data annotation practice will help you settle into the evaluation tasks.
Salary Insight
Pay ranges from $50 to $150 per hour. The final rate depends on your field, depth of experience, and assessment performance.
Pay and demand for AI Training roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
$50–150/hr
Taken from the listing itself.
Typical pay · estimated
$70/hour
Median of 1,250 similar roles that publish pay · 301 publish only a top rate; those count at the rate they gave
Most AI Training roles pay $40–$95 per hour. This role's pay sits above that range.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,391
- Listed in last 30 days
- 731
- Remote
- 98%
Hiring most right now: micro1 (387) · SME Careers (253) · Mercor (220)
Most requested skills · share of roles
- ai evaluation14%
- data annotation13%
- llm evaluation12%
- ai training12%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to Braintrust’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
micro1Research Evaluation Specialist (PhD or Masters / Researcher / Professor)
micro1Computer Science Expert PhD for AI Training Remote Role
BraintrustPhD in Quantitative Finance, AI Research Evaluator
AfterQueryPhD Domain Expert - Remote AI Research Contract
Handshake AISTEM PhD AI Trainer - LATAM Remote
micro1