
AI Evaluation Specialist - Remote Fellowship
Listing checked October 18, 2026 · pay as published by Handshake AI
Key details
- Pay
- $17–30/hr
- Location
- RemoteUnited States
- Job type
- Part-Time
- Posted
- October 19, 2026
Overview
Handshake AI hires students and graduates to support AI research with leading labs. You will use your academic background to help Large Language Models (LLMs) perform better in specific subjects. Projects run in a remote, async format, and the work includes writing domain-specific prompts and judging LLM responses. No minimum hour commitment applies, and placement depends on project availability. The fellowship is part-time and pays $17 to $30 per hour.
What You'll Do6
- Write domain-specific prompts that test how well a model handles ideas from your academic field.
- Evaluate LLM responses for accuracy, reasoning, and how well they follow instructions.
- Apply detailed project instructions or rubrics to keep each judgment consistent.
- Record your evaluations so researchers can review the reasoning behind them.
- Complete short-term tasks on your own schedule with no minimum hours.
- Switch between topics, guidelines, and project needs as new AI training work opens.
Requirements6
- Current associate, bachelor's, or master's student, or a graduate who already holds a degree.
- Strong attention to detail and a record of following detailed instructions with care.
- Comfort working alone in an asynchronous, remote setting.
- Ability to reason through complex material in at least one academic or technical domain.
- F-1 students may qualify through CPT or OPT; STEM OPT does not qualify. Confirm eligibility with your Designated School Official.
- If your school requires a CPT course, this program may not meet that requirement.
Who Should Apply
The role suits current associate, bachelor's, or master's students and recent graduates who want flexible, project-based AI work. You need a sharp eye for detail and the patience to follow long instructions without cutting corners. Candidates who treat this as a way to apply real subject knowledge to model evaluation tend to fit best. The role is less suitable for anyone who needs guaranteed weekly hours or a permanent full-time schedule. Two common issues that hurt applicants: failing to show how they handle detailed rubrics, and missing work authorization limits, since STEM OPT is not supported.
Salary Insight
Handshake AI lists $17 to $30 per hour for this fellowship. That range matches entry-level, project-based AI evaluation work, and your exact rate may depend on the project you join and your academic background.
Pay and demand for AI Training roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
$17–30/hr
Taken from the listing itself.
Typical pay · estimated
$70/hour
Median of 1,264 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Most AI Training roles pay $40–$95 per hour. This role's pay sits below that range.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,464
- Listed in last 30 days
- 742
- Remote
- 98%
Hiring most right now: micro1 (398) · SME Careers (254) · Mercor (211)
Most requested skills · share of roles
- ai evaluation14%
- llm evaluation13%
- data annotation12%
- ai training11%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to Handshake AI’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
Handshake AIComputer Science Expert - Remote AI Fellowship
Handshake AIEngineering Expert - Remote AI Fellowship
Handshake AIRemote AI Evaluation Specialist in Canada
Handshake AILegal Professionals - Remote AI Research Fellowship
Handshake AIEngineering Professional - AI Fellowship
Handshake AI
