Handshake AI
Handshake AIVerified listing

AI Evaluation Specialist - Remote Fellowship

17–30/hr
Remote
Part-Time
Posted October 19, 2026
Not sure you qualify? Match your resume

Listing checked October 18, 2026 · pay as published by Handshake AI

Key details

Pay
$17–30/hr
Location
RemoteUnited States
Job type
Part-Time
Posted
October 19, 2026

Overview

Handshake AI hires students and graduates to support AI research with leading labs. You will use your academic background to help Large Language Models (LLMs) perform better in specific subjects. Projects run in a remote, async format, and the work includes writing domain-specific prompts and judging LLM responses. No minimum hour commitment applies, and placement depends on project availability. The fellowship is part-time and pays $17 to $30 per hour.

What You'll Do6

  • Write domain-specific prompts that test how well a model handles ideas from your academic field.
  • Evaluate LLM responses for accuracy, reasoning, and how well they follow instructions.
  • Apply detailed project instructions or rubrics to keep each judgment consistent.
  • Record your evaluations so researchers can review the reasoning behind them.
  • Complete short-term tasks on your own schedule with no minimum hours.
  • Switch between topics, guidelines, and project needs as new AI training work opens.

Requirements6

  • Current associate, bachelor's, or master's student, or a graduate who already holds a degree.
  • Strong attention to detail and a record of following detailed instructions with care.
  • Comfort working alone in an asynchronous, remote setting.
  • Ability to reason through complex material in at least one academic or technical domain.
  • F-1 students may qualify through CPT or OPT; STEM OPT does not qualify. Confirm eligibility with your Designated School Official.
  • If your school requires a CPT course, this program may not meet that requirement.

Who Should Apply

The role suits current associate, bachelor's, or master's students and recent graduates who want flexible, project-based AI work. You need a sharp eye for detail and the patience to follow long instructions without cutting corners. Candidates who treat this as a way to apply real subject knowledge to model evaluation tend to fit best. The role is less suitable for anyone who needs guaranteed weekly hours or a permanent full-time schedule. Two common issues that hurt applicants: failing to show how they handle detailed rubrics, and missing work authorization limits, since STEM OPT is not supported.

Salary Insight

Handshake AI lists $17 to $30 per hour for this fellowship. That range matches entry-level, project-based AI evaluation work, and your exact rate may depend on the project you join and your academic background.

Pay and demand for AI Training roles

Market estimates from live NearSkill listings — separate from this job's published terms.

Aggregated

This role · as published

$17–30/hr

Taken from the listing itself.

Typical pay · estimated

$70/hour

Median of 1,264 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave

Most AI Training roles pay $40–$95 per hour. This role's pay sits below that range.

Typical rangeMedian payThis role

Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.

Live similar roles
1,464
Listed in last 30 days
742
Remote
98%

Hiring most right now: micro1 (398) · SME Careers (254) · Mercor (211)

Most requested skills · share of roles

  • ai evaluation
    14%
  • llm evaluation
    13%
  • data annotation
    12%
  • ai training
    11%

Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.

Compare your resume against these roles

Required skills

Large Language ModelsLLM EvaluationPrompt DevelopmentAI TrainingModel EvaluationAI ResearchRemote CollaborationAsynchronous WorkAcademic ResearchInstruction FollowingCritical Reasoning

How applying works

  1. 1. Pre-screen on NearSkill

    A quick application on NearSkill checks your fit against this role.

  2. 2. Finish on the employer’s site

    We hand you to Handshake AI’s official application page to complete the form.

  3. 3. Wait for a response

    The employer’s hiring team reviews applications and gets back to you.

Share:

Similar jobs

Open roles that match this listing's skills and level.

View all AI Training jobs