AfterQuery
AfterQueryVerified listing

Graduate Student AI Evaluator

100/hr
Remote
contract
Posted June 26, 2026
Not sure you qualify? Match your resume

Listing checked October 29, 2026 · pay as published by AfterQuery

Key details

Pay
$100/hr
Location
Remote
Job type
contract
Posted
June 26, 2026

Overview

AfterQuery hires graduate students to judge AI work that only a trained specialist can assess. You choose which projects to accept, then work through them on your own schedule, with most windows asking for about 10 to 20 hours a week. A large share of the material is visual: spectra, schematics, maps, clinical images or archival photographs, depending on your discipline. Each judgment you write up becomes the signal that shapes how a multimodal model handles your field.

What You'll Do7

  • Judge drafts and model outputs against the standards of your discipline, reading them the way a specialist would rather than a general audience.
  • Flag errors, vague claims, missing steps and unstated assumptions that a lay reviewer would let pass.
  • Write a structured rationale for every accept, reject or revision call so the decision can be audited.
  • Read and comment on figures, schematics, spectra, maps, clinical scans, artworks or charts that carry the argument in your field.
  • Draft expert-level reference content when a project needs calibration answers or comparison material.
  • Clear the assigned annotation queue inside each project window, roughly 10 to 20 hours of work a week.
  • Take on only the projects that fit around coursework, lab hours and qualifying exams.

Requirements11

  • Enrollment right now in a PhD, Master's, MD or MD/PhD program.
  • Fluency in the visual conventions of your field, whether that means reading spectra, tracing schematics, interpreting maps, assessing clinical images or doing formal visual analysis.
  • Ability to explain in writing why a judgment holds, with reasoning another expert can follow.
  • Reliable internet access and comfort working asynchronously and remotely.
  • Strong written English.
  • Preferred: candidacy or beyond with qualifying exams done, or MS3/MS4 status with clinical rotations under way.
  • Preferred: active research that uses image or visual data such as microscopy, imaging, diagrammatic modeling, CAD, GIS, spectroscopy or archival visual material.
  • Preferred: past work in annotation, data labeling or AI evaluation.
  • Preferred: hands-on familiarity with large language models and multimodal systems.
  • Preferred: quantitative methods training from a science, social science, business or engineering track.
  • Preferred: affiliation with a top research university or a program with strong standing in your discipline.

Who Should Apply

A PhD candidate, master's student or MD/MS3-4 with real depth in one discipline and the writing to defend a judgment. Researchers who already work with visual data (microscopy, GIS, CAD, imaging, spectra) and who have labeled or evaluated material for AI systems fit best.

Salary Insight

The listing sets pay at $100 per hour. Project weeks land between $800 and $1,500 depending on discipline and seniority, and top candidates can reach premium rates. That sits near the top of graduate-level expert evaluation work, which commonly pays well under $100 an hour for annotation and review.

Pay and demand for AI Training roles

Market estimates from live NearSkill listings — separate from this job's published terms.

Aggregated

This role · as published

$100/hr

Taken from the listing itself.

Typical pay · estimated

$70/hour

Median of 1,264 similar roles that publish pay · 301 publish only a top rate; those count at the rate they gave

Most AI Training roles pay $40–$95 per hour. This role's pay sits above that range.

Typical rangeMedian payThis role

Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.

Live similar roles
1,462
Listed in last 30 days
800
Remote
98%

Hiring most right now: micro1 (388) · SME Careers (253) · Mercor (220)

Most requested skills · share of roles

  • ai evaluation
    14%
  • llm evaluation
    12%
  • data annotation
    12%
  • ai training
    12%

Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.

Compare your resume against these roles

Required skills

Data AnnotationData LabelingAI EvaluationLarge Language ModelsMultimodal AIImage AnalysisSpectroscopyGisCadMicroscopyClinical ImagingQuantitative Research MethodsTechnical WritingAcademic Research

How applying works

  1. 1. Pre-screen on NearSkill

    A quick application on NearSkill checks your fit against this role.

  2. 2. Finish on the employer’s site

    We hand you to AfterQuery’s official application page to complete the form.

  3. 3. Wait for a response

    The employer’s hiring team reviews applications and gets back to you.

Share:

Similar jobs

Open roles that match this listing's skills and level.

View all AI Training jobs