
Graduate Student AI Evaluator
Listing checked October 29, 2026 · pay as published by AfterQuery
Key details
- Pay
- $100/hr
- Location
- Remote
- Job type
- contract
- Posted
- June 26, 2026
Overview
AfterQuery hires graduate students to judge AI work that only a trained specialist can assess. You choose which projects to accept, then work through them on your own schedule, with most windows asking for about 10 to 20 hours a week. A large share of the material is visual: spectra, schematics, maps, clinical images or archival photographs, depending on your discipline. Each judgment you write up becomes the signal that shapes how a multimodal model handles your field.
What You'll Do7
- Judge drafts and model outputs against the standards of your discipline, reading them the way a specialist would rather than a general audience.
- Flag errors, vague claims, missing steps and unstated assumptions that a lay reviewer would let pass.
- Write a structured rationale for every accept, reject or revision call so the decision can be audited.
- Read and comment on figures, schematics, spectra, maps, clinical scans, artworks or charts that carry the argument in your field.
- Draft expert-level reference content when a project needs calibration answers or comparison material.
- Clear the assigned annotation queue inside each project window, roughly 10 to 20 hours of work a week.
- Take on only the projects that fit around coursework, lab hours and qualifying exams.
Requirements11
- Enrollment right now in a PhD, Master's, MD or MD/PhD program.
- Fluency in the visual conventions of your field, whether that means reading spectra, tracing schematics, interpreting maps, assessing clinical images or doing formal visual analysis.
- Ability to explain in writing why a judgment holds, with reasoning another expert can follow.
- Reliable internet access and comfort working asynchronously and remotely.
- Strong written English.
- Preferred: candidacy or beyond with qualifying exams done, or MS3/MS4 status with clinical rotations under way.
- Preferred: active research that uses image or visual data such as microscopy, imaging, diagrammatic modeling, CAD, GIS, spectroscopy or archival visual material.
- Preferred: past work in annotation, data labeling or AI evaluation.
- Preferred: hands-on familiarity with large language models and multimodal systems.
- Preferred: quantitative methods training from a science, social science, business or engineering track.
- Preferred: affiliation with a top research university or a program with strong standing in your discipline.
Who Should Apply
A PhD candidate, master's student or MD/MS3-4 with real depth in one discipline and the writing to defend a judgment. Researchers who already work with visual data (microscopy, GIS, CAD, imaging, spectra) and who have labeled or evaluated material for AI systems fit best.
Salary Insight
The listing sets pay at $100 per hour. Project weeks land between $800 and $1,500 depending on discipline and seniority, and top candidates can reach premium rates. That sits near the top of graduate-level expert evaluation work, which commonly pays well under $100 an hour for annotation and review.
Pay and demand for AI Training roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
$100/hr
Taken from the listing itself.
Typical pay · estimated
$70/hour
Median of 1,264 similar roles that publish pay · 301 publish only a top rate; those count at the rate they gave
Most AI Training roles pay $40–$95 per hour. This role's pay sits above that range.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,462
- Listed in last 30 days
- 800
- Remote
- 98%
Hiring most right now: micro1 (388) · SME Careers (253) · Mercor (220)
Most requested skills · share of roles
- ai evaluation14%
- llm evaluation12%
- data annotation12%
- ai training12%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to AfterQuery’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
AfterQueryUndergraduate AI Evaluation Researcher
AfterQueryExpert Data Annotator
micro1Visual Content Evaluator
BraintrustSTEM PhD Expert for AI Reasoning & Evaluation
Handshake AIAI Evaluation Specialist - Remote Fellowship
micro1
