BraintrustVerified listing

AI Assistant Evaluator - AI Research Study

15/hr

Remote · United States only

contract

50 openings

Posted November 11, 2026

Not sure you qualify? Match your resume

Listing checked November 11, 2026 · pay as published by Braintrust

Key details

Pay: $15/hr
Location: Remote · United States onlyUnited States
Job type: contract
Openings: 50
Posted: November 11, 2026

Overview

Turing is running a 16-week research study that puts AI assistants in front of the people who use them every day. You work from your own account on Gemini, Instinct, or Muse, scoring the prompts and replies you encounter against the study's rubric. Time commitment starts at 20 hours per week, with a 40-hour track open to anyone who wants a full schedule. The work is remote from anywhere in the United States, and four of your hours need to overlap with Pacific Time.

What You'll Do6

Read prompts and replies on your assigned assistant and judge them the way a regular user would.
Score response quality and explain your reasoning in written feedback.
Apply the study's evaluation guidelines across every task you pick up.
Stay logged in through your own personal account and complete assigned work over the full 16 weeks.
Reserve four hours of your schedule for overlap with Pacific Time working hours.
Take on tasks on short notice and keep a steady weekly cadence, at either 20 or 40 hours.

Requirements7

At least two weeks of active use of Gemini, Instinct, or Muse on a personal account.
Fluent English, both reading and writing.
Comfort reviewing written prompts and responses and forming a judgment about them.
Current residence in the United States.
Availability to begin right away and stick with the study schedule through 16 weeks.
A weekly commitment of 20 hours, with a 40-hour option for those who want it.
Four hours of overlap with Pacific Time working hours.

Who Should Apply

Someone who already opens Gemini, Instinct, or Muse most days and has thoughts about the answers. The role fits a US-based contractor who can hold 20 hours weekly, overlaps four hours with Pacific Time, and writes clear feedback in English.

Salary Insight

$15.00 per hour, as stated in the listing. At 20 hours per week that comes to about $300 before taxes, and the optional 40-hour track doubles it.

Pay and demand for AI Training roles

Market estimates from live NearSkill listings — separate from this job's published terms.

Aggregated

This role · as published

$15/hr

Taken from the listing itself.

Typical pay · estimated

$70/hour

Median of 1,226 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave

Most AI Training roles pay $40–$100 per hour. This role's pay sits below that range.

Typical rangeMedian payThis role

Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.

Live similar roles: 1,403
Listed in last 30 days: 694
Remote: 99%

Hiring most right now: micro1 (403) · SME Careers (256) · Mercor (174)

Most requested skills · share of roles

ai evaluation
15%
llm evaluation
12%
data annotation
11%
python
11%

Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.

Compare your resume against these roles

Required skills

GeminiInstinctMusePrompt EvaluationResponse Quality AssessmentData AnalysisWritten FeedbackEnglishCommunication

How applying works

1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to Braintrust’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.