
Remote Survey Research Expert for AI Evaluation
Listing checked November 4, 2026 · pay as published by Mercor
Key details
- Pay
- $120/hr
- Location
- Remote
- Job type
- hourly
- Openings
- 4
- Posted
- September 4, 2026
Overview
Mercor pairs an AI research group with practitioners who have built, run, or judged survey work in market research, consumer insights, or behavioural science. The project tests and improves how well advanced AI systems handle survey design, research methodology, respondent behaviour, and evidence quality. You will review surveys for fitness, clarity, and methodological soundness, from question wording to sample composition. The work calls for practical judgment on ambiguous design choices and concise written reasons for each call.
What You'll Do9
- Review surveys for methodological quality, clarity, and fit to purpose.
- Assess question wording for leading language, ambiguity, double-barreled construction, response options, ordering effects, and respondent burden.
- Check screeners, eligibility rules, survey flows, skip logic, display logic, scales, and questionnaire structure.
- Identify sources of sampling, measurement, response, and selection bias.
- Judge whether a survey can produce reliable, interpretable data from the intended population.
- Examine fielding plans, respondent recruitment, quotas, sample makeup, and data-quality controls.
- Apply practical research judgment to design problems that lack a single correct answer.
- Write clear, structured rationales that explain methodological issues and suggest improvements.
- Evaluate AI-generated survey content and research reasoning against professional standards.
Requirements6
- 3+ years of professional experience in survey research, market research, consumer insights, behavioural science, UX research, or a related field.
- Hands-on work designing or fielding surveys in a professional setting.
- Solid grasp of questionnaire design and the common sources of survey error and bias.
- Skill at judging survey methodology, not just running a set questionnaire.
- Strong written communication, with the ability to explain why a design choice is strong or weak.
- High attention to detail and comfort with nuanced calls when information is incomplete or ambiguous.
Preferred Qualifications2
- Experience with respondent panels, sampling strategies, screeners, quotas, or survey fieldwork.
- Familiarity with Qualtrics, SurveyMonkey, Alchemer, Decipher/Forsta, QuestionPro, or similar research tools.
Who Should Apply
Survey researchers, market research and consumer insights managers, behavioural scientists, UX researchers, polling specialists, and research directors with hands-on questionnaire design and fielding experience fit this work. A record of judging survey quality, bias, and sample design matters more than an academic title.
Salary Insight
The engagement pays $120.00 per hour. That rate sits at a senior specialist level for contract survey and consumer insights work and matches practitioners who bring several years of hands-on study design, fielding, and quality review.
Pay and demand for AI Training roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
$120/hr
Taken from the listing itself.
Typical pay · estimated
$68/hour
Median of 1,239 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Most AI Training roles pay $40–$95 per hour. This role's pay sits above that range.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,394
- Listed in last 30 days
- 753
- Remote
- 97%
Hiring most right now: micro1 (377) · SME Careers (253) · Mercor (219)
Most requested skills · share of roles
- ai evaluation14%
- data annotation13%
- llm evaluation12%
- ai training12%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to Mercor’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
MercorMarket Research & Insights Experts
SME CareersMarket Research Expert Remote Contract for AI Data Services
MercorScience Research Expert - AI Evaluation
MercorData Analysis Expert - Remote AI Evaluation
micro1Research Evaluation Specialist (PhD or Masters / Researcher / Professor)
Mercor
