Research Evaluation Specialist (PhD or Masters / Researcher / Professor)
Listing checked October 21, 2026 · pay as published by micro1
Overview
micro1 seeks Research Evaluation Specialists with a PhD or Masters to build rigorous test material for advanced AI model evaluation on a customer project. You will craft original, high-difficulty question-and-answer pairs at the frontier of your discipline, then verify and document answers using primary sources and authoritative references. The role is remote and worldwide, about 15 hours per week, with output-based pay. Prior experience in AI training, data labeling, or model evaluation is required.
What You'll Do6
- 1Compose original, high-difficulty question-and-answer pairs that rigorously test AI model capabilities at the cutting edge of your field.
- 2Source, verify, and thoroughly document answers using primary sources and authoritative references, including clear citations and reasoning.
- 3Design questions that demand advanced reasoning, methodological nuance, or synthesis across multiple sources, ensuring resistance to oversimplified or shortcut solutions.
- 4Test questions against AI systems, identify items that are not sufficiently challenging, and iteratively increase complexity while maintaining accuracy.
- 5Write each question and answer with high precision and clarity, eliminating ambiguity and supporting defensible responses.
- 6Integrate reviewer feedback and consistently uphold all project guidelines and quality standards throughout your deliverables.
Requirements7
- 1Masters or PhD completed, active candidacy, or equivalent research experience as a specialist, researcher, assistant professor, or professor in your domain.
- 2Demonstrated track record of scholarly research, in-depth subject matter expertise, and familiarity with primary literature.
- 3Exceptional analytical thinking, close attention to detail, and strong written communication skills in English.
- 4Experience sourcing and triangulating information from authoritative references.
- 5Proven self-direction and reliability in delivering expert-level work independently within remote engagements.
- 6Skill in composing challenging, original, and methodologically sound questions.
- 7Prior experience in AI training, data labeling, or model evaluation is required.
Who Should Apply
The ideal candidate holds a PhD or Masters (or equivalent research experience) and has a strong publication or research record in their field. They have hands-on experience with AI training, data labeling, or model evaluation, and can work independently to produce precise, well-sourced questions and answers.
Salary Insight
Compensation is $30 to $60 per hour, paid per task that meets project specifications. Time per task varies with experience and workflow. Minimum submission requirements apply, and experts must submit a minimum number of tasks per week.
Pay and demand for Market Research & Insights roles
AggregatedTypical pay
$70/hour
This role
$30–$60/hr
Most Market Research & Insights roles pay $40–$95 per hour. This role's pay falls inside that range.
Based on 1,065 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,214
- Listed in last 30 days
- 483
- Remote
- 98%
Hiring most right now: micro1 (353) · SME Careers (253) · Mercor (152)
Most requested skills · share of roles
- ai training13%
- ai evaluation13%
- llm evaluation11%
- data annotation9%
Figures from Market Research & Insights roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$30–60/hr
Required Skills
Application Tip
Highlight your research publications and any prior AI training, data labeling, or model evaluation work. Provide concrete examples of complex questions you have designed and sourced, showing how you verified answers with primary references.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
micro1
VerifiedEvaluation Specialist/Recent Grad
micro1 is hiring Evaluation Specialists to support a high-impact project for a customer at the frontier of artificial intelligence. You will create original question-and-answer pairs that test the limits of advanced AI models across diverse subjects. The role involves deep research, source triangulation, and iterative testing to push model reasoning. No prior AI experience is required; your domain knowledge and research skills are what matter. This is a remote contractor position with output-based pay.
micro1
VerifiedAI Evaluation Specialist
As an AI Evaluation Specialist, you'll help train next-generation AI systems by designing and executing hands-on evaluation tasks. Your insights will directly shape how models learn, reason, and perform on practical computer-based workflows. This is a fully remote contract role where meticulous observation and clear documentation are key.
micro1
VerifiedDomain Contributor - Evaluation Specialist
micro1 seeks Domain Contributor - Evaluation Specialists to join an internal project that evaluates and improves advanced AI models. You will design challenging tasks that expose reasoning gaps, verify model outputs against primary sources, and document findings. This is a remote contractor role, about 15 hours per week, with pay per task. Experts in history, law, finance, journalism, or tech are needed.
AfterQuery
VerifiedPhD Domain Expert - Remote AI Research Contract
AfterQuery runs a remote, project-based engagement for PhD-level researchers and industry professionals across quantitative, scientific, technical, and humanities fields. Assignments run over 2 to 3 weeks and follow an asynchronous schedule, with 10 to 20 hours per week expected for projects you accept. You bring doctoral depth to literature synthesis, technical writing, data analysis, and experiment design tied to your discipline. The work supports AI research through model evaluation, data curation, and benchmarking tasks that call for subject-matter judgment.
micro1
VerifiedComputer Science Expert PhD for AI Training Remote Role
A remote contract opportunity for a PhD-level computer science expert to contribute specialized knowledge to an AI training initiative. You’ll provide authoritative explanations and review complex CS data to improve model learning, reasoning, and performance. No prior AI experience is required beyond deep domain mastery. Expect to produce high-quality, clearly justified responses and collaborate with annotation leads and project managers.
SME Careers
VerifiedMarket Research Expert Remote Contract for AI Data Services
Join SME Careers as a remote, hourly Market Research expert within our AI data services network. You will review AI-generated market research outputs for accuracy and reasoning, and produce deliverables like research plans, briefs, survey instruments, and competitor scans. Provide precise written feedback to improve model performance across market sizing, segmentation, and insights. A solid background in qualitative and quantitative methods and C1+ English supports clear, decision-ready conclusions across time zones.