Evaluation Specialist/Recent Grad
Listing checked October 21, 2026 · pay as published by micro1
Overview
micro1 is hiring Evaluation Specialists to support a high-impact project for a customer at the frontier of artificial intelligence. You will create original question-and-answer pairs that test the limits of advanced AI models across diverse subjects. The role involves deep research, source triangulation, and iterative testing to push model reasoning. No prior AI experience is required; your domain knowledge and research skills are what matter. This is a remote contractor position with output-based pay.
What You'll Do6
- 1Craft original, challenging question-and-answer pairs that probe the limits of advanced AI models across various subjects.
- 2Perform thorough research using multiple sources to verify accuracy and provide comprehensive documentation.
- 3Design multi-step questions that require synthesis and analytical reasoning, not just single-source lookups.
- 4Test your questions against AI models, analyze the outcomes, and adjust difficulty as needed.
- 5Document your research process with clear citations and logical explanations for each answer.
- 6Refine content based on reviewer feedback and ensure alignment with project guidelines and quality standards.
Requirements7
- 1Demonstrated ability to conduct independent research and critically evaluate information from multiple sources.
- 2Exceptional attention to detail and written precision in English; fluency is required, but it does not need to be your first language.
- 3Talent for crafting nuanced, well-structured questions that probe deep understanding.
- 4Strong self-direction, reliability, and accountability in remote, independent work.
- 5Interest in cutting-edge AI and a passion for testing the boundaries of current model capabilities.
- 6Prior experience in AI training, evaluation, or content creation is a plus, but not required.
- 7Open to recent graduates, advanced-degree holders, and individuals from any academic or professional background with proven research and writing expertise.
Who Should Apply
Recent graduates or advanced-degree holders from any field who have a knack for deep research and precise writing. The role suits self-starters who can work independently, meet deadlines, and are curious about AI model capabilities. No prior AI experience is needed, but a strong interest in the field helps.
Salary Insight
Compensation is output-based, ranging from $20 to $60 per hour, paid per task that meets project specifications. The time required to complete work may vary depending on your experience and workflow. Minimum submission requirements apply, and experts must submit a minimum number of tasks per week.
Pay and demand for AI Training roles
AggregatedTypical pay
$70/hour
This role
$20–$60/hr
Most AI Training roles pay $40–$95 per hour. This role's pay falls inside that range.
Based on 1,055 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,198
- Listed in last 30 days
- 474
- Remote
- 98%
Hiring most right now: micro1 (351) · SME Careers (253) · Mercor (149)
Most requested skills · share of roles
- ai training13%
- ai evaluation13%
- llm evaluation12%
- data annotation9%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$20–60/hr
Required Skills
Application Tip
Highlight your research and writing skills by providing concrete examples of complex questions you have crafted or research projects you have completed. Emphasize your ability to work independently and meet deadlines, and mention any experience with AI evaluation or content creation, even if not required.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
micro1
VerifiedResearch Evaluation Specialist (PhD or Masters / Researcher / Professor)
micro1 seeks Research Evaluation Specialists with a PhD or Masters to build rigorous test material for advanced AI model evaluation on a customer project. You will craft original, high-difficulty question-and-answer pairs at the frontier of your discipline, then verify and document answers using primary sources and authoritative references. The role is remote and worldwide, about 15 hours per week, with output-based pay. Prior experience in AI training, data labeling, or model evaluation is required.
micro1
VerifiedAI Evaluation Specialist
As an AI Evaluation Specialist, you'll help train next-generation AI systems by designing and executing hands-on evaluation tasks. Your insights will directly shape how models learn, reason, and perform on practical computer-based workflows. This is a fully remote contract role where meticulous observation and clear documentation are key.
micro1
VerifiedDomain Contributor - Evaluation Specialist
micro1 seeks Domain Contributor - Evaluation Specialists to join an internal project that evaluates and improves advanced AI models. You will design challenging tasks that expose reasoning gaps, verify model outputs against primary sources, and document findings. This is a remote contractor role, about 15 hours per week, with pay per task. Experts in history, law, finance, journalism, or tech are needed.
Handshake AI
VerifiedSoftware Engineer - AI Evaluation
Handshake AI seeks practicing software engineers for an ongoing part-time contract. You will create expert-level problems rooted in system design, software architecture, and real implementation work, then judge AI answers for technical accuracy and practical feasibility. The role runs remote and asynchronous, so you choose your own hours with no minimum. Your structured written feedback helps models reason more like engineers who build production systems.
micro1
VerifiedJournalist/Writer - Remote AI Writing Evaluation
micro1 is hiring Journalist/Writers to join a project that evaluates advanced AI-generated writing. You will use your editorial expertise to score and critique model outputs, helping train next-generation AI systems. This is a remote contractor role with no prior AI experience needed. Your domain knowledge in journalism, technical writing, and content evaluation is what matters most.
micro1
VerifiedAI Product Evaluator
micro1 is hiring AI Product Evaluators to support a customer's high-impact AI initiative. You will assess AI models and AI agents against detailed scenarios, then document what you find in structured reports. The work is operational and often runs against strict timeframes and usage limit resets. Your input helps shape how these systems learn, reason, and respond.