Side by Side Factuality Evaluator
Listing checked October 16, 2026 · pay as published by Meridial
Overview
Meridial by Invisible hires English-fluent specialists to judge the factual accuracy of text produced by AI models. You review model responses, split each answer into separate claims, and trace those claims to trustworthy sources. Your findings help shape AI systems that aim to deliver accurate, trustworthy information. Topics span many fields, so you need comfort with subjects you have not studied before.
What You'll Do6
- 1Review AI-generated answers that cover a broad range of subjects.
- 2Split each response into individual claims that someone can verify.
- 3Research claims online and locate credible, authoritative sources.
- 4Judge each claim as accurate, inaccurate, or unverifiable, noting small wording shifts.
- 5Make independent calls backed by evidence, even when cases are ambiguous.
- 6Apply detailed evaluation guidelines and record consistent decisions with supporting proof.
Requirements6
- 1English fluency with strong reading comprehension and clear writing.
- 2Critical-thinking and analytical skills.
- 3Web research skill and the ability to tell reliable sources from unreliable ones.
- 4Keen attention to detail when spotting claims and subtle wording differences.
- 5Willingness to research diverse topics, including ones you do not know.
- 6Ability to absorb detailed instructions and apply them in a consistent way.
Who Should Apply
The ideal candidate reads English with precision and enjoys tracing claims back to credible sources. You stay patient with ambiguous cases, notice wording shifts, and apply long guidelines without drifting. If you like research across unfamiliar subjects, this contract fits.
Salary Insight
The contract rate is $6.00 per hour. For remote AI evaluation and fact-checking work, this sits on the lower end of typical pay bands. Many candidates use roles like this to build annotation and review experience.
Pay and demand for AI Training roles
AggregatedTypical pay
$70/hour
This role
$6/hr
Most AI Training roles pay $38–$95 per hour. This role's pay sits below that range.
Based on 951 similar roles that publish pay · 300 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,080
- Listed in last 30 days
- 363
- Remote
- 98%
Hiring most right now: micro1 (284) · SME Careers (253) · Handshake AI (132)
Most requested skills · share of roles
- ai training15%
- ai evaluation13%
- llm evaluation12%
- data annotation10%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$6/hr
Required Skills
Application Tip
When you apply, show how you separate reliable sources from unreliable ones. Include a short example of a claim you verified, name the sources you used, and note the wording difference that determined your call.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Micro1
VerifiedJournalist/Writer - Remote AI Writing Evaluation
micro1 is hiring Journalist/Writers to join a project that evaluates advanced AI-generated writing. You will use your editorial expertise to score and critique model outputs, helping train next-generation AI systems. This is a remote contractor role with no prior AI experience needed. Your domain knowledge in journalism, technical writing, and content evaluation is what matters most.
Mercor
VerifiedPrivate Investigator AI Evaluation
Mercor seeks seasoned private detectives and investigators to assess and sharpen AI systems built for investigative work. You will review AI-generated investigation plans, background research summaries, and surveillance reports, judging how well each artifact holds up against real case standards. Head-to-head comparisons form a core part of the work: you weigh competing AI responses on investigative rigor, legal and ethical compliance, and the logic behind their conclusions. Scenarios cover evidence gathering, source verification, records research, and case reporting, and your feedback helps guide model improvements. The project runs 4 to 6 weeks with an immediate start.
Mercor
VerifiedLegal Expert - AI Evaluation and Review
Mercor keeps an open pool for legal professionals who want part-time, remote work on AI evaluation and training. Research teams behind major AI models turn to that pool for legal judgment they cannot generate on their own, and your standards shape the rubric that grades model output. Assignments can involve writing a legal problem from a matter you handled, complete with facts, forum, governing law, and a reference answer. You might also review model-drafted provisions, privilege calls, or citations for accuracy and persuasive force. Projects open on short notice, so the listing stays live even when no matching engagement runs this week.
AfterQuery
VerifiedContent Writer and Evaluator
AfterQuery seeks a Content Writer and Evaluator to build evaluation scenarios that test autonomous AI systems across specialized domains. You will craft research tasks in areas like sports analytics, financial analysis, or patent research, ensuring each prompt and response meets accuracy and formatting standards. This remote contract role offers flexible hours, with 10-20 hours per week, and pays $15 per hour. You will collaborate with a YC-backed startup and one of the world's leading AI partners, contributing directly to model improvement.
Micro1
VerifiedAI Product Evaluator
micro1 is hiring AI Product Evaluators to support a customer's high-impact AI initiative. You will assess AI models and AI agents against detailed scenarios, then document what you find in structured reports. The work is operational and often runs against strict timeframes and usage limit resets. Your input helps shape how these systems learn, reason, and respond.
Mercor
VerifiedGeneralist AI Evaluation Expert
Mercor runs a standing pool for people who want part-time work in AI training and model evaluation. The team connects generalists to projects that need careful human judgment, from writing prompts and reference answers to grading how well a model handles general reasoning. Contracts pay $40 to $70 per hour and open on short notice, so the listing stays active even when no project is live. You apply once, complete a short interview, and join a network that clients draw from when a matching task appears.