English Speaking Generalist for AI Training and Evaluation
Listing checked September 4, 2026 · pay as published by Micro1
Overview
A remote contractor role focused on helping train and assess next generation AI systems. You will design prompts, run side-by-side evaluations of ChatGPT and Claude, and provide clear, structured feedback in American English. No prior AI experience is required; strong domain knowledge in your field is what matters while you contribute to model learning and behavior. You’ll record sessions, interpret documentation, and follow project guidelines to support ongoing model improvement. The role centers on precise communication, careful evaluation, and reliable technical setup. Bold AI training and AI response evaluation as core areas you’ll engage with.
What You'll Do7
- 1Create a diverse set of prompts across various topics to challenge large language models.
- 2Record and compare prompts and outputs from ChatGPT and Claude, capturing screen and microphone during sessions.
- 3Verbalize real-time assessments, noting model strengths, weaknesses, and key differentiators.
- 4Provide detailed, structured feedback in clear American English, describing reasoning and preferences.
- 5Maintain professional, uncluttered spoken and written communication throughout each recording and review cycle.
- 6Review provided documentation to ensure consistent evaluation standards and accurate project delivery.
- 7Align daily work with project guidelines to support iterative improvements in AI models.
Requirements5
- 1High fluency in spoken and written American English with clear pronunciation.
- 2Experience using large language models like ChatGPT, Claude, or Gemini.
- 3Familiarity with AI evaluation tasks and a comfort with screen and audio recording during sessions.
- 4Strong critical thinking, analytical reasoning, and attention to detail.
- 5Reliable technical setup: dependable computer, stable internet, and the ability to capture high-quality audio and video.
Who Should Apply
The ideal candidate is a domain expert who can articulate observations clearly and has experience with large language models. This role may not be a fit for someone without comfortable English communication or who cannot share screen and microphone during work sessions. Common fit concerns include limited exposure to AI evaluation tasks or an unstable technical setup that would disrupt recording quality. A strong preference is shown for prior data annotation, AI training, QA, or research backgrounds and for candidates who can maintain focus in distraction-free environments.
Salary Insight
$20 - $30/hr. Pay is explicit and discussed upfront within the posting.
Pay and demand for Machine Learning & AI roles
AggregatedTypical pay
$60/hour
This role
$20–$30/hr
Most Machine Learning & AI roles pay $30–$90 per hour. This role's pay sits below that range.
Based on 654 similar roles that publish pay · 185 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 758
- Listed in last 30 days
- 503
- Remote
- 98%
Hiring most right now: micro1 (268) · SME Careers (159) · Mercor (81)
Most requested skills · share of roles
- python14%
- ai training12%
- llm evaluation12%
- translation quality review11%
Figures from Machine Learning & AI roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$20–30/hr
Required Skills
Application Tip
Highlight any hands-on work with large language models and provide a concise example of a past evaluation or annotation task, including your approach to documenting reasoning and outcomes.
See NearSkill jobs more often in your search
Application & verification flow
1Instant rubric match
Your resume is scanned against this role’s requirements to check qualification fit.
2Screened before the employer sees it
Only profiles that clear screening are passed on.
3Outcome by email
We notify you at the address on your resume once the screening is reviewed.
Similar open positions
Explore active roles that match your skills and interests.
Micro1
VerifiedSenior AI Trainer
micro1 seeks Senior AI Trainers to work on a customer-driven project that improves AI system quality through expert model training and evaluation. You will apply your generalist expertise and hands-on experience with AI products to help train next-generation systems. Your daily work involves evaluating AI chat and search tools, writing and refining prompts, and annotating model responses using detailed grading guidelines. This is a remote contractor role open to candidates in Northern America and Europe.
SME Careers
VerifiedCopyediting Expert for AI Language Training Content
Remote contractor role centered on copyediting and AI data training to improve English-language outputs. Review AI-generated responses and craft expert language content that guides model learning with precise, written feedback. Evaluate accuracy, clarity, and alignment with prompts, flagging any meaning drift or logical gaps for correction. Support localization QA and editorial workflows by applying style guides and terminology standards across languages.
Turing
VerifiedAI Quality Analyst - English
This role puts you inside Gemini's personalization quality loop. You will design multi-turn prompts that draw on your own Google activity, including Gmail, Search, and YouTube history, then judge whether the model's responses are grounded, integrated, and helpful. The work involves side-by-side SxS evaluations, writing rationales that reference specific turns, and verifying debug info to confirm the model used your data correctly. This 3-month contractor engagement requires at least 4 hours per day with a 4-hour overlap with PST.
Micro1
VerifiedAI Evaluation Specialist
As an AI Evaluation Specialist, you'll help train next-generation AI systems by designing and executing hands-on evaluation tasks. Your insights will directly shape how models learn, reason, and perform on practical computer-based workflows. This is a fully remote contract role where meticulous observation and clear documentation are key.
Micro1
VerifiedGeneralist Writer for AI Quality Evaluation Remote
A remote contractor role for writers focused on AI quality and evaluation. You’ll review both human and AI-generated content for accuracy and coherence, comparing outputs against detailed guidelines. Expect to deliver precise, actionable feedback that helps improve AI system performance. This work runs in US and Western Europe time zones, with an initial four-week sprint and a minimum weekly commitment.
Mercor
VerifiedEnglish Language Expert - Remote AI Project
Mercor needs language specialists for an AI research effort with a top research lab. The work centers on large language models: you check how well they summarize, hold dialogue, correct grammar, rewrite text, and reason in English. You also build and refine English linguistic data that improves what these models understand and generate. Your edits, annotations, and error reports go straight into model training.