
Content Writer & AI Evaluation Specialist
Listing checked October 29, 2026 · pay as published by AfterQuery
Key details
- Pay
- $43/hr
- Location
- Remote
- Job type
- contract
- Posted
- September 25, 2025
Overview
AfterQuery places seasoned writers inside AI research, and this engagement puts you alongside one of the world's leading AI partners. Your writing becomes training material: stories, articles, summaries and dialogues that teach a model how text should read. A large share of the job is judgment, scoring output for fluency, coherence, factuality, creativity and bias against detailed guidelines. Expect remote work at 40 hours/week for 3 to 6 months as an independent contractor, paid $43/hr.
What You'll Do8
- Craft prompts, creative samples and explanatory text inside your own area of subject knowledge.
- Draft and revise training content that pushes a model toward harder writing tasks.
- Produce paired prompts and model responses designed to probe specific capabilities.
- Review AI-generated writing for fluency, coherence, factual accuracy, originality and bias.
- Score and annotate that output against the project guidelines.
- Write structured feedback that helps the model grasp nuanced language use and domain-specific writing conventions.
- Adjust voice and tone to fit each scenario and its intended audience.
- Keep quality steady across high volumes of content and hit agreed deadlines.
Requirements9
- Bachelor's degree in English, Creative Writing, Linguistics, Computer Science or a comparable field.
- 3+ years of professional English content writing or copywriting.
- A clear read on what LLMs handle well and where they break down.
- Strong editing instincts and the range to shift style and tone on request.
- Full-time availability of 40 hours per week across a 3 to 6 month engagement.
- Self-direction: plan your own schedule and meet deadlines without supervision.
- Preferred: hands-on prompt engineering and experience judging LLM output.
- Preferred: fluency in Chinese, Spanish, Portuguese, Arabic, French or German.
- Preferred: familiarity with NLP concepts and human evaluation methods for LLMs.
Who Should Apply
Writers with three or more years of professional English copywriting who already read model output with a critical eye. A linguistics, creative writing or CS degree strengthens the case, and bilingual candidates or anyone with prompt engineering and human evaluation experience move to the front.
Salary Insight
Pay sits at $43/hr, near the top of what contract AI evaluation and training-data writing typically offers, which matches the three-year experience floor and the evaluation skill set. At 40 hours a week the engagement runs 3 to 6 months.
Pay and demand for AI Training roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
$43/hr
Taken from the listing itself.
Typical pay · estimated
$68/hour
Median of 1,325 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Most AI Training roles pay $37–$95 per hour. This role's pay falls inside that range.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,546
- Listed in last 30 days
- 827
- Remote
- 97%
Hiring most right now: micro1 (423) · SME Careers (254) · Mercor (221)
Most requested skills · share of roles
- ai evaluation13%
- llm evaluation12%
- data annotation11%
- ai training11%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to AfterQuery’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
AfterQueryContent Writer and Evaluator
MercorChinese Linguistic Experts
SME CareersAttorney AI Training Specialist for Legal Content Review
SME CareersCopyediting Expert for AI Language Training Content
SME CareersArabic Language Expert for AI Training Content and QA
Handshake AI
