Legal Expert - AI Evaluation and Review
Listing checked September 16, 2026 · pay as published by Mercor
Key details
- Pay
- $60–150/hr
- Location
- Remote
- Job type
- part-time
- Posted
- September 15, 2026
Overview
Mercor keeps an open pool for legal professionals who want part-time, remote work on AI evaluation and training. Research teams behind major AI models turn to that pool for legal judgment they cannot generate on their own, and your standards shape the rubric that grades model output. Assignments can involve writing a legal problem from a matter you handled, complete with facts, forum, governing law, and a reference answer. You might also review model-drafted provisions, privilege calls, or citations for accuracy and persuasive force. Projects open on short notice, so the listing stays live even when no matching engagement runs this week.
What You'll Do6
- Write legal problems drawn from real matters, spelling out facts, forum, governing law, and the reference answer that scores a model's response.
- Grade model-drafted legal work on whether a provision achieves its stated aim, whether a privilege call holds, and whether a citation supports the point it serves.
- Identify answers where a model gets the law right yet would still lose because of the forum, standard of review, or facts that do not carry the argument.
- Review model output for legal accuracy, clarity, and alignment with the rubric you helped define.
- Flag unclear task instructions or gaps in project briefs before grading begins.
- Apply professional legal experience to evaluate compliance, regulatory, policy, or litigation content as needed.
Requirements6
- Professional background in legal practice, compliance, regulatory affairs, or policy.
- Clear writing skills, because the work centers on explaining your reasoning in detail.
- Comfort with ambiguous instructions and a habit of flagging gaps instead of guessing.
- Ability to assess legal arguments across forums and standards of review.
- Experience with litigation, corporate law, M&A, intellectual property, criminal justice, risk management, or related areas.
- Paralegals, legal assistants, compliance specialists, and policy professionals qualify alongside practicing attorneys.
Who Should Apply
Legal professionals with practice, compliance, regulatory, or policy experience fit this pool best. Paralegals and legal assistants also belong if they can explain legal reasoning in writing. People who handle vague briefs and turn them into graded legal problems without step-by-step guidance will do well. Candidates who need a set schedule, one client, or a traditional hiring decision should look elsewhere, since the listing stays open and only produces invitations when a project matches. Low fit scores often trace to resumes that list job titles without evidence of legal analysis, or to candidates who skip the domain expert interview and fail to confirm their work location.
Salary Insight
Listings in this legal AI evaluation field have posted from $60 to $150 per hour. Projects set the exact rate by scope and depth, so the number on a specific invitation is the one that matters. The spread covers a wide band of work, from paralegal tasks to senior regulatory or M&A review, which means the top end tends to match specialized subject-matter judgment.
Pay and demand for AI Training roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
$60–150/hr
Taken from the listing itself.
Typical pay · estimated
$70/hour
Median of 1,290 similar roles that publish pay · 301 publish only a top rate; those count at the rate they gave
Most AI Training roles pay $40–$95 per hour. This role's pay sits above that range.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,488
- Listed in last 30 days
- 808
- Remote
- 98%
Hiring most right now: micro1 (407) · SME Careers (253) · Mercor (222)
Most requested skills · share of roles
- ai evaluation14%
- llm evaluation12%
- data annotation12%
- ai training12%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to Mercor’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
MercorLegal Expert (Remote) - AI Model Evaluation
AfterQueryLegal Expert - AI Legal Reasoning Evaluation
SME CareersLegal Expert for AI Data Training, Remote Contract
MercorLegal Domain Expert — AI Training & Evaluation
Handshake AILawyers - Remote AI Evaluation for Legal Experts
Braintrust