Legal Expert - AI Evaluation and Review (Remote)
Listing checked September 16, 2026 · pay as published by Mercor
Overview
Mercor keeps an open pool for legal professionals who want part-time, remote work on AI evaluation and training. Research teams behind major AI models turn to that pool for legal judgment they cannot generate on their own, and your standards shape the rubric that grades model output. Assignments can involve writing a legal problem from a matter you handled, complete with facts, forum, governing law, and a reference answer. You might also review model-drafted provisions, privilege calls, or citations for accuracy and persuasive force. Projects open on short notice, so the listing stays live even when no matching engagement runs this week.
What You'll Do6
- 1Write legal problems drawn from real matters, spelling out facts, forum, governing law, and the reference answer that scores a model's response.
- 2Grade model-drafted legal work on whether a provision achieves its stated aim, whether a privilege call holds, and whether a citation supports the point it serves.
- 3Identify answers where a model gets the law right yet would still lose because of the forum, standard of review, or facts that do not carry the argument.
- 4Review model output for legal accuracy, clarity, and alignment with the rubric you helped define.
- 5Flag unclear task instructions or gaps in project briefs before grading begins.
- 6Apply professional legal experience to evaluate compliance, regulatory, policy, or litigation content as needed.
Requirements6
- 1Professional background in legal practice, compliance, regulatory affairs, or policy.
- 2Clear writing skills, because the work centers on explaining your reasoning in detail.
- 3Comfort with ambiguous instructions and a habit of flagging gaps instead of guessing.
- 4Ability to assess legal arguments across forums and standards of review.
- 5Experience with litigation, corporate law, M&A, intellectual property, criminal justice, risk management, or related areas.
- 6Paralegals, legal assistants, compliance specialists, and policy professionals qualify alongside practicing attorneys.
Who Should Apply
Legal professionals with practice, compliance, regulatory, or policy experience fit this pool best. Paralegals and legal assistants also belong if they can explain legal reasoning in writing. People who handle vague briefs and turn them into graded legal problems without step-by-step guidance will do well. Candidates who need a set schedule, one client, or a traditional hiring decision should look elsewhere, since the listing stays open and only produces invitations when a project matches. Low fit scores often trace to resumes that list job titles without evidence of legal analysis, or to candidates who skip the domain expert interview and fail to confirm their work location.
Salary Insight
Listings in this legal AI evaluation field have posted from $60 to $150 per hour. Projects set the exact rate by scope and depth, so the number on a specific invitation is the one that matters. The spread covers a wide band of work, from paralegal tasks to senior regulatory or M&A review, which means the top end tends to match specialized subject-matter judgment.
Pay and demand for Machine Learning & AI roles
AggregatedTypical pay
$80/hour
This role
$60–$150/hr
Most Machine Learning & AI roles pay $55–$105 per hour. This role's pay falls inside that range.
Based on 575 similar roles that publish pay · 94 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 634
- Listed in last 30 days
- 286
- Remote
- 97%
Hiring most right now: micro1 (297) · Mercor (92) · SME Careers (64)
Most requested skills · share of roles
- python15%
- technical writing8%
- llm evaluation7%
- data annotation6%
Figures from Machine Learning & AI roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$60–150/hr
Required Skills
Application Tip
When you apply, attach a resume that shows concrete legal writing or analysis examples, such as a memo, brief, or compliance finding, and name the forum, governing law, and issue you addressed. That evidence speaks to the written-reasoning requirement and can raise your fit score before the 20-minute AI interview.
See NearSkill jobs more often in your search
Application & verification flow
1Instant rubric match
Your resume is scanned against this role’s requirements to check qualification fit.
2Screened before the employer sees it
Only profiles that clear screening are passed on.
3Outcome by email
We notify you at the address on your resume once the screening is reviewed.
Similar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedLegal Expert (Remote) - AI Model Evaluation
Mercor maintains an open pool of licensed lawyers who supply legal judgment to the research teams behind top AI models. Work arrives as project-based tasks: drafting a motion or brief from a fact pattern, then writing the reference answer that grades a model's attempt. Other assignments involve scoring model-drafted contract and discovery work, checking whether a privilege call holds, or deciding if a citation supports the claim it backs. The listing stays open even when no project matches your practice area, and new engagements start on short notice. Pay for past projects in this field has ranged from $100 to $150 an hour, with scope and depth setting the exact figure.
AfterQuery
VerifiedLegal Expert - AI Legal Reasoning Evaluation (Remote)
AfterQuery recruits legal experts to teach and test how AI models handle legal reasoning. Your work can range from composing hard legal prompts to checking model answers for accuracy, sound logic, and hidden mistakes such as invented citations or rules used in the wrong context. You may also draft reference answers and explanations, or build grading rubrics that separate strong legal analysis from weak output. This contract role runs remote at 40 hours per week, with pay from $50 to $200 per hour.
SME Careers
VerifiedLegal Expert for AI Data Training, Remote Contract
Remote contract role focused on guiding AI data training by reviewing legal analyses and producing precise explanations. You will assess reasoning quality, identify gaps in legal methodology, and provide structured feedback that maps facts to valid elements and defenses. Citations, rules, and jurisdictional relevance are checked for accuracy, with clear notes for improvement. This assignment supports SME Careers' AI data services by delivering reliable, well-reasoned content to improve model performance.
Handshake AI
VerifiedLawyers - Remote AI Evaluation for Legal Experts
Handshake AI hires lawyers with active or recent practice experience to review AI output for legal soundness. The work centers on legal analysis, statutory interpretation, case law reasoning, and drafting standards. You design job-related prompts and critique model responses for accuracy, clarity, and relevance to real legal practice. This remote contract role runs alongside a primary legal job and is not a law firm or in-house counsel position. The program operates year-round, placement depends on current project needs, and no AI or machine learning background is required.
SME Careers
VerifiedAttorney AI Training Specialist for Legal Content Review
Remote, hourly contract role for an attorney who reviews AI-generated legal outputs and creates expert legal content. You assess reasoning quality and perform step-by-step issue analyses, delivering precise written feedback. You fact-check legal concepts and, when needed, provide citations to primary authorities to ensure accuracy and clarity. This remote contract position supports training data programs for major AI labs.
AfterQuery
VerifiedParalegal Expert - Remote Contract Work
AfterQuery, a YC-backed startup, hires paralegals to build and grade the legal challenges that teach AI models how to handle real legal support work. You design scenarios around legal research, citation formats, document drafting, discovery management and trial preparation, then judge how well a model answers them. The contract runs about 10 hours a week, fully remote and asynchronous, so you set your own hours around other commitments. Pay sits at $50 to $60 per hour for this specialized legal content work.