Legal Expert (Remote) - AI Model Evaluation
Listing checked September 16, 2026 · pay as published by Mercor
Overview
Mercor maintains an open pool of licensed lawyers who supply legal judgment to the research teams behind top AI models. Work arrives as project-based tasks: drafting a motion or brief from a fact pattern, then writing the reference answer that grades a model's attempt. Other assignments involve scoring model-drafted contract and discovery work, checking whether a privilege call holds, or deciding if a citation supports the claim it backs. The listing stays open even when no project matches your practice area, and new engagements start on short notice. Pay for past projects in this field has ranged from $100 to $150 an hour, with scope and depth setting the exact figure.
What You'll Do7
- 1Draft motions, briefs, or other legal documents from a fact pattern, then create the reference answer that graders use to score a model's version.
- 2Review model-written contracts and discovery materials, judging whether each provision achieves what it claims.
- 3Assess privilege calls in model output and determine if the legal reasoning holds.
- 4Check citations in model answers to confirm each source supports the proposition it backs.
- 5Identify where a model states the law in a sound way but would still lose because of the forum, the standard of review, or facts the argument cannot carry.
- 6Write clear explanations of your grading decisions so project leads can see the basis for each score.
- 7Flag unclear instructions or gaps in a fact pattern before work begins.
Requirements5
- 1Hold a J.D., LL.B., or LL.M. and a current license to practice.
- 2Bring professional experience in litigation, transactional work, or regulatory practice.
- 3Explain legal reasoning in writing that another lawyer can follow.
- 4Handle ambiguous tasks and flag unclear instructions instead of guessing.
- 5Show direct drafting and analysis work you completed, recent enough to discuss why you reached your conclusion.
Who Should Apply
Licensed attorneys with hands-on litigation, transactional, or regulatory backgrounds fit this pool best. The work suits lawyers who drafted motions, briefs, contracts, or discovery responses and can walk through the choices they made. Judicial clerks, in-house counsel, and enforcement lawyers often match, though firm prestige matters less than your own drafting and analysis. Candidates who lack a current license, have not written legal analysis in years, or want a steady full-time employer will find this setup a poor match. Applications often score low when a resume lists practice areas without showing specific documents the candidate wrote or when the AI interview answer stays vague about forum, standard of review, or privilege analysis.
Salary Insight
Past projects in this field posted at $100 to $150 an hour. Each project sets its rate based on scope and depth, so a straightforward document review may sit at the lower end while complex litigation analysis can reach the top. That range matches part-time, project-based AI evaluation work for licensed lawyers, and it does not match a full-time salary equivalent.
Pay and demand for Machine Learning & AI roles
AggregatedTypical pay
$80/hour
This role
$100–$150/hr
Most Machine Learning & AI roles pay $55–$105 per hour. This role's pay sits above that range.
Based on 575 similar roles that publish pay · 94 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 634
- Listed in last 30 days
- 286
- Remote
- 97%
Hiring most right now: micro1 (297) · Mercor (92) · SME Careers (64)
Most requested skills · share of roles
- python15%
- technical writing8%
- llm evaluation7%
- data annotation6%
Figures from Machine Learning & AI roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$100–150/hr
Required Skills
Application Tip
Before the AI interview, prepare two or three concrete examples of your own drafting: a motion, brief, contract, or discovery response where you made the key analytical call. State your license jurisdiction, practice area, and years of experience up front, then explain the forum, standard of review, or privilege issue that drove your conclusion. Specific documents and reasoning raise your fit score more than a list of firm names.
See NearSkill jobs more often in your search
Application & verification flow
1Instant rubric match
Your resume is scanned against this role’s requirements to check qualification fit.
2Screened before the employer sees it
Only profiles that clear screening are passed on.
3Outcome by email
We notify you at the address on your resume once the screening is reviewed.
Similar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedLegal Expert - AI Evaluation and Review (Remote)
Mercor keeps an open pool for legal professionals who want part-time, remote work on AI evaluation and training. Research teams behind major AI models turn to that pool for legal judgment they cannot generate on their own, and your standards shape the rubric that grades model output. Assignments can involve writing a legal problem from a matter you handled, complete with facts, forum, governing law, and a reference answer. You might also review model-drafted provisions, privilege calls, or citations for accuracy and persuasive force. Projects open on short notice, so the listing stays live even when no matching engagement runs this week.
AfterQuery
VerifiedLegal Expert - AI Legal Reasoning Evaluation (Remote)
AfterQuery recruits legal experts to teach and test how AI models handle legal reasoning. Your work can range from composing hard legal prompts to checking model answers for accuracy, sound logic, and hidden mistakes such as invented citations or rules used in the wrong context. You may also draft reference answers and explanations, or build grading rubrics that separate strong legal analysis from weak output. This contract role runs remote at 40 hours per week, with pay from $50 to $200 per hour.
Handshake AI
VerifiedLawyers - Remote AI Evaluation for Legal Experts
Handshake AI hires lawyers with active or recent practice experience to review AI output for legal soundness. The work centers on legal analysis, statutory interpretation, case law reasoning, and drafting standards. You design job-related prompts and critique model responses for accuracy, clarity, and relevance to real legal practice. This remote contract role runs alongside a primary legal job and is not a law firm or in-house counsel position. The program operates year-round, placement depends on current project needs, and no AI or machine learning background is required.
Mercor
VerifiedLegal Domain Expert — AI Training & Evaluation
A senior legal practitioner sits inside a frontier AI lab's research team, where professional judgment becomes training signal for models that reason about legal work. The day-to-day involves reviewing the quality of legal tasks and model outputs, writing instruction specifications and golden solutions, and designing evaluation benchmarks. The engagement is a full-time W-2 position through Cincinnatus LLC, and the work takes place on-site in the Bay Area multiple days per week. This role needs a practicing specialist with deep domain knowledge, not a generalist or an academic.
AfterQuery
VerifiedAttorney - Remote Contract, Legal AI Content
AfterQuery hires Juris Doctor graduates to build legal reasoning challenges for AI models. You will craft questions and case studies in areas such as contract law, constitutional law, and intellectual property. The contract runs 20 hours per week, remote and asynchronous, with pay between $75 and $200 per hour. You also review model answers and flag gaps in logic or legal accuracy. A YC-backed team pairs legal experts with technical staff to sharpen content difficulty.
AfterQuery
VerifiedParalegal Expert - Remote Contract Work
AfterQuery, a YC-backed startup, hires paralegals to build and grade the legal challenges that teach AI models how to handle real legal support work. You design scenarios around legal research, citation formats, document drafting, discovery management and trial preparation, then judge how well a model answers them. The contract runs about 10 hours a week, fully remote and asynchronous, so you set your own hours around other commitments. Pay sits at $50 to $60 per hour for this specialized legal content work.