Legal Domain Expert — AI Training & Evaluation
Listing checked August 29, 2026 · pay as published by Mercor
Overview
A senior legal practitioner sits inside a frontier AI lab's research team, where professional judgment becomes training signal for models that reason about legal work. The day-to-day involves reviewing the quality of legal tasks and model outputs, writing instruction specifications and golden solutions, and designing evaluation benchmarks. The engagement is a full-time W-2 position through Cincinnatus LLC, and the work takes place on-site in the Bay Area multiple days per week. This role needs a practicing specialist with deep domain knowledge, not a generalist or an academic.
What You'll Do5
- 1Audit legal tasks and model outputs for quality, flagging missing reasoning, superficial analysis, and answers that would not survive professional scrutiny.
- 2Write instruction specifications that define expected model behavior and produce golden solutions to legal problems that serve as correct references.
- 3Design new legal tasks that mirror real-world practice, and build evaluation sets that measure genuine model improvement.
- 4Work alongside client researchers to calibrate standards, turning implicit legal judgment into explicit, teachable criteria.
- 5Provide precise written feedback that helps researchers refine the model's reasoning over time.
Requirements7
- 1A Juris Doctor from an accredited law school, with preference for a degree from a top-tier program.
- 2At least five years of substantive post-JD legal practice at a recognized institution, with demonstrated progression to senior associate, counsel, partner, or equivalent.
- 3Active membership in good standing with at least one U.S. state bar.
- 4Real specialization in a practice area such as corporate and transactional, litigation, regulatory and compliance, intellectual property, employment and labor, or tax.
- 5Hands-on experience using large language models in professional legal work, including the judgment to tell well-reasoned answers from confident misinformation.
- 6Availability to commit 40 hours per week for an initial six-month engagement.
- 7Bay Area residency or willingness to relocate there at personal expense, with on-site presence required several days each week.
Who Should Apply
Practicing attorneys with deep specialization and a track record of owning complex matters will thrive here. The role is less suitable for recent graduates, generalists, or lawyers without active LLM experience, since the work depends on professional judgment and the ability to evaluate model reasoning against real legal standards. Candidates often score low on fit when they lack a distinct practice specialty or cannot point to specific instances of using AI tools in their daily legal work. Another common rejection reason is failing to show seniority: internships and clerkships do not count toward the five-year requirement.
Salary Insight
The posted pay range is $60-$100 per hour. The lower end matches lawyers who just clear the five-year experience threshold, while the upper end is for specialists with partner-level seniority or a top-tier JD.
Pay and demand for AI Training roles
AggregatedTypical pay
$75/hour
This role
$60–$100/hr
Most AI Training roles pay $42–$100 per hour. This role's pay falls inside that range.
Based on 1,061 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,212
- Listed in last 30 days
- 453
- Remote
- 98%
Hiring most right now: micro1 (362) · SME Careers (253) · Mercor (145)
Most requested skills · share of roles
- ai training13%
- ai evaluation11%
- llm evaluation11%
- data annotation9%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$60–100/hr
Required Skills
Application Tip
In your application, describe a specific legal matter where you used an LLM to produce analysis and then caught a subtle error in the model's reasoning. Name your primary practice area and your state bar membership, and quantify your years of post-JD experience to make fit clear.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedSenior Counsel Legal Domain Expert
An AI lab in the Bay Area seeks an experienced lawyer with 8 to 15 years of post-qualification practice to help research teams improve how frontier models handle real legal work. The engagement runs through Cincinnatus LLC as a full-time W-2 position, with work inside the client's own systems and a hybrid schedule that requires regular on-site presence. You will evaluate the quality of legal knowledge tasks, write instruction specs and golden solutions, and build benchmarks that show whether the model improves. The role targets lawyers at counsel or senior associate level with deep specialization, and partners, general counsel, and early-career lawyers should apply through the seniority-matched listings.
Mercor
VerifiedPartner & General Counsel - Legal Domain Expert
A leading AI lab needs a senior legal domain expert to join its GenAI research team and help frontier models reason through real legal work. You will review the quality of legal knowledge tasks, write instruction specs and golden solutions, and design evaluation sets that measure genuine progress. This full-time W-2 role runs through Cincinnatus LLC and places you inside the client's own tools alongside their research and program managers. The engagement starts with 6 months at 40 hours per week, with a hybrid schedule in the Bay Area and on-site work multiple days each week.
AfterQuery
VerifiedLegal Expert - AI Legal Reasoning Evaluation
AfterQuery recruits legal experts to teach and test how AI models handle legal reasoning. Your work can range from composing hard legal prompts to checking model answers for accuracy, sound logic, and hidden mistakes such as invented citations or rules used in the wrong context. You may also draft reference answers and explanations, or build grading rubrics that separate strong legal analysis from weak output. This contract role runs remote at 40 hours per week, with pay from $50 to $200 per hour.
SME Careers
VerifiedLegal Expert for AI Data Training, Remote Contract
Remote contract role focused on guiding AI data training by reviewing legal analyses and producing precise explanations. You will assess reasoning quality, identify gaps in legal methodology, and provide structured feedback that maps facts to valid elements and defenses. Citations, rules, and jurisdictional relevance are checked for accuracy, with clear notes for improvement. This assignment supports SME Careers' AI data services by delivering reliable, well-reasoned content to improve model performance.
Mercor
VerifiedLegal Expert - AI Evaluation and Review
Mercor keeps an open pool for legal professionals who want part-time, remote work on AI evaluation and training. Research teams behind major AI models turn to that pool for legal judgment they cannot generate on their own, and your standards shape the rubric that grades model output. Assignments can involve writing a legal problem from a matter you handled, complete with facts, forum, governing law, and a reference answer. You might also review model-drafted provisions, privilege calls, or citations for accuracy and persuasive force. Projects open on short notice, so the listing stays live even when no matching engagement runs this week.
SME Careers
VerifiedAttorney AI Training Specialist for Legal Content Review
Remote, hourly contract role for an attorney who reviews AI-generated legal outputs and creates expert legal content. You assess reasoning quality and perform step-by-step issue analyses, delivering precise written feedback. You fact-check legal concepts and, when needed, provide citations to primary authorities to ensure accuracy and clarity. This remote contract position supports training data programs for major AI labs.