Legal Expert - AI Legal Reasoning Evaluation
Listing checked October 29, 2026 · pay as published by AfterQuery
Key details
- Pay
- $125/hr
- Location
- Remote
- Job type
- contract
- Posted
- June 27, 2026
Overview
You help train and judge how AI models handle legal questions. Work ranges from writing hard legal prompts to reviewing model answers for sound legal reasoning and accuracy. You also catch subtle mistakes such as fabricated citations or rules stretched to cover facts they do not fit, then draft model answers and explanations that show the right path. Some tasks involve building rubrics that set a clear standard for grading response quality.
What You'll Do7
- Write legal prompts that test how well an AI model reasons through statutes, cases, and doctrine.
- Review model responses for correct legal analysis, accurate citations, and sound application of rules.
- Flag errors such as invented case law, misread statutes, or a rule stretched to cover facts it does not fit.
- Draft model answers that demonstrate strong legal reasoning and clear explanation.
- Create grading rubrics that define what a correct, well-reasoned response should include.
- Compare model output against legal sources and note gaps in reasoning or authority.
- Explain why a response fails or succeeds so the evaluation record is useful.
Requirements5
- Active bar admission, since the application asks for bar credentials.
- Strong legal reasoning across statutes, regulations, and case law.
- Ability to read a legal argument and spot fabricated citations, misapplied rules, or gaps in analysis.
- Clear legal writing for model answers, explanations, and grading standards.
- Comfort judging written work against a rubric and documenting your reasoning.
Who Should Apply
Licensed attorneys with active bar admission who enjoy close reading of legal reasoning and want to shape how AI models answer legal questions. The work suits lawyers who can judge citations, rules, and written explanations for accuracy and explain their verdict.
Salary Insight
The listing sets pay at $125 per hour. That rate fits expert-network legal work for licensed attorneys, where compensation often tracks bar admission and depth of practice experience.
Pay and demand for AI Training roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
$125/hr
Taken from the listing itself.
Typical pay · estimated
$70/hour
Median of 1,290 similar roles that publish pay · 301 publish only a top rate; those count at the rate they gave
Most AI Training roles pay $40–$95 per hour. This role's pay sits above that range.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,488
- Listed in last 30 days
- 808
- Remote
- 98%
Hiring most right now: micro1 (407) · SME Careers (253) · Mercor (222)
Most requested skills · share of roles
- ai evaluation14%
- llm evaluation12%
- data annotation12%
- ai training12%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to AfterQuery’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
MercorLegal Expert - AI Evaluation and Review
MercorLegal Expert (Remote) - AI Model Evaluation
Handshake AILawyers - Remote AI Evaluation for Legal Experts
MercorLegal Domain Expert — AI Training & Evaluation
TuringLaw Expert
SME Careers