Applied Legal Benchmark Specialist | $83-$105/hr Remote
Overview
Legal experts with a JD, LLM, or SJD will craft and review multiple-choice questions for an AI research initiative. The work is remote and asynchronous, with two possible tracks: authoring original questions or verifying pre-written ones. Each question targets a core law domain such as intellectual property, securities, or antitrust. Experts rate difficulty from medium to expert and provide chain-of-thought solutions with references.
What You'll Do7
- 1Draft original legal questions that probe conceptual understanding rather than simple memorization.
- 2Ensure each problem statement is self-contained and unambiguous, with all needed facts included.
- 3Assign difficulty ratings: medium for lower-level undergrad, hard for advanced undergrad, expert for graduate level and beyond.
- 4Produce one correct answer plus nine plausible but incorrect distractors designed to challenge specialists.
- 5Write step-by-step chain-of-thought explanations in markdown, with clear and concise reasoning.
- 6Attach 1 to 5 academic references from peer-reviewed journals or legal databases for each question.
- 7For verification, review questions for clarity, completeness, precision, and solvability, then edit and document changes.
Requirements5
- 1JD, LLM, SJD, or doctoral candidate in law or a related field.
- 2Master's degree accepted with exceptional expertise in a specific legal subdomain.
- 3Strong command of legal reasoning, statutory interpretation, and jurisprudential theory.
- 4Experience with bar exam writing, legal academia, or judicial clerkships is a strong plus.
- 5Excellent written English and the ability to express complex legal ideas with clarity and brevity.
Who Should Apply
This role suits lawyers and advanced law students who enjoy writing precise, detailed exam questions. Legal professionals who prefer client-facing practice or broad advisory work will find the task too narrow. Candidates with weak attention to detail often get rejected because their questions contain ambiguities or unsupported references. Others score low when they submit questions that rely on rote memorization instead of conceptual reasoning. If you have a strong record in one of the listed domains and can commit 10+ hours weekly, this is a good fit.
Salary Insight
The posted rate is $83.00 to $105.00 per hour. That range aligns with the rates paid to legal experts with advanced credentials and niche subject knowledge. Placement within the range depends on the domain and the quality of your work.
Location
Required Skills
Application Tip
Include a short portfolio or sample questions from one of the listed law domains. That gives reviewers direct evidence of your ability to write rigorous, unambiguous questions with plausible distractors. Mention your specific domain expertise and any prior bar exam or academic writing experience.
See NearSkill jobs more often in your search
How your application is processed
1Application received
Your resume and details are logged the moment you apply.
2ATS + eligibility screening
We check your profile against the role’s skills, seniority, and requirements.
3Employer sees qualified profiles only
Only candidates who clear screening move forward.
Similar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedLegal Domain Expert — AI Training & Evaluation
A senior legal practitioner sits inside a frontier AI lab's research team, where professional judgment becomes training signal for models that reason about legal work. The day-to-day involves reviewing the quality of legal tasks and model outputs, writing instruction specifications and golden solutions, and designing evaluation benchmarks. The engagement is a full-time W-2 position through Cincinnatus LLC, and the work takes place on-site in the Bay Area multiple days per week. This role needs a practicing specialist with deep domain knowledge, not a generalist or an academic.
Micro1
VerifiedMember of Technical Staff, Legal Research
This role sits at the intersection of legal expertise and AI research. You'll design evaluation frameworks that measure how well large language models handle complex legal reasoning, working remotely to help build the next generation of enterprise AI for the legal industry. Your work will directly shape how AI agents perform tasks like statutory interpretation, contract analysis, and workflow automation.
SME Careers
VerifiedLegal Expert for AI Data Training, Remote Contract
Remote contract role focused on guiding AI data training by reviewing legal analyses and producing precise explanations. You will assess reasoning quality, identify gaps in legal methodology, and provide structured feedback that maps facts to valid elements and defenses. Citations, rules, and jurisdictional relevance are checked for accuracy, with clear notes for improvement. This assignment supports SME Careers' AI data services by delivering reliable, well-reasoned content to improve model performance.
Mercor
VerifiedApplied Engineering Benchmark Specialist
Expert engineers write and verify advanced multiple-choice assessment content for an AI research initiative. The work splits into two tracks: authoring original questions or validating pre-written ones across domains like VLSI, control science, mechatronics, and biotechnology. Each question demands deep conceptual reasoning, a difficulty rating from medium to expert, and a full chain-of-thought solution. The role is asynchronous, fully remote, and expects at least 10 hours per week.
SME Careers
VerifiedAttorney AI Training Specialist for Legal Content Review
Remote, hourly contract role for an attorney who reviews AI-generated legal outputs and creates expert legal content. You assess reasoning quality and perform step-by-step issue analyses, delivering precise written feedback. You fact-check legal concepts and, when needed, provide citations to primary authorities to ensure accuracy and clarity. This remote contract position supports training data programs for major AI labs.
Mercor
VerifiedLegal Expert — Disputes & International (Project Donna)
Act as a senior legal reviewer for a study run by a leading AI legal company, designed to gauge how expert attorneys judge machine-produced work. You will read a fabricated case file and then score six anonymized AI outputs, each labeled A through F, on the basis of accuracy and usefulness. The substantive focus sits squarely in dispute resolution, with an emphasis on international arbitration, sanctions, and cross-border matters like award enforcement and emergency relief. For every comparison you must write a short explanation of your choice, which directly shapes the AI tool's future behavior. The entire commitment spans about 24 hours and operates under a strict NDA.