In-House Counsel (United Kingdom) | $150-$160/hr Remote
Overview
Mercor is working with a leading legal AI company to assess how well AI models handle genuine questions about UK law. We're looking for experienced in-house counsel in the UK to act as expert reviewers, evaluating outputs from two different AI systems. You'll compare responses side by side, score them against a set rubric, and provide concise written feedback for each evaluation.
What You'll Do4
- 1Run an identical batch of prompts through two different LLM platforms and capture their answers.
- 2Review the responses from both systems side by side to spot differences in legal reasoning and accuracy.
- 3Score each answer against the standardized rubric provided, ensuring consistent and fair grading.
- 4Write brief but precise feedback notes for every evaluation to explain your score.
Requirements4
- 1At least 5 years of experience as in-house counsel practising in the United Kingdom.
- 2Solid grasp of UK commercial law and contract law, with the ability to assess complex legal scenarios.
- 3Exceptional attention to detail and precise written English, since your feedback will be read closely.
- 4Comfortable working independently, following a rubric, and meeting deadlines under a short-term engagement.
Who Should Apply
The perfect fit is a seasoned UK-based in-house counsel with a strong background in commercial and contract matters, who enjoys analytical work and can evaluate AI outputs critically. You're comfortable writing concise, accurate assessments and working on a flexible, remote basis. If you're curious about how AI handles legal questions and want to help improve it, this is a great opportunity.
Salary Insight
$150–$160 per hour, with an initial commitment of around 10 hours and the possibility of additional hours afterward. All work is covered by an NDA.
Location
Required Skills
Application Tip
When you apply, briefly describe your experience with UK commercial and contract law and any familiarity you have with LLM tools — then mention how you'd approach scoring nuanced AI legal answers.
See NearSkill jobs more often in your search
How your application is processed
1Application received
Your resume and details are logged the moment you apply.
2ATS + eligibility screening
We check your profile against the role’s skills, seniority, and requirements.
3Employer sees qualified profiles only
Only candidates who clear screening move forward.
Similar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedIn-House Counsel (Australia)
Mercor is helping a legal AI company evaluate how well artificial intelligence handles genuine questions about Australian law. We're seeking seasoned Australian in-house counsel to serve as expert reviewers, feeding the same prompts through two AI platforms, comparing the results, and ranking them against a clearly defined rubric. This remote, hourly role starts with roughly 10 hours of work, with the potential for more assignments down the line.
Mercor
VerifiedIn-House Counsel (Spain)
Mercor is collaborating with a legal AI company to see how well artificial intelligence handles real questions about Spanish law. We're seeking seasoned in-house counsel based in Spain to serve as expert reviewers, evaluating answers from two AI platforms and scoring them against a structured rubric.
Mercor
VerifiedCorporate/M&A Lawyer (United Kingdom)
Mercor connects experienced corporate/M&A lawyers with a legal AI company that evaluates how well AI systems handle real questions of UK law. Reviewers run identical prompts through two LLM platforms, compare the responses, and score them against a clear rubric. The work is remote, covered by an NDA, and starts at about 10 hours with room to grow. Your written feedback shapes how legal AI products are benchmarked.
Mercor
VerifiedIn-House Counsel (Japan)
Mercor is partnering with a legal AI company to see how well AI systems handle real questions about Japanese law. We're looking for experienced in-house counsel in Japan to act as expert reviewers, running the same prompts through two different AI platforms, comparing the answers, and scoring them against a clear rubric. This is a remote, hourly role paying $140–150 per hour, starting with around 10 hours of work and strong potential for more.
Mercor
VerifiedIn-House Counsel (Germany)
A leading legal AI company is teaming up with Mercor to measure how well large language models handle real-world German law questions. They're looking for experienced German in-house counsel to act as expert evaluators, comparing responses from two AI platforms. You'll score outputs against a clear rubric and provide brief written assessments. This is a flexible, remote contract opportunity paying a strong hourly rate.
Mercor
VerifiedIn-House Counsel (France)
Play a key role in testing how well legal AI systems handle real questions of French law. This remote, hourly contract position puts your in-house counsel expertise to work evaluating AI-generated answers side by side, scoring them against a clear rubric, and providing written feedback.