In-House Counsel (Germany) | $140-$150/hr Remote
Overview
A leading legal AI company is teaming up with Mercor to measure how well large language models handle real-world German law questions. They're looking for experienced German in-house counsel to act as expert evaluators, comparing responses from two AI platforms. You'll score outputs against a clear rubric and provide brief written assessments. This is a flexible, remote contract opportunity paying a strong hourly rate.
What You'll Do5
- 1Execute identical prompt sets across two different LLM platforms
- 2Review the responses from each platform side by side
- 3Rate each answer against a standardized evaluation rubric
- 4Submit concise written feedback explaining your scores for every comparison
- 5Flag subtle legal inaccuracies or omissions in AI-generated responses
Requirements4
- 1A minimum of 5 years of experience practising as in-house counsel in Germany
- 2Strong expertise in German commercial law and contract law
- 3Excellent written communication with a meticulous, detail-oriented approach
- 4Ability to work independently, adhere to a rubric, and deliver results on deadline
Who Should Apply
You're a seasoned German legal counsel who enjoys the analytical side of law and wants to influence how AI handles legal questions. You're comfortable working autonomously, have an eye for nuance, and can articulate why one answer is stronger than another. If you're curious about legal technology and have some spare capacity, this is a low-commitment way to apply your expertise.
Salary Insight
Pay is $140–$150 per hour (USD), with an initial commitment of roughly 10 hours and strong potential for additional work.
Location
Required Skills
Application Tip
When applying, highlight any experience you have evaluating AI outputs, building rubrics, or reviewing legal content for accuracy. Mention specific examples of complex German commercial or contract law scenarios you've handled — this will show you can bring real-world nuance to your evaluations.
See NearSkill jobs more often in your search
How your application is processed
1Application received
Your resume and details are logged the moment you apply.
2ATS + eligibility screening
We check your profile against the role’s skills, seniority, and requirements.
3Employer sees qualified profiles only
Only candidates who clear screening move forward.
Similar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedCorporate/M&A Lawyer (Germany)
Mercor connects experienced corporate/M&A lawyers with a legal AI company benchmarking how well large language models answer real questions of German law. In this reviewer role, you run identical prompts through two AI platforms, compare the outputs, and score each response against a standardized rubric. The engagement is remote from Germany, starts with about 10 hours of work, and can lead to ongoing assignments. All work falls under an NDA.
Mercor
VerifiedIn-House Counsel (United Kingdom)
Mercor is working with a leading legal AI company to assess how well AI models handle genuine questions about UK law. We're looking for experienced in-house counsel in the UK to act as expert reviewers, evaluating outputs from two different AI systems. You'll compare responses side by side, score them against a set rubric, and provide concise written feedback for each evaluation.
Mercor
VerifiedIn-House Counsel (Australia)
Mercor is helping a legal AI company evaluate how well artificial intelligence handles genuine questions about Australian law. We're seeking seasoned Australian in-house counsel to serve as expert reviewers, feeding the same prompts through two AI platforms, comparing the results, and ranking them against a clearly defined rubric. This remote, hourly role starts with roughly 10 hours of work, with the potential for more assignments down the line.
Mercor
VerifiedIn-House Counsel (Spain)
Mercor is collaborating with a legal AI company to see how well artificial intelligence handles real questions about Spanish law. We're seeking seasoned in-house counsel based in Spain to serve as expert reviewers, evaluating answers from two AI platforms and scoring them against a structured rubric.
Mercor
VerifiedIn-House Counsel (Japan)
Mercor is partnering with a legal AI company to see how well AI systems handle real questions about Japanese law. We're looking for experienced in-house counsel in Japan to act as expert reviewers, running the same prompts through two different AI platforms, comparing the answers, and scoring them against a clear rubric. This is a remote, hourly role paying $140–150 per hour, starting with around 10 hours of work and strong potential for more.
Mercor
VerifiedIn-House Counsel (France)
Play a key role in testing how well legal AI systems handle real questions of French law. This remote, hourly contract position puts your in-house counsel expertise to work evaluating AI-generated answers side by side, scoring them against a clear rubric, and providing written feedback.