In-House Counsel (Japan) | $140-$150/hr Remote
Overview
Mercor is partnering with a legal AI company to see how well AI systems handle real questions about Japanese law. We're looking for experienced in-house counsel in Japan to act as expert reviewers, running the same prompts through two different AI platforms, comparing the answers, and scoring them against a clear rubric. This is a remote, hourly role paying $140–150 per hour, starting with around 10 hours of work and strong potential for more.
What You'll Do4
- 1Run identical test prompts through two different AI (LLM) platforms
- 2Review the outputs from both platforms side by side to spot differences
- 3Score every response using a standardized rubric provided by the team
- 4Submit short, precise written feedback for each evaluation you complete
Requirements4
- 15+ years of experience working as in-house legal counsel in Japan
- 2Strong knowledge of Japanese law, especially commercial and contract matters
- 3Exceptional attention to detail and the ability to write clearly and concisely
- 4Comfort working independently to a rubric and meeting deadlines
Who Should Apply
This role is ideal for a Japan-based in-house lawyer with solid commercial and contract law experience who wants to use their expertise in a new way. You should enjoy structured evaluation work, be able to articulate your reasoning in writing, and stay comfortable with NDA-protected projects. If you're detail-oriented and curious about how AI performs on legal questions, this is a great fit.
Salary Insight
The position pays USD $140–150 per hour, with an initial commitment of about 10 hours and the potential for additional hours afterward.
Location
Required Skills
Application Tip
Before applying, test a few legal AI tools yourself so you can speak concretely about how you would judge answer quality. Mention that experience in your application to show you understand the evaluation process.
See NearSkill jobs more often in your search
How your application is processed
1Application received
Your resume and details are logged the moment you apply.
2ATS + eligibility screening
We check your profile against the role’s skills, seniority, and requirements.
3Employer sees qualified profiles only
Only candidates who clear screening move forward.
Similar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedCorporate/M&A Lawyer (Japan)
Mercor recruits experienced corporate/M&A lawyers in Japan to act as expert reviewers for a legal AI benchmarking project. You will feed identical legal prompts into two LLM platforms, compare their outputs, and grade each response against a fixed rubric. The work is remote, paid per hour, and an NDA applies to every task. The initial batch of about 10 hours can expand if the collaboration goes well.
Mercor
VerifiedLitigation Lawyer (Japan)
Mercor partners with a legal AI company to test how well AI systems answer real questions of Japanese law. As an expert reviewer, you will run identical prompts through two LLM platforms, compare the responses, and score them against a provided rubric. The role is a short-term, remote engagement based in Japan, with an initial commitment of about 10 hours. Your written evaluations help shape how legal AI tools handle litigation and disputes.
Mercor
VerifiedIn-House Counsel (Australia)
Mercor is helping a legal AI company evaluate how well artificial intelligence handles genuine questions about Australian law. We're seeking seasoned Australian in-house counsel to serve as expert reviewers, feeding the same prompts through two AI platforms, comparing the results, and ranking them against a clearly defined rubric. This remote, hourly role starts with roughly 10 hours of work, with the potential for more assignments down the line.
Mercor
VerifiedIn-House Counsel (United Kingdom)
Mercor is working with a leading legal AI company to assess how well AI models handle genuine questions about UK law. We're looking for experienced in-house counsel in the UK to act as expert reviewers, evaluating outputs from two different AI systems. You'll compare responses side by side, score them against a set rubric, and provide concise written feedback for each evaluation.
Mercor
VerifiedIn-House Counsel (Germany)
A leading legal AI company is teaming up with Mercor to measure how well large language models handle real-world German law questions. They're looking for experienced German in-house counsel to act as expert evaluators, comparing responses from two AI platforms. You'll score outputs against a clear rubric and provide brief written assessments. This is a flexible, remote contract opportunity paying a strong hourly rate.
Mercor
VerifiedIn-House Counsel (Spain)
Mercor is collaborating with a legal AI company to see how well artificial intelligence handles real questions about Spanish law. We're seeking seasoned in-house counsel based in Spain to serve as expert reviewers, evaluating answers from two AI platforms and scoring them against a structured rubric.