Japanese AI Evaluation Specialist (Japan)
Listing checked October 13, 2026 · pay as published by Handshake AI
Overview
Handshake AI seeks Japanese speakers who live in Japan to improve how models personalize answers. You will review and rank AI responses on the Handshake annotation platform, using your own experience with AI tools to judge which output fits a user better. You do not need prior AI training experience, and the project runs alongside other commitments. Work happens on a part-time, project basis with no fixed schedule or minimum hours.
What You'll Do5
- 1Use the Handshake annotation platform to complete evaluation tasks, drawing on your real-world use of AI tools.
- 2Compare pairs of AI-generated answers and choose the one you prefer, then explain the reasons behind your choice.
- 3Rank AI responses to help models tailor future answers to individual users.
- 4Write clear feedback that describes why one response works better for a user, including subtle differences.
- 5Set your own schedule and complete tasks at your own pace, with no minimum hour target.
Requirements6
- 1Live in Japan and work in a remote, asynchronous setup with self-direction.
- 2Speak and write Japanese at a fluent level, with strong written skills for explaining your reasoning.
- 3Understand English well enough for platform instructions and training materials, around CEFR B2.
- 4Hold a bachelor's degree or higher.
- 5Form and defend your own preference between two AI answers, even when the differences are small.
- 6Work without close supervision in a remote, asynchronous setting.
Who Should Apply
The ideal candidate lives in Japan, writes Japanese at a fluent level, and can explain a preference between two AI responses in clear written form. A bachelor's degree and working English (around CEFR B2) complete the profile.
Salary Insight
This fellowship pays $30.00 per hour for part-time work. Pay at this level often matches language-focused AI evaluation projects that need bilingual judgment, and the lack of a minimum hour requirement lets you decide how much you take on.
Pay and demand for AI Training roles
AggregatedTypical pay
$70/hour
This role
$30/hr
Most AI Training roles pay $37–$95 per hour. This role's pay sits below that range.
Based on 961 similar roles that publish pay · 300 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,088
- Listed in last 30 days
- 472
- Remote
- 99%
Hiring most right now: micro1 (279) · SME Careers (253) · Handshake AI (132)
Most requested skills · share of roles
- ai training15%
- ai evaluation13%
- llm evaluation12%
- data annotation11%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$30/hr
Required Skills
Application Tip
Write a short sample in Japanese that compares two AI answers and states which one you prefer with your reasoning, then include your English level (for example CEFR B2) and your bachelor's degree in your profile.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Handshake AI
VerifiedJapanese AI Evaluation Specialist - Japan Remote
Handshake AI invites Japanese speakers who live in Japan to join a project-based fellowship focused on making AI chat replies more personal. You will use your own time with ChatGPT to judge pairs of model answers, choose which one fits a user better, and explain that choice in clear Japanese. Tasks run through Handshake's annotation platform, where your written feedback trains future models to tailor responses to individual users. The role is remote and asynchronous, with no fixed hours or minimum workload, so you can add it to an existing job. Because instructions and training arrive in English, you need solid English reading skills alongside fluent Japanese.
Handshake AI
VerifiedMandarin AI Evaluation Specialist (Singapore/Malaysia)
Handshake AI seeks Mandarin speakers in Singapore or Malaysia to judge and rank AI-generated answers, helping models tailor responses to individual users. You will work on an annotation platform, using your own experience with AI tools to compare pairs of responses and explain which one works better. The work is ongoing and project-based, so you can fit it around another job. There is no fixed schedule or minimum hours, and you complete tasks at your own pace.
Handshake AI
VerifiedSpanish AI Evaluation Specialist (Mexico)
Handshake AI seeks Spanish speakers in Mexico to help shape how AI models personalize answers for individual users. You will work inside Handshake's annotation platform, compare AI-generated replies, and share which one you prefer and why. The project runs on an ongoing basis, so you can add it alongside another role. You set your own schedule, with no minimum hours and no fixed shifts. Your feedback goes toward making future models better at tailoring responses to each person.
Handshake AI
VerifiedKorean AI Response Evaluation Specialist - South Korea
Handshake AI seeks Korean speakers in South Korea to rank and critique model outputs for more personalized answers. You will work inside an annotation platform, drawing on your own ChatGPT usage to compare two responses and explain which one fits a specific user better. The fellowship runs as ongoing project work, so you can schedule tasks around a current job. Written feedback in Korean carries the weight here, while the platform and training materials arrive in English. You set your own schedule, with no fixed shift or minimum hour count.
Handshake AI
VerifiedFrench AI Evaluation Specialist (Canada)
Handshake AI needs French speakers across Canada to sharpen how AI models tailor answers for individual users. The work centers on comparing and ranking model outputs on Handshake's annotation platform, then explaining which response fits better and why. You bring your own experience with AI tools to each task and submit written judgments that guide future model behavior. Projects run on an ongoing basis, so you can fit the work around a current job or study schedule.
Handshake AI
VerifiedPortuguese AI Evaluation Specialist (Brazil)
Handshake AI runs a fellowship for Portuguese speakers in Brazil who want a hand in shaping how models tailor answers to individual users. You work inside an annotation platform, compare pairs of AI-generated responses, and rank them using your own judgment about which one fits the request better. Every preference you record, plus the reasoning behind it, feeds into how future models personalize their output. Projects run on an ongoing basis, so the work fits around a current job or course load.