Mandarin AI Evaluation Specialist (Singapore/Malaysia)
Listing checked October 13, 2026 · pay as published by Handshake AI
Overview
Handshake AI seeks Mandarin speakers in Singapore or Malaysia to judge and rank AI-generated answers, helping models tailor responses to individual users. You will work on an annotation platform, using your own experience with AI tools to compare pairs of responses and explain which one works better. The work is ongoing and project-based, so you can fit it around another job. There is no fixed schedule or minimum hours, and you complete tasks at your own pace.
What You'll Do5
- 1Use Handshake's annotation platform to complete evaluation tasks, drawing on your own experience with AI tools.
- 2Compare two AI-generated responses side by side and judge which one is stronger, even when the differences are subtle.
- 3Share your honest preferences and explain the reasoning behind each choice in clear writing.
- 4Write feedback that helps AI models understand how to personalize answers for individual users.
- 5Set your own hours and work in an asynchronous, remote setup with no minimum time commitment.
Requirements6
- 1Based in Singapore or Malaysia and able to work in a remote, self-directed way.
- 2Fluent in Mandarin, both written and spoken, with strong writing skills to explain your reasoning.
- 3Working understanding of English at a B2 level or similar, since the platform, instructions, and training materials are in English.
- 4Bachelor's degree or higher.
- 5Comfortable making and defending your own judgments between two AI responses, even when differences are subtle.
- 6Ability to work on your own in a remote, asynchronous environment.
Who Should Apply
The ideal candidate lives in Singapore or Malaysia, writes clear Mandarin, and reads English well enough to follow platform instructions. You enjoy comparing AI outputs and defending your choice with specific reasoning, even when the two answers look similar.
Salary Insight
This fellowship pays $30.00 per hour. For project-based AI evaluation work that demands Mandarin fluency and a bachelor's degree, the rate matches the skill and judgment expected.
Pay and demand for AI Training roles
AggregatedTypical pay
$70/hour
This role
$30/hr
Most AI Training roles pay $37–$95 per hour. This role's pay sits below that range.
Based on 961 similar roles that publish pay · 300 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,088
- Listed in last 30 days
- 472
- Remote
- 99%
Hiring most right now: micro1 (279) · SME Careers (253) · Handshake AI (132)
Most requested skills · share of roles
- ai training15%
- ai evaluation13%
- llm evaluation12%
- data annotation11%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$30/hr
Required Skills
Application Tip
In your application, provide a concrete example of a time you compared two AI responses and explained your choice, since the role centers on defending subtle judgments.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Handshake AI
VerifiedMalay AI Evaluation Specialist (Singapore/Malaysia)
Handshake AI seeks Malay speakers in Singapore or Malaysia for a part-time, remote fellowship. You will use the company's annotation platform to compare AI-generated answers and rank which response fits an individual user better. The work is project-based and ongoing, so you can schedule tasks around another job. Your written feedback in Bahasa Melayu helps train future models to personalize their replies. Handshake sets no minimum hours and no fixed schedule.
Handshake AI
VerifiedTamil AI Evaluation Specialist (Singapore/Malaysia)
Handshake AI seeks Tamil speakers in Singapore or Malaysia to support model personalization. You will work on an annotation platform, compare and rank AI responses, and explain which answer fits an individual user better. The work is ongoing and project-based, so you can add it to your current role. No set schedule or minimum hour requirement applies. Your feedback helps future models learn how to adapt answers to different people.
Handshake AI
VerifiedHindi AI Evaluation Specialist (Singaporean Dialect)
Handshake AI seeks Hindi speakers who know the Singaporean-Hindi dialect to improve how AI models personalize answers. You will compare pairs of AI-generated responses using your own judgment and real-world experience with AI tools. The work happens on Handshake's annotation platform, with no set schedule, so you can complete tasks at your own pace. This part-time fellowship pays $30 per hour and runs alongside your current commitments.
Handshake AI
VerifiedBangla AI Evaluation Specialist
Handshake AI seeks Bangla speakers who know the language as used in Singapore to help models give more personal answers. The work is a part-time fellowship you can do alongside another role, with no set schedule or minimum hours. You judge and rank AI responses, then write feedback that explains your choices for individual users. Pay runs at $30.00 per hour, and the project continues on an ongoing basis.
Handshake AI
VerifiedJapanese AI Evaluation Specialist (Japan)
Handshake AI seeks Japanese speakers who live in Japan to improve how models personalize answers. You will review and rank AI responses on the Handshake annotation platform, using your own experience with AI tools to judge which output fits a user better. You do not need prior AI training experience, and the project runs alongside other commitments. Work happens on a part-time, project basis with no fixed schedule or minimum hours.
Handshake AI
VerifiedKorean AI Response Evaluation Specialist - South Korea
Handshake AI seeks Korean speakers in South Korea to rank and critique model outputs for more personalized answers. You will work inside an annotation platform, drawing on your own ChatGPT usage to compare two responses and explain which one fits a specific user better. The fellowship runs as ongoing project work, so you can schedule tasks around a current job. Written feedback in Korean carries the weight here, while the platform and training materials arrive in English. You set your own schedule, with no fixed shift or minimum hour count.