Portuguese AI Evaluation Specialist (Brazil)
Listing checked October 15, 2026 · pay as published by Handshake AI
Overview
Handshake AI runs a fellowship for Portuguese speakers in Brazil who want a hand in shaping how models tailor answers to individual users. You work inside an annotation platform, compare pairs of AI-generated responses, and rank them using your own judgment about which one fits the request better. Every preference you record, plus the reasoning behind it, feeds into how future models personalize their output. Projects run on an ongoing basis, so the work fits around a current job or course load.
What You'll Do6
- 1Work through tasks on Handshake's annotation platform, drawing on your own experience with AI tools.
- 2Compare two AI-generated responses side by side and choose the one that serves the user's request better.
- 3Explain each choice in writing, describing the reasoning that shaped your preference.
- 4Point out subtle gaps in tone, accuracy, and personalization that separate the two responses.
- 5Submit honest feedback that helps models learn to personalize answers for individual users.
- 6Set your own hours, with no fixed schedule and no minimum weekly commitment.
Requirements5
- 1Based in Brazil and able to work remotely on a self-directed, asynchronous schedule.
- 2Fluent in Portuguese, written and spoken, with the writing skills to lay out your reasoning in clear prose.
- 3Working knowledge of English at around B2 level, since the platform, instructions, and training material all arrive in English.
- 4Comfortable choosing between two AI responses and defending that choice when the differences are subtle.
- 5Holds a bachelor's degree or higher.
Who Should Apply
Portuguese speakers living in Brazil who hold a bachelor's degree and read English instructions at a B2 level. The work suits people with firm opinions about which AI answer works better and the writing skill to spell out why.
Salary Insight
Pay runs $25.00 per hour for this part-time fellowship. That rate reflects the bilingual, reasoning-heavy nature of the tasks rather than simple data labeling, and it matches the degree and Portuguese fluency the project asks for. Earnings scale with how many tasks you take on, since no weekly hour minimum applies.
Pay and demand for AI Training roles
AggregatedTypical pay
$70/hour
This role
$25/hr
Most AI Training roles pay $37–$95 per hour. This role's pay sits below that range.
Based on 961 similar roles that publish pay · 300 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,088
- Listed in last 30 days
- 469
- Remote
- 99%
Hiring most right now: micro1 (279) · SME Careers (253) · Handshake AI (132)
Most requested skills · share of roles
- ai training15%
- ai evaluation13%
- llm evaluation12%
- data annotation11%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$25/hr
Required Skills
Application Tip
State your English level as a concrete figure such as B2 and describe your Portuguese writing in terms of the audience you have written for. Then add one short reasoning sample: two model responses, your pick, and the reason. Reviewers score written judgment, so a real example carries more weight than a list of language certificates.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Handshake AI
VerifiedSpanish AI Evaluation Specialist (Mexico)
Handshake AI seeks Spanish speakers in Mexico to help shape how AI models personalize answers for individual users. You will work inside Handshake's annotation platform, compare AI-generated replies, and share which one you prefer and why. The project runs on an ongoing basis, so you can add it alongside another role. You set your own schedule, with no minimum hours and no fixed shifts. Your feedback goes toward making future models better at tailoring responses to each person.
Handshake AI
VerifiedSpanish AI Response Evaluator - Remote Mexico
Handshake AI hires Spanish speakers based in Mexico to judge and rank answers from AI chat assistants. You will draw on your own experience with ChatGPT to decide which response fits a specific user better, then explain that choice in Spanish. Work happens on Handshake's annotation platform, and the project-based setup lets you complete tasks at your own pace with no fixed schedule or minimum hours. This ongoing fellowship suits people who already use AI tools and can defend subtle preferences between two model outputs.
Handshake AI
VerifiedJapanese AI Evaluation Specialist (Japan)
Handshake AI seeks Japanese speakers who live in Japan to improve how models personalize answers. You will review and rank AI responses on the Handshake annotation platform, using your own experience with AI tools to judge which output fits a user better. You do not need prior AI training experience, and the project runs alongside other commitments. Work happens on a part-time, project basis with no fixed schedule or minimum hours.
SME Careers
VerifiedPortuguese Localization Expert for AI Training Data
This remote, hourly contractor role focuses on evaluating AI outputs in Portuguese to ensure accuracy, tone, and cultural nuance. You will craft high‑quality language content and assess the model’s reasoning quality to guide training. Apply senior‑level Portuguese localization judgment and MQM/LQA concepts to maintain consistent quality across prompts and outputs. You’ll work as a remote contractor with opportunities to join future AI data projects through SME Careers.
Handshake AI
VerifiedFrench AI Evaluation Specialist (Canada)
Handshake AI needs French speakers across Canada to sharpen how AI models tailor answers for individual users. The work centers on comparing and ranking model outputs on Handshake's annotation platform, then explaining which response fits better and why. You bring your own experience with AI tools to each task and submit written judgments that guide future model behavior. Projects run on an ongoing basis, so you can fit the work around a current job or study schedule.
Handshake AI
VerifiedMandarin AI Evaluation Specialist (Singapore/Malaysia)
Handshake AI seeks Mandarin speakers in Singapore or Malaysia to judge and rank AI-generated answers, helping models tailor responses to individual users. You will work on an annotation platform, using your own experience with AI tools to compare pairs of responses and explain which one works better. The work is ongoing and project-based, so you can fit it around another job. There is no fixed schedule or minimum hours, and you complete tasks at your own pace.