Spanish AI Response Evaluator - Remote Mexico
Listing checked September 22, 2026 · pay as published by Handshake AI
Overview
Handshake AI hires Spanish speakers based in Mexico to judge and rank answers from AI chat assistants. You will draw on your own experience with ChatGPT to decide which response fits a specific user better, then explain that choice in Spanish. Work happens on Handshake's annotation platform, and the project-based setup lets you complete tasks at your own pace with no fixed schedule or minimum hours. This ongoing fellowship suits people who already use AI tools and can defend subtle preferences between two model outputs.
What You'll Do6
- 1Complete tasks on Handshake's annotation platform while using your own real conversations with AI assistants.
- 2Compare AI-generated responses side by side and select the one that serves the described user better.
- 3Explain your preference in written Spanish, giving reasoning that shows why one answer outperforms the other.
- 4Rank or rate AI outputs based on relevance, tone, and fit for an individual user.
- 5Share your ChatGPT conversation history for research and product improvement, with confidentiality protections.
- 6Work at your own pace with no set schedule and no minimum hour requirement.
Requirements6
- 1Reside in Mexico and work in a remote, self-directed, asynchronous setup.
- 2Write and speak Spanish fluently, with strong written communication for explaining decisions.
- 3Understand English at around B2 level because the platform, instructions, and training materials are in English.
- 4Use ChatGPT or similar AI chat assistants with enough familiarity to compare responses.
- 5Form and defend your own preferences between two AI-generated answers, even when differences are subtle.
- 6Share your ChatGPT conversation history for research and product improvement under confidential handling.
Who Should Apply
The role fits a Mexico-based Spanish speaker who already uses ChatGPT, writes clear Spanish, and reads English well enough for platform instructions. You should enjoy comparing two model answers and explaining why one suits a user better, even when the gap is small. Applicants who cannot share their ChatGPT history, or who lack B2 English, often score low because the platform and training materials are in English. This fellowship is less suitable for someone seeking a permanent job with fixed hours or a traditional team schedule. Candidates who give vague feedback like "this answer sounds better" instead of reasoned preferences also tend to miss the mark.
Salary Insight
Pay is $25.00 per hour for this part-time fellowship. For project-based AI evaluation that requires fluent Spanish and around B2 English, that rate matches roles asking for hands-on ChatGPT experience and written reasoning. Because there is no minimum hour requirement, your total earnings depend on the number of tasks you complete.
Location
Compensation
$25/hr
Required Skills
Application Tip
In your application, name the AI chat assistants you use and describe one real case where you compared two responses and chose one for a specific user need. Mention your English level (B2 or higher) and confirm you are based in Mexico, since location and language are hard filters for this fellowship.
See NearSkill jobs more often in your search
Application & verification flow
1Instant rubric match
Your resume is scanned against this role’s requirements to check qualification fit.
2Screened before the employer sees it
Only profiles that clear screening are passed on.
3Outcome by email
We notify you at the address on your resume once the screening is reviewed.
Similar open positions
Explore active roles that match your skills and interests.
Handshake AI
VerifiedJapanese AI Evaluation Specialist - Japan Remote
Handshake AI invites Japanese speakers who live in Japan to join a project-based fellowship focused on making AI chat replies more personal. You will use your own time with ChatGPT to judge pairs of model answers, choose which one fits a user better, and explain that choice in clear Japanese. Tasks run through Handshake's annotation platform, where your written feedback trains future models to tailor responses to individual users. The role is remote and asynchronous, with no fixed hours or minimum workload, so you can add it to an existing job. Because instructions and training arrive in English, you need solid English reading skills alongside fluent Japanese.
Handshake AI
VerifiedKorean AI Response Evaluation Specialist - South Korea
Handshake AI seeks Korean speakers in South Korea to rank and critique model outputs for more personalized answers. You will work inside an annotation platform, drawing on your own ChatGPT usage to compare two responses and explain which one fits a specific user better. The fellowship runs as ongoing project work, so you can schedule tasks around a current job. Written feedback in Korean carries the weight here, while the platform and training materials arrive in English. You set your own schedule, with no fixed shift or minimum hour count.
Turing
VerifiedAI Quality Analyst (Personalization) - Spanish
Evaluators in this role test Gemini's new personalization feature by measuring how well the model uses past conversations, Gmail, Google Search, and YouTube activity to tailor responses. The work blends creative prompt writing with structured quality review. Each evaluation prompt starts from the evaluator's own experiences and runs 1-5 turns. You will score responses on Grounding, Integration, and Helpfulness, then compare them side-by-side and justify each ranking. The project centers on Spanish, and you must use your personal Google account for authentic data access.
Handshake AI
VerifiedBahasa Indonesian AI Response Evaluator Remote
Handshake AI invites Bahasa Indonesian speakers who live in Indonesia to join an ongoing project that improves how chat assistants personalize answers. You will use your own experience with ChatGPT to compare AI-generated replies and explain which one fits a specific user better. Work happens on Handshake's annotation platform, and training materials, instructions, and the interface appear in English. You set your own hours, complete tasks at your own pace, and can keep this project alongside a current job. Applicants need to share ChatGPT conversation history for research and product improvement, and Handshake handles that data under confidentiality rules.
SME Careers
VerifiedSpanish Localization Specialist for AI Data Training
This remote, hourly contractor role centers on shaping AI data training content in Spanish localization to guide model learning. You’ll craft detailed prompts and responses across topics to help AI models understand nuanced language and cultural references. A core part of the work is reviewing AI outputs for accuracy and clarity and providing actionable feedback. You’ll apply MQM and LQA concepts to identify errors and document root causes for continuous improvement.
Turing
VerifiedSmall business owners (AI response evaluation) - Spanish Business Documents
You will compare answers from multiple AI chatbots against real-world small business scenarios. Using your own Spanish business documents, you will create realistic prompts and run each chatbot conversation for up to five turns. For every task, you will score responses on clarity, usefulness, and accuracy, then submit transcripts and structured feedback. The 16-week engagement is fully remote and project-based, with a defined number of evaluation tasks.