AI Personalization Evaluation Expert – Multilingual
Listing checked October 11, 2026 · pay as published by Meridial
Overview
The project measures how well AI assistants deliver personalized conversations when they can draw on connected digital services and past activity. You chat with two versions of an assistant, then compare each experience. After writing a prompt, you hold a natural back-and-forth with both systems. Some questions tie to information in those linked services, while others come from whatever topic you choose. Your evaluations focus on how each assistant uses context, earns trust, and handles feedback.
What You'll Do8
- 1Write an initial prompt that starts a conversation with two AI assistants.
- 2Hold separate natural exchanges with each assistant, covering either connected-service activity or open topics.
- 3Compare how each assistant applies available information from your linked services.
- 4Rate whether the assistant shows understanding of you and your context.
- 5Check how each assistant links details across the conversation.
- 6Assess trustworthiness and safety in each response.
- 7Note how each assistant reacts to your feedback and corrections.
- 8Score the overall helpfulness and natural flow of both conversations.
Requirements6
- 1Fluent in one of these languages and locales: Spanish (Latin America), Arabic, Portuguese (Brazil), Japanese (Japan), Turkish (Turkey), Indonesian (Indonesia), Hindi (India), Korean (Korea), French (France), or German (Germany).
- 2Meet the expert requirement set tied to your chosen language or locale.
- 3Recent activity across a specific mix of everyday digital services that meets the project threshold.
- 4Complete a brief verification that checks your service usage and activity.
- 5Answer every verification question based on your actual, current usage.
- 6Skill in comparing two AI assistants across dimensions such as context use, trust, safety, feedback handling, and conversational flow.
Who Should Apply
Ideal candidates speak one of the listed languages at a fluent level and match the expert requirement set for that locale. They also show recent, active use of a specific combination of everyday digital services, since the project verifies that activity before placement. The role suits people who enjoy comparing two AI assistants and scoring context use, trust, safety, feedback response, and conversational flow. Applicants who skip the verification or give answers that do not reflect their real service usage often fail the eligibility check. People seeking a general AI writing or data labeling task may find this project too focused on personalization evaluation and service-linked context.
Salary Insight
The role pays $9.00/hr. That rate sits at the entry level for AI evaluation and personalization review work, so candidates with prior annotation, model comparison, or multilingual evaluation experience may see it as a starting point rather than a premium rate.
Pay and demand for Language & Linguistics roles
AggregatedTypical pay
$30/hour
This role
$9/hr
Most Language & Linguistics roles pay $20–$45 per hour. This role's pay sits below that range.
Based on 236 similar roles that publish pay · 102 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 274
- Listed in last 30 days
- 183
- Remote
- 100%
Hiring most right now: SME Careers (106) · micro1 (68) · Turing (37)
Most requested skills · share of roles
- translation quality review31%
- localization30%
- translation27%
- proofreading26%
Figures from Language & Linguistics roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$9/hr
Required Skills
Application Tip
Complete the service verification with your true, current usage, and list every qualifying digital service you use, because the project checks a specific combination and activity level before placement.
See NearSkill jobs more often in your search
Application & verification flow
1Instant rubric match
Your resume is scanned against this role’s requirements to check qualification fit.
2Screened before the employer sees it
Only profiles that clear screening are passed on.
3Outcome by email
We notify you at the address on your resume once the screening is reviewed.
Similar open positions
Explore active roles that match your skills and interests.
Turing
VerifiedAI Quality Analyst (Personalization) - Spanish
Evaluators in this role test Gemini's new personalization feature by measuring how well the model uses past conversations, Gmail, Google Search, and YouTube activity to tailor responses. The work blends creative prompt writing with structured quality review. Each evaluation prompt starts from the evaluator's own experiences and runs 1-5 turns. You will score responses on Grounding, Integration, and Helpfulness, then compare them side-by-side and justify each ranking. The project centers on Spanish, and you must use your personal Google account for authentic data access.
Turing
VerifiedAI Quality Analyst (Personalization) - Arabic
You will evaluate a new personalization feature in Gemini. You will design prompts that draw on your own life and judge how well the model uses data from past conversations, Gmail, Google Search, and YouTube to tailor responses. Each review weighs Grounding, Integration, and helpfulness. The project focuses on Arabic, so strong reading and writing skills in that language are required. Work is remote and requires a 4-hour overlap with Pacific Time each day.
Turing
VerifiedAI Quality Analyst (Personalization) - Polish
Evaluate a new Gemini personalization feature by testing how well the model draws on past conversations, Gmail, Google Search, and YouTube activity to tailor responses. You will design multi-turn prompts from your own personal experiences, then score outputs on Grounding, Integration, and Helpfulness. The position is a contractor role that requires Polish reading and writing proficiency and at least 4 hours of daily overlap with Pacific Time. Work happens remotely on your own device, and every evaluation conversation must be deleted afterward to keep your personal history clean.
Turing
VerifiedAI Quality Analyst (Personalization) - Portuguese
You will evaluate a new personalization feature for Gemini by testing how it draws on past conversations, Gmail, Google Search, and YouTube activity. You will design multi-turn prompts from your own life and judge whether the model's responses are grounded, integrated, and genuinely helpful. Your daily routine involves comparing two model answers side-by-side and writing rationales that reference specific turns. The role demands Portuguese fluency, a willingness to use your personal Google account, and full-time availability aligned to global coverage.
Turing
VerifiedAI Quality Analyst (Personalization) - Dutch
Contractors will evaluate a new Gemini personalization feature by testing how well it uses past conversations, Gmail, Google Search, and YouTube activity. The work mixes creative prompt design with analytical evaluation, including side-by-side ranking of model responses. Evaluations focus on dimensions like Grounding, Integration, and Helpfulness in Dutch, the project's focus language. The engagement runs one month, requires 4 hours of daily overlap with PST, and pays $20 per hour.
Turing
VerifiedAI Quality Analyst (Personalization) - Turkish
In this contract role, you will evaluate a new personalization feature for Gemini. You will measure how well the model incorporates signals from your past conversations, Gmail, Google Search, and YouTube activity to make responses more relevant. You will design multi-turn prompts based on your own experiences and then judge the model's output on dimensions like Grounding, Integration, and Helpfulness. The work demands both creative prompt design and disciplined analytical review of model responses.