AI Quality Analyst (Personalization) - Dutch
Listing checked August 25, 2026 · pay as published by Turing
Overview
Contractors will evaluate a new Gemini personalization feature by testing how well it uses past conversations, Gmail, Google Search, and YouTube activity. The work mixes creative prompt design with analytical evaluation, including side-by-side ranking of model responses. Evaluations focus on dimensions like Grounding, Integration, and Helpfulness in Dutch, the project's focus language. The engagement runs one month, requires 4 hours of daily overlap with PST, and pays $20 per hour.
What You'll Do8
- 1Craft multi-turn prompts ranging from 1 to 5 turns that force the model to draw on your personal data and experiences.
- 2Score model responses against the intent of your starting prompt to confirm the personalization was applied as intended.
- 3Audit responses for Grounding errors, flagging claims about you that rely on weak inference or hallucination rather than evidence.
- 4Judge Integration quality by checking that personal details feel natural in the response instead of robotic overnarrating.
- 5Compare two model outputs side-by-side (SxS) and stack-rank them by overall helpfulness, ease of use, and enjoyment.
- 6Write concise rationales for each ranking, referencing exact turn numbers where the model succeeded or failed.
- 7Pull and verify Debug Info to confirm the model used chat summaries and connected data sources as expected.
- 8Delete evaluation conversations after each session to keep your chat history clean and prevent data leakage.
Requirements11
- 1Read and write Dutch with full professional proficiency; Dutch is the required language for this evaluation project.
- 2Use your primary personal Google account and enable personal data sources such as Gmail, Search, and YouTube for testing.
- 3Commit to at least 4 hours per day, up to 40 hours per week, with 4 hours of overlap with PST.
- 4Apply strong analytical thinking to judge nuanced, ambiguous AI outputs and personalization quality.
- 5Design creative, multi-turn prompts based on personal context to stress-test the model's capabilities.
- 6Identify incorrect personalization, poor inferences, and forced connections in model responses.
- 7Spot subtle differences between side-by-side responses, including naturalness and overnarrating.
- 8Write clear, structured rationales for rankings and reference specific turn numbers.
- 9Provide constructive feedback and detailed annotations on model behavior.
- 10Hold a BS/BA degree or equivalent experience in fields like linguistics, computer science, journalism, law, or policy; prior work in data annotation or AI evaluation is preferred.
- 11Work independently in a remote environment with a dependable computer and internet connection.
Who Should Apply
The ideal candidate is a Dutch-speaking evaluator with a sharp eye for AI output flaws and comfort using their personal Google account as a testing tool. Someone with prior experience in data annotation, content moderation, or AI quality evaluation will adapt well, since the work demands precise written rationale and SxS judgment. This role is less suitable for people who prefer structured, predictable tasks or who hesitate to share personal search and email data for testing. Applications often stall when candidates lack fluent Dutch, fail to meet the PST overlap requirement, or submit assessment responses that are vague and do not reference turn numbers. The one-month contract also requires strict data hygiene, so candidates unwilling to delete conversation histories should not apply.
Salary Insight
The project pays $20 per hour for a one-month contractor engagement.
Location
Compensation
$20/hr
Required Skills
Application Tip
When completing the assessment, structure your rationales around specific turn numbers and address Grounding, Integration, and Helpfulness as separate dimensions.
See NearSkill jobs more often in your search
Application & verification flow
1Instant rubric match
Your resume is scanned against this role’s requirements to check qualification fit.
2Screened before the employer sees it
Only profiles that clear screening are passed on.
3Outcome by email
We notify you at the address on your resume once the screening is reviewed.
Similar open positions
Explore active roles that match your skills and interests.
Turing
VerifiedAI Quality Analyst (Personalization) - Polish
Evaluate a new Gemini personalization feature by testing how well the model draws on past conversations, Gmail, Google Search, and YouTube activity to tailor responses. You will design multi-turn prompts from your own personal experiences, then score outputs on Grounding, Integration, and Helpfulness. The position is a contractor role that requires Polish reading and writing proficiency and at least 4 hours of daily overlap with Pacific Time. Work happens remotely on your own device, and every evaluation conversation must be deleted afterward to keep your personal history clean.
Turing
VerifiedAI Quality Analyst - English
This role puts you inside Gemini's personalization quality loop. You will design multi-turn prompts that draw on your own Google activity, including Gmail, Search, and YouTube history, then judge whether the model's responses are grounded, integrated, and helpful. The work involves side-by-side SxS evaluations, writing rationales that reference specific turns, and verifying debug info to confirm the model used your data correctly. This 3-month contractor engagement requires at least 4 hours per day with a 4-hour overlap with PST.
Turing
VerifiedAI Quality Analyst (Personalization) - Turkish
In this contract role, you will evaluate a new personalization feature for Gemini. You will measure how well the model incorporates signals from your past conversations, Gmail, Google Search, and YouTube activity to make responses more relevant. You will design multi-turn prompts based on your own experiences and then judge the model's output on dimensions like Grounding, Integration, and Helpfulness. The work demands both creative prompt design and disciplined analytical review of model responses.
Turing
VerifiedAI Quality Analyst (Personalization) - German
An AI Quality Analyst on this project evaluates Gemini's new personalization feature by testing how well it uses data from past conversations, Gmail, Google Search, and YouTube activity. Analysts design multi-turn prompts grounded in their own experiences, then judge the responses for Grounding, Integration, and Helpfulness. The work is remote, contract-based, and focused on German-language quality. German reading and writing skills at a professional level are required, along with agreement to connect a primary personal Google account.
Turing
VerifiedAI Quality Analyst (Personalization) - Spanish
Evaluators in this role test Gemini's new personalization feature by measuring how well the model uses past conversations, Gmail, Google Search, and YouTube activity to tailor responses. The work blends creative prompt writing with structured quality review. Each evaluation prompt starts from the evaluator's own experiences and runs 1-5 turns. You will score responses on Grounding, Integration, and Helpfulness, then compare them side-by-side and justify each ranking. The project centers on Spanish, and you must use your personal Google account for authentic data access.
Turing
VerifiedAI Quality Analyst - Portuguese (Portugal)
Turing hires an AI Quality Analyst to evaluate a new Gemini personalization feature that pulls from your past conversations, Gmail, Google Search, and YouTube activity. You will write multi-turn prompts in Portuguese from your own experiences and judge how well the model responds. Each review weighs personalization quality across Grounding, Integration, and Helpfulness. The contractor role runs for 3 months, pays $15 per hour, and asks for 4 hours of daily overlap with PST.