Generalist - English & Urdu | $15-$20/hr Remote
Overview
We’re looking for a bilingual Urdu and English speaker to help refine AI-generated responses. You’ll evaluate model outputs for accuracy, clarity, and reasoning, then provide structured feedback in English. This is a part-time, remote contract role where your insights directly shape the next generation of conversational AI.
What You'll Do5
- 1Verify facts using trusted public sources and external tools to ensure response accuracy.
- 2Create high-quality human evaluation data by pinpointing strengths, weaknesses, and factual errors in Urdu AI responses.
- 3Assess reasoning quality, tone, clarity, and completeness of each response against expected standards.
- 4Check that model outputs follow system guidelines and behave naturally in conversation.
- 5Document your analysis clearly in English, highlighting subtle nuances others might miss.
Requirements5
- 1Native fluency in Urdu and strong proficiency in English (both written and spoken).
- 2A Bachelor’s degree in any field, with a background that demands analytical thinking (e.g., research, policy, linguistics, engineering).
- 3Significant hands-on experience working with large language models (LLMs) and understanding how people use them.
- 4Exceptional attention to detail, able to spot factual gaps, reasoning errors, or communication issues.
- 5Nice to have: prior experience with RLHF, model evaluation, data annotation, or writing/editing high-quality content.
Who Should Apply
The ideal candidate is a meticulous bilingual professional who enjoys picking apart text and identifying what works and what doesn’t. You’re comfortable using LLMs regularly, have a knack for analytical reasoning, and can communicate subtle feedback in precise English. If you’ve done data annotation, RLHF, or quality evaluation before, you’ll hit the ground running.
Salary Insight
$15–$20 per hour, paid as a remote part-time contract role. Global applicants welcome.
Application Tip
Before applying, practice evaluating a short Urdu AI response and write a sample critique in English. This demonstrates your analytical approach and will help you ace the mandatory Bilingual Competency interview.
Similar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedGeneralist - English & Punjabi | $15-$20/hr Remote
Join a team dedicated to refining AI communication by evaluating Punjabi-language model responses. In this remote contract role, you'll assess the quality, accuracy, and tone of AI-generated text, providing detailed feedback in English. Your analytical eye will help shape the next generation of conversational AI.
Mercor
VerifiedGeneralist - English & Bengali | $15-$20/hr Remote
This remote contract role gives you the chance to shape how AI communicates in Bengali. You'll analyze model-generated responses, pinpoint what works and what doesn't, and document your findings in English. Your insights will directly influence the next generation of conversational AI, making it more accurate and natural.
Mercor
VerifiedGeneralist - English & Telugu | $15-$20/hr Remote
This contract role involves evaluating Telugu-language AI responses to identify strengths, weaknesses, and factual errors. You'll provide detailed English-language feedback that directly shapes how future AI models generate more accurate and natural-sounding answers. It's a fully remote, part-time position perfect for bilingual professionals with an analytical mindset.
Mercor
VerifiedGeneralist - English & Malayalam | $15-$20/hr Remote
This is a remote, part-time contract role where you’ll evaluate AI-generated responses in Malayalam, identifying what works and what needs improvement. Your detailed, English-language analysis will directly contribute to refining the model’s output quality. Ideal for someone who enjoys structured analytical thinking and wants to shape the next generation of conversational AI.
Mercor
VerifiedGeneralist - English & Gujarati | $15-$20/hr Remote
This role focuses on reviewing and evaluating AI-generated responses in Gujarati to identify strengths and areas for improvement. You'll perform fact-checking, assess reasoning and clarity, and produce detailed feedback in English that helps refine future AI outputs. The work is fully remote and contract-based, offering flexible hours for bilingual professionals.
Mercor
VerifiedGeneralist - English & Marathi | $15-$20/hr Remote
We're looking for a bilingual Marathi-English generalist to help refine how AI models understand and respond in Marathi. You'll evaluate AI-generated answers by identifying strengths, weaknesses, and factual errors, then provide clear feedback in English. This contract role is ideal for someone with strong analytical instincts and native Marathi fluency.