Generalist - English & Telugu | $15-$20/hr Remote
Overview
This contract role involves evaluating Telugu-language AI responses to identify strengths, weaknesses, and factual errors. You'll provide detailed English-language feedback that directly shapes how future AI models generate more accurate and natural-sounding answers. It's a fully remote, part-time position perfect for bilingual professionals with an analytical mindset.
What You'll Do4
- 1Verify facts by cross-referencing responses against trusted public sources and external search tools.
- 2Create structured evaluation data that highlights what an AI response does well, where it falls short, and any inaccuracies present.
- 3Judge responses on reasoning, clarity, tone, and completeness — noting subtle issues that affect quality.
- 4Ensure each AI output follows expected conversational norms and the project's specific guidelines for safe, helpful behavior.
Requirements7
- 1A Bachelor's degree in any field.
- 2Native-level fluency in Telugu plus strong written English skills to articulate nuanced feedback clearly.
- 3Hands-on experience working with large language models (LLMs) — you understand common failure modes and user expectations.
- 4Exceptional attention to detail, especially in spotting subtle reasoning gaps or tone mismatches.
- 5A background that involves structured analytical thinking (e.g., research, policy, analytics, linguistics, or engineering).
- 6Bonus: Previous work in RLHF, model evaluation, or data annotation.
- 7Bonus: Experience comparing multiple AI outputs and making fine-grained qualitative judgments.
Who Should Apply
You're a detail-oriented bilingual thinker who enjoys dissecting language and logic. You have a strong grasp of how LLMs work and can articulate exactly why one response is better than another. Whether your background is in linguistics, data analysis, or research, you're comfortable with structured evaluation tasks and thrive in a remote, independent workflow.
Salary Insight
The role pays $15–$20 per hour (USD), based on experience and performance.
Application Tip
To stand out, include a brief example in your application of a time you evaluated an AI or chatbot response and suggested a concrete improvement—this shows you already think like an evaluator.
Similar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedGeneralist - English & Tamil | $15-$20/hr Remote
This remote contract role is perfect for a bilingual Tamil and English speaker who enjoys digging into the details of AI-generated content. You'll evaluate model responses in Tamil, checking for accuracy, clarity, and reasoning quality, then provide structured feedback in English. Your work will directly help shape the next generation of conversational AI, making it smarter and more reliable.
Mercor
VerifiedGeneralist - English & Malayalam | $15-$20/hr Remote
This is a remote, part-time contract role where you’ll evaluate AI-generated responses in Malayalam, identifying what works and what needs improvement. Your detailed, English-language analysis will directly contribute to refining the model’s output quality. Ideal for someone who enjoys structured analytical thinking and wants to shape the next generation of conversational AI.
Mercor
VerifiedGeneralist - English & Gujarati | $15-$20/hr Remote
This role focuses on reviewing and evaluating AI-generated responses in Gujarati to identify strengths and areas for improvement. You'll perform fact-checking, assess reasoning and clarity, and produce detailed feedback in English that helps refine future AI outputs. The work is fully remote and contract-based, offering flexible hours for bilingual professionals.
Mercor
VerifiedGeneralist - English & Marathi | $15-$20/hr Remote
We're looking for a bilingual Marathi-English generalist to help refine how AI models understand and respond in Marathi. You'll evaluate AI-generated answers by identifying strengths, weaknesses, and factual errors, then provide clear feedback in English. This contract role is ideal for someone with strong analytical instincts and native Marathi fluency.
Mercor
VerifiedGeneralist - English & Odia | $15-$20/hr Remote
Join a global team of evaluators helping refine AI-generated responses in Odia. In this contract role, you’ll analyze model outputs for accuracy, clarity, and cultural relevance, then provide detailed feedback in English. Your work directly shapes the next generation of conversational AI.
Mercor
VerifiedGeneralist - English & Bengali | $15-$20/hr Remote
This remote contract role gives you the chance to shape how AI communicates in Bengali. You'll analyze model-generated responses, pinpoint what works and what doesn't, and document your findings in English. Your insights will directly influence the next generation of conversational AI, making it more accurate and natural.