Generalist - English & Odia | $15-$20/hr Remote
Overview
Join a global team of evaluators helping refine AI-generated responses in Odia. In this contract role, you’ll analyze model outputs for accuracy, clarity, and cultural relevance, then provide detailed feedback in English. Your work directly shapes the next generation of conversational AI.
What You'll Do4
- 1Verify factual claims in Odia-language AI responses using reliable public sources and tools
- 2Produce high-quality human evaluation data by noting strengths, weaknesses, and factual mistakes
- 3Assess each response on reasoning, tone, completeness, and clarity
- 4Ensure outputs follow expected conversation norms and project guidelines
Requirements5
- 1Native-level fluency in Odia and strong written English skills
- 2A Bachelor’s degree in any field
- 3Practical experience working with large language models and understanding how people use them
- 4Sharp attention to detail and ability to spot subtle issues in text
- 5Background in structured analytical work such as research, policy, analytics, linguistics, or engineering
Who Should Apply
This role is ideal for detail-oriented individuals who enjoy digging into language and logic. You’re comfortable giving precise, constructive feedback and can switch between Odia and English seamlessly. Prior work in RLHF, model evaluation, or data annotation is a plus, but not required.
Salary Insight
$15.00–$20.00 per hour, based on experience and performance.
Application Tip
Before applying, practice writing a short evaluation of an AI-generated Odia response in English — note both what works and what could be improved. This will help you demonstrate your analytical thinking during the Odia bilingual competency interview.
Similar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedGeneralist - English & Bengali | $15-$20/hr Remote
This remote contract role gives you the chance to shape how AI communicates in Bengali. You'll analyze model-generated responses, pinpoint what works and what doesn't, and document your findings in English. Your insights will directly influence the next generation of conversational AI, making it more accurate and natural.
Mercor
VerifiedGeneralist - English & Telugu | $15-$20/hr Remote
This contract role involves evaluating Telugu-language AI responses to identify strengths, weaknesses, and factual errors. You'll provide detailed English-language feedback that directly shapes how future AI models generate more accurate and natural-sounding answers. It's a fully remote, part-time position perfect for bilingual professionals with an analytical mindset.
Mercor
VerifiedGeneralist - English & Assamese | $15-$20/hr Remote
In this contract role, you'll help refine AI by evaluating its Assamese-language responses. You'll identify strengths and weaknesses, fact-check using public sources, and provide clear English feedback to guide the development of a near-perfect AI assistant. This is a part-time, remote opportunity paying $15–$20 per hour.
Mercor
VerifiedGeneralist - English & Gujarati | $15-$20/hr Remote
This role focuses on reviewing and evaluating AI-generated responses in Gujarati to identify strengths and areas for improvement. You'll perform fact-checking, assess reasoning and clarity, and produce detailed feedback in English that helps refine future AI outputs. The work is fully remote and contract-based, offering flexible hours for bilingual professionals.
Mercor
VerifiedGeneralist - English & Malayalam | $15-$20/hr Remote
This is a remote, part-time contract role where you’ll evaluate AI-generated responses in Malayalam, identifying what works and what needs improvement. Your detailed, English-language analysis will directly contribute to refining the model’s output quality. Ideal for someone who enjoys structured analytical thinking and wants to shape the next generation of conversational AI.
Mercor
VerifiedGeneralist - English & Marathi | $15-$20/hr Remote
We're looking for a bilingual Marathi-English generalist to help refine how AI models understand and respond in Marathi. You'll evaluate AI-generated answers by identifying strengths, weaknesses, and factual errors, then provide clear feedback in English. This contract role is ideal for someone with strong analytical instincts and native Marathi fluency.