AI Rater Guidelines Writer (Linguist / Instructional Designer) | $45-$65/hr Remote
Overview
This is a chance to work with a top-tier AI research lab as a key contributor to the development of advanced large language models. You'll transform ambiguous program requirements into precise, consistent guidelines for human raters, ensuring high-quality training data across domains like finance, legal, sports, and more. This part-time remote role (W-2 through Cincinnatus LLC) offers a competitive hourly rate and the opportunity to directly shape the next generation of generative AI.
What You'll Do5
- 1Collaborate with research and program teams to bridge the gap between vague program needs and clear, rater-ready instructions across diverse subject-matter areas.
- 2Develop rating rubrics and guidelines that are unambiguous, internally consistent, and easy for raters to apply, including in unusual edge cases.
- 3Review draft guidelines for ambiguity, contradictions, or coverage gaps, and refine them until raters can apply them without needing to escalate.
- 4Translate domain-specific specifications from fields such as finance, retail, insurance, legal, and sports into precise, discipline-appropriate rater instructions.
- 5Work alongside other subject matter experts and program leads to ensure uniformity and accuracy across multiple guideline sets.
Requirements5
- 1At least 3 years of professional experience in linguistics, instructional design, technical writing, or a closely related field, with direct experience writing or refining guidelines for human raters in a GenAI or RLHF context.
- 2Demonstrated ability to work across multiple subject-matter domains (e.g., finance, retail, legal, sports) and convert domain-specific nuance into clear, unambiguous instructions.
- 3A strong track record of resolving ambiguity and contradiction in written specifications, with concrete before-and-after examples to share.
- 4Excellent written communication skills and the ability to explain complex or nuanced guidance clearly and precisely.
- 5Reliable availability for at least 35 hours per week during weekday business hours.
Who Should Apply
This role is ideal for a linguist or instructional designer who excels at turning messy, high-level requirements into structured, repeatable guidelines. You enjoy working across multiple domains and have a sharp eye for ambiguity. If you have experience in AI training data quality and can work independently in a remote environment while collaborating with research teams, you'll thrive here.
Salary Insight
The role pays $45–$65 per hour (W-2 employment through Cincinnatus LLC). Benefits may be available as part of the employment package.
Application Tip
Prepare a brief portfolio or example of a guideline or rubric you've written that successfully removed ambiguity. Highlight a specific before-and-after transformation to demonstrate your ability to clarify complex requirements.
Similar open positions
Explore active roles that match your skills and interests.
Micro1
VerifiedAI Evaluation Analyst | $20-$30/hr Remote
As an AI Evaluation Analyst at micro1, you'll help train advanced language models by creating high-quality evaluation data and multi-turn conversations. This remote contract role is ideal for someone with strong analytical and writing skills who wants to directly influence how AI systems reason and interact. No previous AI experience is required—your domain expertise and attention to detail are what matter.
Mercor
VerifiedFinance Program Coordinator — AI Training Data Operations | $40-$60/hr Remote
We're looking for a skilled Finance Program Coordinator to join a leading AI lab's GenAI team and help shape the next generation of large language models. In this remote, part-time role, you'll bring your finance expertise and organizational rigor to coordinate domain-specific rater teams, ensuring high-quality training data for cutting-edge AI systems. This is a W-2 contract position through Cincinnatus LLC, offering a competitive hourly rate of $40–$60/hr.
Micro1
VerifiedAI Evaluation Specialist | $20-$35/hr Remote
As an AI Evaluation Specialist, you'll help train next-generation AI systems by designing and executing hands-on evaluation tasks. Your insights will directly shape how models learn, reason, and perform on practical computer-based workflows. This is a fully remote contract role where meticulous observation and clear documentation are key.
Micro1
VerifiedLLM Red-Teamer | $40-$65/hr Remote
micro1 is looking for sharp critical thinkers to help push the limits of frontier language models. In this role, you'll design tricky, adversarial multi-turn conversations and evaluate how well AI systems handle them. Your unique domain knowledge matters more than prior AI experience — we want people who can think like a hacker and write with precision.
Micro1
VerifiedEnglish Speaking Generalist | $20-$30/hr Remote
Join a remote contract role at micro1, where you’ll help train next-generation AI systems by evaluating and comparing responses from models like ChatGPT and Claude. As an English Speaking Generalist, you’ll create diverse prompts, record your screen and voice, and provide detailed verbal feedback—all while using your domain expertise, not prior AI experience.
Mercor
VerifiedMachine Learning & NLP Expert | $80-$110/hr Remote
Join a top-tier AI lab's generative AI team as a part-time remote Machine Learning and NLP Expert. You'll craft complex, real-world tasks to test and improve frontier models, author reference solutions, and analyze model performance. This role requires hands-on Python proficiency and deep expertise in modern ML and NLP methods, offering flexible remote work at approximately 20 hours per week.