Quality Analyst - AI Training (US)

What You'll Do8

• Read paired chatbot responses side by side and decide which one answers the prompt better.
• Score each response on accuracy, relevance, completeness, clarity and conformance to the evaluation guide.
• Catch subtle mistakes, contradictions and gaps in information that a surface reading would miss.
• Write structured feedback and a final assessment for every comparison you complete.
• Apply the review guidelines the same way across all tasks so scores stay consistent.
• Record findings in the project tooling and share them with the quality team.
• Raise ambiguous or complex cases to the right contact instead of guessing.
• Keep pace with project targets for quality, output volume and turnaround.

Requirements9

• 3 or more years in quality assurance, data annotation, content evaluation, testing or a closely related role.
• Strong analytical and critical-thinking ability, backed by solid problem-solving.
• Clear written and verbal communication, since your assessments are read by other reviewers.
• Close attention to detail and the discipline to follow detailed evaluation guidelines.
• Comfort working without direct supervision and juggling several tasks at once.
• Familiarity with AI tools, chatbots and online work platforms.
• Based in the United States.
• Available 8 hours a day, five days a week, including weekends when the project needs it.
• Two weekdays off, with at least four hours of overlap with Pacific Time.

Preferred Qualifications3

• Prior chatbot evaluation work
• LLM testing experience
• Background on data-quality projects

Who Should Apply

Quality reviewers with 3+ years in annotation, content evaluation or testing who can spot inconsistencies in AI answers and explain them in writing. US-based analysts ready for a 16-week remote project with Pacific Time overlap should apply.

Salary Insight