Video Evaluation Generalist | $15-$20/hr Remote
Overview
Mercor partners with a leading AI lab on a video research project, and you'll play a hands-on role shaping its quality. Your main task is to watch two short clips side by side and judge them through a structured rubric. Each comparison captures details like prompt adherence, motion quality, visual artifacts, and physical plausibility. The position is short-term, remote, and allows substantial scheduling flexibility, with a minimum of 20 hours per week expected for about 1.5 weeks. You'll also occasionally write short justifications for your score choices, so clear, precise language matters just as much as sharp observation.
What You'll Do5
- 1Inspect paired video clips simultaneously and measure each one against the provided rubric criteria.
- 2Assign numeric scores to each clip across dimensions including prompt adherence, motion quality, visual artifacts, and physical plausibility.
- 3Decide which clip performs better overall and submit your preference.
- 4Craft brief written explanations for your scoring decisions when the task requests one.
- 5Keep your judgment consistent throughout the session, applying the same scoring standard across many batches to preserve reliability.
Requirements5
- 1Possess a Bachelor's degree or currently pursue one from an accredited institution.
- 2Demonstrate strong writing skills that allow you to explain judgment calls in a few clear sentences.
- 3Show solid critical thinking and light attention to subtle visual differences.
- 4Work autonomously without constant supervision and hit weekly deadlines.
- 5Preferred but not required: two or more years in teaching or research roles.
Who Should Apply
This role suits someone with a sharp eye for visual quality and a structured approach to evaluation. You likely come from an academic or research background, feel comfortable writing about what you observe, and can keep your scoring steady during repetitive tasks. If you prefer open-ended creative projects or need a long-term employer, this short engagement will frustrate you. Candidates who fail to follow the rubric exactly, deliver vague or one-liner justifications, or show uneven scoring across batches often get passed over or score low on fit.
Salary Insight
Pay is set at $15 to $20 per hour, depending on your background and performance during the interview. That rate aligns with what most remote annotation and video evaluation roles offer, and it reflects the generalist nature of the work. This is not a niche expert position; it rewards consistency and careful writing more than specialized training.
Location
Required Skills
Application Tip
During the 15-minute AI-led interview, describe a specific time you caught a subtle visual or logical flaw in a video or document. Could be from research, teaching, or even personal projects. Mention how you would explain that flaw in writing. This signals the exact rubric mindset they need.
See NearSkill jobs more often in your search
How your application is processed
1Application received
Your resume and details are logged the moment you apply.
2ATS + eligibility screening
We check your profile against the role’s skills, seniority, and requirements.
3Employer sees qualified profiles only
Only candidates who clear screening move forward.
Similar open positions
Explore active roles that match your skills and interests.
Micro1
VerifiedVideo Editor
This role is your chance to put your video editing and visual storytelling expertise to work in a cutting-edge field: training next-generation AI systems. You'll review, evaluate, and refine AI-generated animations and educational content, helping models learn to produce better visual narratives. No prior AI experience is required—just a strong creative foundation and a passion for detail.
Micro1
VerifiedVideo Editing Expert
We're looking for a skilled video editing expert to help train the next generation of AI systems. In this contract role, you'll apply your deep knowledge of editing workflows, storytelling, and technical production to evaluate and refine content that teaches AI models how to think and create. No AI experience required—your hands-on expertise is what matters most.
Turing
VerifiedImage/Video Annotator
Annotators support large multimodal AI systems by analyzing video and image annotation tasks, recording people, objects, environments, relationships, emotions, and storytelling flow from short clips and stills. You will describe how scenes change over time and note subtle visual cues like mood, lighting, and spatial relationships. The structured data you produce helps train AI models to perceive and reason about scenes, motion, and context similar to human understanding. Work is remote and based on a contract engagement with a 20-hour weekly commitment.
Mercor
VerifiedVisual Quality Expert (Film, VFX & Animation)
Bring your VFX, animation, or photography eye to a leading AI lab's GenAI team. You will judge high-resolution video and stills at the pixel-level, catching compression artifacts, noise, aliasing, and grain inconsistencies that most viewers miss. This part-time remote role places you as an extended team member through Cincinnatus LLC, with working hours in the PST to EST window. You will help shape evaluation standards that guide how the AI models learn quality.
Micro1
VerifiedAI Evaluation Specialist
As an AI Evaluation Specialist, you'll help train next-generation AI systems by designing and executing hands-on evaluation tasks. Your insights will directly shape how models learn, reason, and perform on practical computer-based workflows. This is a fully remote contract role where meticulous observation and clear documentation are key.
Micro1
VerifiedVideo Data Annotator for Robotics Footage
A remote contractor role focused on labeling robotics video data to help train AI systems. You’ll follow project guidelines to annotate footage, score quality, and flag actions, objects, or events with precision. Collaboration with the micro1 team ensures consistent standards and clear feedback on guidelines and scoring. This position relies on strong domain knowledge rather than prior AI experience, and you’ll contribute to real-world datasets used to improve model performance. Key work rests on delivering accurate annotations within project timelines and maintaining quality checks, in a remote setup.