Data Science Expert | $120-$170/hr Remote
Overview
Mercor is collaborating with a prominent AI research lab to recruit seasoned data scientists for a project that assesses AI systems' ability to handle real-world data science tasks. Your role isn't to produce work but to define excellence—crafting detailed scoring rubrics and evaluating sample outputs with clear, written rationales. This is a high-impact, remote contract position paying $120–$170 per hour.
What You'll Do5
- 1Develop precise, task-specific scoring criteria for data science outputs such as analyses, models, dashboards, experiment results, and written recommendations.
- 2Evaluate both AI-generated and human-produced work samples against those criteria, providing thorough written justifications for each score.
- 3Maintain consistent, evidence-based judgment to ensure scores are reproducible and defensible across evaluations.
- 4Act on structured feedback from senior reviewers, iterating and refining your scoring approach quickly.
- 5Collaborate with a team of evaluators to calibrate scoring standards and ensure alignment.
Requirements5
- 1At least 5 years of professional data science experience in an industry setting.
- 2Background in business, product, or growth data science at top-tier technology companies.
- 3Deep expertise in experiment design, A/B testing, metric definition, and SQL/Python analysis, plus the ability to communicate findings to executive stakeholders.
- 4Exceptional written communication skills with attention to detail and consistency.
- 5Comfort with having your judgment reviewed and calibrated against peers; prior involvement in AI training, evaluation, or human-data projects is a strong plus.
Who Should Apply
This role is ideal for a seasoned data scientist who thrives on setting high standards and systematically evaluating work. You should be detail-oriented, articulate in writing, and comfortable with your judgments being scrutinized and aligned with a team. If you have experience in AI evaluation or training datasets, that’s a bonus.
Salary Insight
The position pays $120–$170 per hour on a contract basis, with exact rate depending on experience and calibration.
Application Tip
In your application, highlight a specific instance where you designed a scoring rubric or evaluation framework—whether for A/B test results, model performance, or a data science deliverable. Demonstrating your ability to define and apply rigorous criteria will set you apart.
Similar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedData analysis / quantitative readouts Evaluator | $80-$120/hr Remote
We're looking for seasoned data analysts to evaluate AI-generated reports, spreadsheets, and slide decks. You'll use your quantitative expertise to assess accuracy, rigor, and presentation quality, then deliver structured feedback. This is a remote, hourly role with a competitive rate.
Micro1
VerifiedData Scientist | $50-$95/hr Remote
As a Data Scientist with micro1, you'll play a hands-on role in refining the next generation of AI systems. Your core responsibility is to apply your analytical expertise — from statistics and data modeling to visualization — to help models learn and reason more effectively. No prior AI experience is required; your domain knowledge and data craft are what truly matter.
Micro1
VerifiedData Scientist | Remote
This contractor role is perfect for data scientists who want to directly improve how AI models learn and reason. You'll apply your analytical skills to collect, clean, and model real-world data, helping train next-generation systems without needing prior AI experience—your domain expertise is the key ingredient. Work remotely and contribute to cutting-edge projects that turn raw data into smarter, more capable AI.
Mercor
VerifiedDesign Expert | $80-$150/hr Remote
This role offers experienced designers a chance to influence how leading AI systems approach creative work. Instead of producing designs, you’ll set the bar for quality by crafting scoring criteria and evaluating both AI-generated and human-created samples. Your detailed written feedback will directly sharpen the AI’s design judgment.
Micro1
VerifiedData Analyst (Excel) | $40-$55/hr Remote
In this remote role, you’ll put your Excel expertise to work in a unique way—helping train cutting-edge AI systems. Your day-to-day analysis, cleaning, and reporting will directly influence how models learn and reason. No prior AI background is needed; your data analysis skills are what count.
Mercor
VerifiedManagement Consulting Expert | $150-$220/hr Remote
This unique role lets you put your management consulting expertise to work in the AI space — not by producing client deliverables, but by shaping how AI systems are evaluated on real consulting tasks. You'll design rigorous grading criteria for work like market analyses and strategy decks, then score AI and human samples with detailed justifications. If you've spent 5+ years at a top-tier firm and have a sharp eye for what excellence looks like, this is your chance to influence AI development directly.