Data Scientist for AI Model Evaluation and Quality Assurance
Listing checked September 12, 2026 · pay as published by Micro1
Overview
micro1 is hiring data scientists to work with a leading AI lab on a contract basis. Your job is to bring quantitative rigor to how AI models handle statistics, machine learning, and experimentation. You will review model outputs, spot methodological flaws, and build expert-level prompts and datasets. This is a remote role for someone with a strong analytical background and clear technical writing skills.
What You'll Do7
- 1Assess AI model responses to data science, statistics, ML, and quantitative problems.
- 2Write expert-level prompts, datasets, and reference solutions that test model reasoning.
- 3Flag flawed methodology, statistical errors, and weak quantitative arguments in model outputs.
- 4Deliver structured feedback that helps improve model capability over time.
- 5Apply Python, Pandas, and data modeling skills to create realistic evaluation scenarios.
- 6Design experiments and statistical tests to check whether model answers hold up.
- 7Document your findings in a way that technical and non-technical stakeholders can follow.
Requirements7
- 1At least one year of experience at a top tech, finance, or research company, with some of that time in the past 7 years.
- 2Undergraduate degree from a top-ranked university.
- 3Based in an English-speaking country.
- 4Strong written communication of technical and statistical concepts.
- 5Hands-on experience with Python, machine learning, and statistics.
- 6Familiarity with data analysis, experimentation, and data modeling.
- 7Ability to spot errors in quantitative reasoning and explain them clearly.
Who Should Apply
This role fits data scientists with a rigorous quantitative background who enjoy evaluating and critiquing analytical work. You should have at least a year at a top company and a degree from a strong university, plus the ability to write about statistics and ML in plain English. Candidates who lack experience with formal experimentation or who struggle to explain technical flaws in writing will find this role difficult. A common reason applicants get rejected is not meeting the top-company or top-university bar. Another is providing vague feedback instead of specific, structured critiques.
Salary Insight
The rate for this contract is $245 to $280 per hour. That figure is stated in the source, so no further negotiation details are provided.
Pay and demand for Quality Assurance & Testing roles
AggregatedTypical pay
$72/hour
This role
$245–$280/hr
Most Quality Assurance & Testing roles pay $40–$98 per hour. This role's pay sits above that range.
Based on 1,077 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,241
- Listed in last 30 days
- 472
- Remote
- 98%
Hiring most right now: micro1 (363) · SME Careers (254) · Mercor (152)
Most requested skills · share of roles
- ai training13%
- ai evaluation11%
- llm evaluation11%
- data annotation9%
Figures from Quality Assurance & Testing roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$245–280/hr
Required Skills
Application Tip
In your application, highlight specific projects where you used Python, Pandas, or statistical testing to catch errors or improve a model. Quantify your impact, such as reducing false positives by a certain percentage, and mention your top-company experience with dates to show it falls within the past 7 years.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Micro1
VerifiedJunior Data Scientist
micro1 is hiring a Junior Data Scientist to work with a top AI lab, focusing on how AI models handle statistics, machine learning, experimentation, and quantitative reasoning. You will evaluate model outputs, craft expert prompts and datasets, and flag methodological flaws. This is a remote contractor role with a pay range of $150 to $200 per hour. The position suits someone with at least one year of experience at a leading tech, finance, or research company, gained partly within the last three years, and who is based in an English-speaking country.
Turing
VerifiedData Scientist/Analyst
This contract role focuses on improving AI model performance through hands-on Python development and rigorous data analysis. You will build and maintain code for model training, run evaluations, and rank model responses across diverse domains. The work includes creating high-quality datasets for supervised fine-tuning and collaborating with researchers on RLHF efforts. The position is fully remote and requires a minimum of 20 hours per week with 4 hours of overlap with Pacific Time.
Mercor
VerifiedData Analysis Expert - Remote AI Evaluation
Mercor maintains a standing pool for data analysis experts who want to train and evaluate frontier AI models. Research teams bring their hardest data judgment calls here, and your standards help build the rubrics that grade model answers. The pool spans business intelligence, data engineering, statistics, and machine learning, with part-time project work that starts on short notice. A matching project may arrive within a week or take several months, depending on client needs. The listing stays open even when no project is active.
Micro1
VerifiedApplied Scientist
micro1 seeks Applied Scientists to support a customer's data-driven project, with a focus on advanced analytics and experimentation. You will help train next-generation AI systems by providing high-quality, real-world input that shapes how models learn and reason. The work centers on Python, machine learning, statistics, and experimentation. No prior AI experience is needed; your domain knowledge and clear communication are what matter.
SME Careers
VerifiedPython Data Scientist for AI Reasoning Review
Work remotely as a contract Data Scientist who reviews AI-generated analytical reasoning, code, and model outputs, and crafts precise reference solutions for data problems. You will assess prompts for accuracy and clarity, then write step-by-step explanations that demonstrate correct methods. Rate and compare AI responses on correctness and reasoning quality to guide improvements in machine learning workflows. This remote, hourly role supports projects in data science and analytics for a fast-growing AI data services company.
Handshake AI
VerifiedTechnical AI Evaluation Contributor (Remote US)
Handshake AI hires experienced software engineers, data scientists, and quants for part-time contract work that supports AI research. You will create expert-level technical problems and judge AI-generated answers for accuracy, feasibility, and alignment with real system design, modeling, or trading work. The project runs on an ongoing basis, so you can add it alongside a current role. No set schedule or minimum hour requirement applies.