MLE Bench – Data Analyst
Listing checked August 25, 2026 · pay as published by Turing
Overview
Turing runs benchmark-driven evaluation projects for frontier AI labs, and this role focuses on data analysis for MLE Bench. You will inspect real-world machine learning outputs, define and validate metrics, and write reproducible Python and SQL analysis scripts. The 3-month contractor engagement requires at least 20 hours per week and a 4-hour daily overlap with PST.
What You'll Do7
- 1Analyze structured and unstructured datasets generated by ML training, inference, and evaluation pipelines to uncover patterns and anomalies.
- 2Define and compute metrics that measure model performance, then validate those metrics for accuracy and relevance.
- 3Investigate data distributions, model outputs, failure modes, and edge cases tied to benchmark tasks.
- 4Write and run Python and SQL code to produce reports and support the evaluation workflow.
- 5Check datasets and experimental results for quality, consistency, and correctness.
- 6Document your analytical methods and create reproducible workflows that others can follow.
- 7Collaborate with ML engineers and researchers to design realistic evaluation scenarios for MLE Bench.
Requirements8
- 1At least 3 years of experience as a data analyst or analytics-focused engineer.
- 2Strong Python skills for data analysis, including writing clean and well-documented code.
- 3Solid experience with SQL and working with relational datasets.
- 4Hands-on experience analyzing ML outputs and evaluation metrics.
- 5A firm grasp of statistics and analytical reasoning.
- 6Ability to work with large, complex datasets and draw reliable conclusions.
- 7Excellent written and spoken English for clear communication.
- 8Comfort with documenting analysis and creating reproducible processes.
Who Should Apply
The ideal candidate has several years of hands-on data analysis experience, deep familiarity with Python and SQL, and a genuine interest in how machine learning models are evaluated. This role is less suitable for analysts who prefer static dashboards over probing model behavior or who lack comfort with statistical reasoning. Candidates often get rejected when they struggle with the live coding interview, especially on SQL queries or Python data manipulation. Another common miss is failing to show a clear work schedule that accommodates the required 4-hour overlap with PST.
Pay and demand for Data Engineering roles
AggregatedTypical pay
$70/hour
This role
Pay not disclosed
Most Data Engineering roles pay $40–$98 per hour.
Based on 1,058 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,220
- Listed in last 30 days
- 462
- Remote
- 98%
Hiring most right now: micro1 (356) · SME Careers (254) · Mercor (146)
Most requested skills · share of roles
- ai training13%
- llm evaluation11%
- ai evaluation11%
- data annotation9%
Figures from Data Engineering roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
Undisclosed by Turing
Comparable roles pay
1,058 roles$40 – $98/ hr
Not this role’s pay. Turing has not published a range.
Confirmed during Turing profile screening.
Required Skills
Application Tip
Before you apply, run through a timed Python and SQL coding exercise that mimics a data analysis task, such as computing a metric from a sample dataset. Be ready to explain how you validate metrics and handle messy data, and mention any past work with ML evaluation in your application.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Turing
VerifiedPython Machine Learning Engineer
Turing pairs frontier AI labs with data, training pipelines, and specialized researchers, and helps enterprises move AI from prototype to production systems that deliver measurable business results. This remote contract role focuses on machine learning solution delivery using Python, with ownership across data pipelines, model design, deployment, and monitoring. The engineer sets technical direction, mentors peers, and keeps ML initiatives aligned with business priorities. Hands-on experience in Kaggle competitions or ML benchmarks is a strong signal for this position.
Turing
VerifiedSWE Bench – Data Engineer/Data Scientist
Turing, a San Francisco-based research accelerator, is hiring experienced data engineers and data scientists for benchmark-driven evaluation of advanced AI systems. The role centers on SWE Bench-style tasks: building and validating data pipelines, processing structured and unstructured datasets, and preparing features for data science workflows. You will write Python code, run local experiments, and verify outputs for correctness and reproducibility. This is a fully remote contractor assignment with required overlap with PST hours.
Turing
VerifiedData Scientist/Analyst
This contract role focuses on improving AI model performance through hands-on Python development and rigorous data analysis. You will build and maintain code for model training, run evaluations, and rank model responses across diverse domains. The work includes creating high-quality datasets for supervised fine-tuning and collaborating with researchers on RLHF efforts. The position is fully remote and requires a minimum of 20 hours per week with 4 hours of overlap with Pacific Time.
Mercor
VerifiedData Analysis Expert - Remote AI Evaluation
Mercor maintains a standing pool for data analysis experts who want to train and evaluate frontier AI models. Research teams bring their hardest data judgment calls here, and your standards help build the rubrics that grade model answers. The pool spans business intelligence, data engineering, statistics, and machine learning, with part-time project work that starts on short notice. A matching project may arrive within a week or take several months, depending on client needs. The listing stays open even when no project is active.
AfterQuery
VerifiedML Research Expert - Benchmark Authoring
AfterQuery seeks Master's and PhD-level ML researchers to design and validate benchmark tasks that measure what frontier models can do across machine learning. The work is remote, asynchronous, and flexible, with 5 to 40 hours a week available. Your domain expertise shapes the tasks, whether you focus on language models, reinforcement learning, robotics, ML systems, or another listed area. The role fits people who write ML code and publish results, not those with annotation or data-labelling backgrounds. Pay is $150 per hour.
Turing
VerifiedSoftware Engineer – AI Code Evaluation & Benchmarking (US candidates only)
This contract role places an experienced software engineer inside an evaluation workflow for frontier AI models. You will review AI-generated code for correctness, efficiency, and maintainability, validate solutions against real engineering tasks, and debug failures across different environments. You will also help build and refine evaluation datasets, benchmarks, and grading rubrics. The assignment runs for one month, requires at least 4 hours per day and 20 hours per week with a 4-hour overlap with PST, and is open only to candidates in the US. Work is fully remote.