Data Analyst for AI Evaluation in Cloud Data Workflows
Listing checked September 4, 2026 · pay as published by micro1
Overview
A remote contractor role focused on evaluating AI assistants within real-world analytical workflows that rely on cloud data warehouses. You’ll verify AI outputs against source data using SQL, manage seeded datasets in Snowflake, and help calibrate evaluation processes for consistency. The work supports training next‑generation AI systems, and your domain expertise matters even without prior AI experience. You will interact with secure access controls and maintain clear documentation of findings, configurations, and results. Snowflake and SQL are central to daily tasks, along with QA of analytics outputs.
What You'll Do7
- 1Execute structured evaluation tasks that mimic routine analytics, including anomaly checks, KPI reporting, and data refreshes, using AI-powered tools connected to a cloud data warehouse.
- 2Write and run your own SQL queries to verify AI figures against source data and assess joins, filters, and time window logic for accuracy.
- 3Manage seeded datasets in Snowflake, resetting and maintaining them to ensure reliable test scenarios and consistent answers.
- 4Oversee warehouse roles, permissions, and access controls to create repeatable and secure evaluation environments.
- 5Document connectivity and authentication setups across several analytics platforms and SaaS tools, ensuring traceable configurations.
- 6Investigate unusual or undocumented AI behavior encountered during workflow runs and report findings clearly.
- 7Collaborate with peers in calibration sessions to align scoring and maintain rigor in evaluating AI outputs.
Requirements4
- 1At least 3 years as a data analyst or analytics engineer with strong SQL abilities and hands-on Snowflake experience (warehouses, access control, query history).
- 2Proven skill in auditing metrics against raw data and spotting subtle errors in aggregation or logic.
- 3Experience using connectors to Claude and ChatGPT for analytics workflows.
- 4Familiarity with business and finance analytics, KPI definitions, and leadership-facing reporting practices.
Who Should Apply
The ideal candidate is a data professional with deep SQL and Snowflake know‑how who can independently verify AI-generated analytics against source data. This role suits someone who has worked with KPI reporting and understands access control, data governance, and securing analytics environments. It’s less suitable for those without solid Snowflake experience or those who haven’t audited metrics against raw datasets. Common fit gaps include limited SQL proficiency, lack of experience with Snowflake security features, or minimal exposure to KPI reporting for leadership audiences.
Salary Insight
$50 - $60/hr. Pay is discussed later in the process.
Pay and demand for AI Training roles
AggregatedTypical pay
$70/hour
This role
$50–$60/hr
Most AI Training roles pay $43–$98 per hour. This role's pay falls inside that range.
Based on 1,109 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,264
- Listed in last 30 days
- 682
- Remote
- 97%
Hiring most right now: micro1 (376) · SME Careers (254) · Mercor (167)
Most requested skills · share of roles
- ai evaluation13%
- ai training12%
- llm evaluation11%
- data annotation9%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$50–60/hr
Required Skills
Application Tip
Highlight your Snowflake and SQL credentials and include a concrete example of auditing a KPI against raw data, plus any experience with AI connectors for analytics.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
SME Careers
VerifiedSQL Engineer Remote Contract for AI Data Review
Work remotely as an hourly contractor to review AI-generated SQL queries, database designs, and data-processing logic. Provide high-quality reference solutions and clear explanations for complex data problems. Evaluate submissions for accuracy and prompt adherence, and pinpoint issues in query structure or indexing. Capture findings in concise, step-by-step solutions and compare multiple AI responses based on correctness and reasoning quality.
SME Careers
VerifiedSQL Quality Assurance Lead for AI Training Data
This remote contract role acts as a SQL Quality Assurance Lead for AI training data projects, safeguarding accuracy and consistency across SQL and database content. You will review AI-generated SQL queries, database explanations, and schema reasoning, delivering precise, rubric-aligned feedback. You’ll coordinate with remote trainers and QAs, update Discord guidelines, and maintain onboarding material to support calibration and knowledge sharing. This position sits within SME Careers' expert network, offering future contract opportunities even when there isn’t an active project today.
Mercor
VerifiedData Analysis Expert - Remote AI Evaluation
Mercor maintains a standing pool for data analysis experts who want to train and evaluate frontier AI models. Research teams bring their hardest data judgment calls here, and your standards help build the rubrics that grade model answers. The pool spans business intelligence, data engineering, statistics, and machine learning, with part-time project work that starts on short notice. A matching project may arrive within a week or take several months, depending on client needs. The listing stays open even when no project is active.
micro1
VerifiedSenior Data Analyst
This part-time contract role puts you at the center of AI development, where you will assess how well AI handles business data scenarios. You will work with large business data sets, apply quality assurance methods, and flag personally identifiable information (PII) when needed. The position is remote and open to U.S.-based analysts only. Your feedback will directly shape how AI models are trained and evaluated for real-world data work.
micro1
VerifiedAI Evaluation Specialist
As an AI Evaluation Specialist, you'll help train next-generation AI systems by designing and executing hands-on evaluation tasks. Your insights will directly shape how models learn, reason, and perform on practical computer-based workflows. This is a fully remote contract role where meticulous observation and clear documentation are key.
SME Careers
VerifiedData Science Team Lead for AI Training QA Remote
This remote contract role places you as a data science QA Lead guiding quality and consistency across AI training programs. You review AI-generated content and trainer outputs, applying quality standards and providing precise written feedback to uphold guidelines. You assess statistics and model evaluation to detect issues such as data leakage or non-reproducible code. You support onboarding, maintain documentation, and help activate contributors who drift from guidelines.