AWS Serverless & Infrastructure-as-Code Task Auditor
Listing checked September 1, 2026 · pay as published by Mercor
Overview
This contract role puts you inside the evaluation loop for training data used by a frontier AI lab. You will audit AWS serverless and infrastructure-as-code tasks for architectural correctness, cross-service integration, and IaC fidelity. Expect to work through Lambda, Step Functions, DynamoDB, EventBridge, and related services, then deliver written feedback guided by a set rubric. The position is fully remote at an hourly rate.
What You'll Do7
- 1Review multi-service AWS serverless designs for correctness and architectural soundness.
- 2Check that infrastructure-as-code definitions accurately match the intended cloud environment.
- 3Verify that integrations between services like Lambda, SQS, and EventBridge work as expected.
- 4Assess IAM permission boundaries and failure and retry semantics in each task.
- 5Write concise, rubric-based feedback that tells the task author exactly what to fix.
- 6Flag cases where local emulation behavior would differ from real AWS behavior.
- 7Score tasks consistently to support the AI model training pipeline.
Requirements7
- 1At least 3 years of hands-on experience building multi-service AWS serverless applications with Lambda, API Gateway, DynamoDB/Streams, S3, EventBridge, SNS/SQS, and Step Functions.
- 2Strong working knowledge of infrastructure-as-code using AWS CDK, CloudFormation, or SAM.
- 3Ability to evaluate event-driven architecture correctness, IAM boundaries, and retry/failure semantics.
- 4Familiarity with LocalStack or similar tools for local testing versus actual AWS behavior.
- 5Preferred: AWS Solutions Architect or Developer certification.
- 6Preferred: Experience with observability and cost management for serverless workloads.
- 7Preferred: Prior code review or task grading experience.
Who Should Apply
A candidate who excels here has deep hands-on experience with event-driven AWS systems and can spot subtle misconfigurations fast. They feel comfortable writing clear, actionable feedback that helps someone else improve their code. This role is less suitable for developers whose serverless experience is limited to single functions or tutorials. Rejections often happen when a candidate cannot explain how IAM boundaries or retry policies affect real-world behavior, or when their written feedback is vague.
Salary Insight
The pay is $70 to $90 per hour. This rate matches senior-level serverless architects who can both critique infrastructure and communicate fixes clearly.
Pay and demand for AI Training roles
AggregatedTypical pay
$70/hour
This role
$70–$90/hr
Most AI Training roles pay $40–$95 per hour. This role's pay falls inside that range.
Based on 996 similar roles that publish pay · 300 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,145
- Listed in last 30 days
- 405
- Remote
- 97%
Hiring most right now: micro1 (309) · SME Careers (253) · Mercor (139)
Most requested skills · share of roles
- ai training14%
- ai evaluation12%
- llm evaluation11%
- data annotation10%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$70–90/hr
Required Skills
Application Tip
In your application, describe a specific serverless bug you found and fixed, and include a sample of written feedback you gave to another developer.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
SME Careers
VerifiedAWS Specialist Contractor for Cloud Task Design and Recording
Join SME Careers as a remote contract AWS Specialist focused on shaping practical cloud exercises for AI model training. You will craft realistic AWS tasks spanning IAM, S3, EC2, Lambda, and CloudWatch, and document them clearly in SuperAnnotate for review. You will also record your screen as you execute the tasks, ensuring steps are reproducible and safe for AI-training data. This role supports SME Careers, a fast-growing AI Data Services company and a subsidiary of SuperAnnotate, delivering training data for major AI labs.
Meridial
VerifiedTechnical Task Auditor
Independent contractors in this role audit tasks that train and evaluate AI systems. You pick one specialty from eight areas, such as GPU kernels, AWS Trainium, NKI, CVE and application security, machine learning, AI-assisted developer workflows, AWS Serverless and Infrastructure as Code, Kubernetes, or SWE-Bench. Your job is to judge whether each task is accurate, realistic, solvable, and reproducible, and whether reliable tests and evaluation criteria support it. When something falls short, you write feedback that other experts can act on. Not every specialty is required, and you complete a technical assessment for your chosen area during selection.
Mercor
VerifiedSWE-Bench Task Auditor
This role puts you inside the evaluation pipeline for a frontier AI lab's models. You will audit SWE-Bench style repository tasks, checking reference patches, test harnesses, and Docker isolation for correctness and reproducibility. Your written, rubric-based feedback shapes which tasks get used for training and evaluation. The work is remote and hourly, paying $70-$90 per hour, and it demands strong open-source credentials plus fluency in Python and at least one of Java, Go, TypeScript, or C++.
Mercor
VerifiedCloud / DevOps Engineer (Infra & IaC)
A leading AI lab building foundational Large Language Models needs a Cloud/DevOps Engineer to improve the quality of its training and inference infrastructure. The role centers on hands-on work with Kubernetes, AWS services, and Infrastructure-as-Code. You will design tasks, evaluate solutions, and write technical feedback that helps models reason about cluster failures, AWS integration, and CI/CD pipelines. The position is full-time (40 hours/week), remote within the United States, and structured as a W-2 contract through Cincinnatus LLC.
Mercor
VerifiedAI Developer Trace Task Auditor
Every coding trace you receive comes from AI-assisted developer sessions. You will assess each trace for code correctness, workflow soundness, and reasoning, then write clear feedback that follows a defined rubric. A frontier AI lab uses these evaluations to train and refine its models, so your judgments shape model behavior. The role is remote within the United States and pays $70 to $90 per hour.
Mercor
VerifiedKubernetes Task Auditor
At Mercor, you will assess Kubernetes tasks that train a frontier AI lab's models. The work involves grading cluster-operation scenarios, checking manifest correctness, and judging whether failure-mode troubleshooting is realistic and complete. Each review ends with rubric-based written feedback that the AI team uses to improve model performance. This remote hourly role is open to candidates across the United States.