AWS Serverless & Infrastructure-as-Code Task Auditor | $70-$90/hr Remote
Overview
This contract role puts you inside the evaluation loop for training data used by a frontier AI lab. You will audit AWS serverless and infrastructure-as-code tasks for architectural correctness, cross-service integration, and IaC fidelity. Expect to work through Lambda, Step Functions, DynamoDB, EventBridge, and related services, then deliver written feedback guided by a set rubric. The position is fully remote at an hourly rate.
What You'll Do7
- 1Review multi-service AWS serverless designs for correctness and architectural soundness.
- 2Check that infrastructure-as-code definitions accurately match the intended cloud environment.
- 3Verify that integrations between services like Lambda, SQS, and EventBridge work as expected.
- 4Assess IAM permission boundaries and failure and retry semantics in each task.
- 5Write concise, rubric-based feedback that tells the task author exactly what to fix.
- 6Flag cases where local emulation behavior would differ from real AWS behavior.
- 7Score tasks consistently to support the AI model training pipeline.
Requirements7
- 1At least 3 years of hands-on experience building multi-service AWS serverless applications with Lambda, API Gateway, DynamoDB/Streams, S3, EventBridge, SNS/SQS, and Step Functions.
- 2Strong working knowledge of infrastructure-as-code using AWS CDK, CloudFormation, or SAM.
- 3Ability to evaluate event-driven architecture correctness, IAM boundaries, and retry/failure semantics.
- 4Familiarity with LocalStack or similar tools for local testing versus actual AWS behavior.
- 5Preferred: AWS Solutions Architect or Developer certification.
- 6Preferred: Experience with observability and cost management for serverless workloads.
- 7Preferred: Prior code review or task grading experience.
Who Should Apply
A candidate who excels here has deep hands-on experience with event-driven AWS systems and can spot subtle misconfigurations fast. They feel comfortable writing clear, actionable feedback that helps someone else improve their code. This role is less suitable for developers whose serverless experience is limited to single functions or tutorials. Rejections often happen when a candidate cannot explain how IAM boundaries or retry policies affect real-world behavior, or when their written feedback is vague.
Salary Insight
The pay is $70 to $90 per hour. This rate matches senior-level serverless architects who can both critique infrastructure and communicate fixes clearly.
Location
Required Skills
Application Tip
In your application, describe a specific serverless bug you found and fixed, and include a sample of written feedback you gave to another developer.
See NearSkill jobs more often in your search
How your application is processed
1Application received
Your resume and details are logged the moment you apply.
2ATS + eligibility screening
We check your profile against the role’s skills, seniority, and requirements.
3Employer sees qualified profiles only
Only candidates who clear screening move forward.
Similar open positions
Explore active roles that match your skills and interests.
SME Careers
VerifiedAWS Specialist Contractor for Cloud Task Design and Recording
Join SME Careers as a remote contract AWS Specialist focused on shaping practical cloud exercises for AI model training. You will craft realistic AWS tasks spanning IAM, S3, EC2, Lambda, and CloudWatch, and document them clearly in SuperAnnotate for review. You will also record your screen as you execute the tasks, ensuring steps are reproducible and safe for AI-training data. This role supports SME Careers, a fast-growing AI Data Services company and a subsidiary of SuperAnnotate, delivering training data for major AI labs.
Micro1
VerifiedAWS Engineer
This role is all about designing and managing cloud infrastructure on AWS while helping train next-generation AI systems. You'll apply your deep AWS expertise to ensure scalable, reliable, and secure environments — no prior AI experience required, just your domain knowledge. As a remote contractor, you'll work with core services like EC2, S3, RDS, IAM, and VPC, automate with Terraform or CloudFormation, and keep everything running smoothly via CloudWatch and scripting in Bash and Python.
Mercor
VerifiedSWE-Bench Task Auditor
This role puts you inside the evaluation pipeline for a frontier AI lab's models. You will audit SWE-Bench style repository tasks, checking reference patches, test harnesses, and Docker isolation for correctness and reproducibility. Your written, rubric-based feedback shapes which tasks get used for training and evaluation. The work is remote and hourly, paying $70-$90 per hour, and it demands strong open-source credentials plus fluency in Python and at least one of Java, Go, TypeScript, or C++.
Mercor
VerifiedCloud / DevOps Engineer (Infra & IaC)
A leading AI lab building foundational Large Language Models needs a Cloud/DevOps Engineer to improve the quality of its training and inference infrastructure. The role centers on hands-on work with Kubernetes, AWS services, and Infrastructure-as-Code. You will design tasks, evaluate solutions, and write technical feedback that helps models reason about cluster failures, AWS integration, and CI/CD pipelines. The position is full-time (40 hours/week), remote within the United States, and structured as a W-2 contract through Cincinnatus LLC.
Mercor
VerifiedAI Developer Trace Task Auditor
Every coding trace you receive comes from AI-assisted developer sessions. You will assess each trace for code correctness, workflow soundness, and reasoning, then write clear feedback that follows a defined rubric. A frontier AI lab uses these evaluations to train and refine its models, so your judgments shape model behavior. The role is remote within the United States and pays $70 to $90 per hour.
Mercor
VerifiedKubernetes Task Auditor
At Mercor, you will assess Kubernetes tasks that train a frontier AI lab's models. The work involves grading cluster-operation scenarios, checking manifest correctness, and judging whether failure-mode troubleshooting is realistic and complete. Each review ends with rubric-based written feedback that the AI team uses to improve model performance. This remote hourly role is open to candidates across the United States.