Everyday AI Agent Tester
Listing checked October 10, 2026 · pay as published by Micro1
Overview
This is a chance to put two AI agents through their paces on real errands like paying bills, booking trips, and handling groceries. You will use your own phone and personal AI accounts to run each scenario, approve or halt steps, and record the screen. After each run, you score the agent on completion, quality, control issues, satisfaction, and time. The project kicks off Monday, October 12, and onboarding happens today, Saturday, or Sunday so you are ready to start. Expect about 1.5 hours per task, including evidence and scoring.
What You'll Do8
- 1Carry out everyday tasks with two AI agents, covering bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms.
- 2Decide when to approve or stop the agent at critical points during each run.
- 3Record your phone screen for every attempt without missing any steps.
- 4Score each run on completion, quality, control issues, satisfaction, and time.
- 5Write clear feedback about how the agent performed and what the experience was like.
- 6Follow the testing protocol and document each action as you go.
- 7Use your personal AI accounts (Free, Go, or Plus; not Pro) to interact with the agents.
- 8Submit evidence and scores within the expected timeframe for each task.
Requirements9
- 1Must be based in the United States.
- 2Bachelor's degree required.
- 32-3 years of work experience, ideally in engineering, business management, or office/operations.
- 4Active daily use of AI tools in your personal life.
- 5Strong attention to detail and ability to follow instructions exactly.
- 6Clear written communication skills for documenting and scoring.
- 7Access to a smartphone that can screen record.
- 8An active personal AI account (Free, Go, or Plus; not Pro).
- 9No coding or AI background needed, but generalists and domain experts are welcome.
Who Should Apply
The ideal candidate is US-based with a bachelor's degree and 2-3 years of experience in engineering, business management, or operations. You already use AI in your daily routine and can follow a testing protocol with care, recording your screen and scoring each run. This role suits generalists who are curious about how AI agents handle real errands, as well as domain experts who want to bring their perspective. It is less suitable for people who dislike repetitive documentation, cannot commit to roughly 1.5 hours per task, or do not have a personal AI account that meets the Free, Go, or Plus requirement. Candidates often get rejected when they skip the screening questions or fail to show they use AI regularly. Another common reason for low fit is not having a phone that can screen record or not being able to onboard before the Monday start.
Salary Insight
The pay range is $25 to $45 per hour. No other compensation details are provided in the source.
Pay and demand for AI Training roles
AggregatedTypical pay
$70/hour
This role
$25–$45/hr
Most AI Training roles pay $40–$95 per hour. This role's pay sits below that range.
Based on 975 similar roles that publish pay · 300 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,110
- Listed in last 30 days
- 379
- Remote
- 98%
Hiring most right now: micro1 (294) · SME Careers (253) · Mercor (137)
Most requested skills · share of roles
- ai training14%
- ai evaluation13%
- llm evaluation12%
- data annotation10%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$25–45/hr
Required Skills
Application Tip
In your application, mention your personal AI account type (Free, Go, or Plus) and confirm you have a smartphone that can screen record. Also, describe one or two everyday tasks you have used AI for, such as paying a bill or booking a trip, to show you meet the daily AI use requirement.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Micro1
VerifiedAI Agent Evaluator
This contract role puts you on the front line of testing how well AI agents handle real errands. You will run two agents side by side on your own phone, using your personal accounts, and judge how they perform on tasks like paying bills, booking trips, and buying groceries. Each run takes about 1.5 hours, including evidence and scoring. The project kicks off Monday, October 12, with onboarding happening today through Sunday so you are ready to start. You will need an active personal AI account (Free, Go, or Plus, not Pro) and a smartphone that can record your screen.
Micro1
VerifiedGmail & Google Calendar AI Evaluator (US Remote)
micro1 is hiring Gmail and Google Calendar AI Assistant Evaluators for a customer-driven project that improves how AI handles everyday digital tasks. You will draw on your own habits with email, scheduling, bookings, and coordination to test and grade assistant responses. The work is fully remote, open to US-based contractors, and pays $15 to $30 per hour. Your feedback will directly shape how AI models manage the tasks people delegate most often.
Micro1
VerifiedAI Product Evaluator
micro1 is hiring AI Product Evaluators to support a customer's high-impact AI initiative. You will assess AI models and AI agents against detailed scenarios, then document what you find in structured reports. The work is operational and often runs against strict timeframes and usage limit resets. Your input helps shape how these systems learn, reason, and respond.
Turing
VerifiedAI Evaluation Specialist – Small Business & Operations
This project puts small business owners in the evaluator seat for AI chatbot output. You build realistic prompts from daily operational scenarios, then compare how multiple chatbots handle them over up to five turns. Judging comes down to clarity, usefulness, and accuracy, with written feedback required. The scope also includes marketing content, customer interactions, market research, and financial planning support. The engagement is project-based and runs for 16 weeks with a fixed set of evaluation tasks.
Turing
VerifiedBusiness Analyst (Computer Use Agent)
Turing seeks a Business Analyst to evaluate a Computer-Using Agent (CUA) project, judging how well AI systems interpret instructions, reason through problems, and carry out tasks in digital environments. Your days center on inspecting AI-generated responses and actions, verifying claims through online research, and scoring accuracy, task completion, and reasoning quality. You will craft scenarios and questions that test large language models, then deliver annotations, ratings, and written explanations that help improve them. The work runs as a long-term hourly engagement for 16 weeks, with a possible extension and a start around 15 October.
Turing
VerifiedMobile UI Video Creator - Remote AI Training
Turing runs data collection for frontier AI labs and enterprises that need reliable AI systems. This project needs a mobile UI trainer who can film short first-person walk-and-talk videos showing real places nearby. You will record 1 to 5 minute clips where you speak to an AI assistant, point at objects, and follow a task list. Footage goes toward multimodal data work that teaches models how people move, talk, and describe their surroundings. The contract lasts 3 months and you film in your own area on your own schedule.