AI Agent Tester - Real-World Tasks
Listing checked October 27, 2026 · pay as published by micro1
Key details
- Pay
- $25–45/hr
- Location
- Remote
- Job type
- contract
- Openings
- 50
- Posted
- October 24, 2026
Overview
You will test two AI agents side by side as they handle everyday errands like paying bills, booking trips, and buying groceries. Using your own accounts on your phone, you approve key steps, record each attempt, and score how well the agents perform. The project is already running, and you can start within 24-48 hours of selection. Expect to spend about 1.5 hours per run, including evidence and scoring. This is a contractor role open to US-based candidates.
What You'll Do7
- Run real-life scenarios such as bill payments, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms.
- Approve or halt the agent at critical decision points during each task.
- Screen record every attempt on your smartphone.
- Score each run on completion, quality, control issues, satisfaction, and time.
- Provide clear written feedback on the agent experience.
- Use your own accounts for ChatGPT Plus, Muse, and Dots to conduct tests.
- Make test purchases with a payment card and get reimbursed afterward.
Requirements8
- US-based with a Bachelor's degree.
- 2-3 years of experience, preferably in engineering, business management, or office/operations.
- Already use AI in daily life.
- Detail-oriented and great at following instructions and documenting each step.
- Clear written communication skills.
- Generalists welcome; domain experts preferred.
- No coding or AI background needed.
- Access to an active personal AI assistant account (Plus tier), active Muse and Dots access, a smartphone that can screen record, and a payment card for test purchases.
Who Should Apply
The ideal candidate is US-based with a Bachelor's degree and 2-3 years of experience in engineering, business management, or operations. You already use AI tools daily and have a sharp eye for detail. Generalists and domain experts alike are welcome, and no coding skills are required.
Salary Insight
Pay ranges from $25 to $45 per hour. The exact rate is discussed during the hiring process.
Application tip
In your application, highlight your experience using AI in daily life and your attention to detail. Mention specific examples of following instructions and documenting steps, and note your access to ChatGPT Plus, Muse, and Dots.
Pay and demand for AI Training roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
$25–45/hr
Taken from the listing itself.
Typical pay · estimated
$70/hour
Median of 1,064 similar roles that publish pay · 300 publish only a top rate; those count at the rate they gave
Most AI Training roles pay $40–$95 per hour. This role's pay sits below that range.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,191
- Listed in last 30 days
- 542
- Remote
- 98%
Hiring most right now: micro1 (335) · SME Careers (253) · Mercor (168)
Most requested skills · share of roles
- ai evaluation14%
- ai training13%
- llm evaluation12%
- data annotation10%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to micro1’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
micro1AI Agent Evaluator
micro1AI Agent Power User
micro1Gmail & Google Calendar AI Evaluator (US Remote)
micro1AI Product Evaluator
TuringAI Evaluation Specialist – Small Business & Operations
micro1