Gmail & Google Calendar AI Evaluator (US Remote)
Listing checked September 26, 2026 · pay as published by Micro1
Overview
micro1 is hiring Gmail and Google Calendar AI Assistant Evaluators for a customer-driven project that improves how AI handles everyday digital tasks. You will draw on your own habits with email, scheduling, bookings, and coordination to test and grade assistant responses. The work is fully remote, open to US-based contractors, and pays $15 to $30 per hour. Your feedback will directly shape how AI models manage the tasks people delegate most often.
What You'll Do7
- 1Carry out realistic digital chores such as sending emails, setting up meetings, booking reservations, and coordinating with others while using AI assistant tools under repeatable conditions.
- 2Give an AI assistant plain instructions for real-world tasks, then inspect its output for accuracy and completeness.
- 3Apply detailed grading rubrics to score, rank, and annotate assistant replies, producing structured feedback that helps improve model performance.
- 4Build test scenarios around email threads, calendar invites, online bookings, and group coordination, making sure edge cases and varied situations are covered.
- 5Record findings and submit evaluation data through AI training platforms in line with project standards and deadlines.
- 6Work with project trainers and other contributors to clear up ambiguities, sharpen guidelines, and keep evaluations consistent across the team.
- 7Take part in ongoing quality reviews and adjust your approach based on feedback to maintain strict evaluation standards.
Requirements8
- 1You live in the United States, own an iPhone with iMessage, and have a Facebook or Instagram account.
- 2You use Gmail and Google Calendar every day to run your life: sending messages, accepting invites, scheduling, and moving plans around.
- 3You have regular experience coordinating with people over email or text, whether setting up meetups, following up on threads, or confirming shared plans and payments.
- 4You are comfortable booking things online on your own, such as restaurants, appointments, travel, or deliveries.
- 5You have used AI tools for practical tasks and can give an assistant instructions and check its work.
- 6You show exceptional attention to detail and accuracy when reviewing AI-generated output.
- 7You communicate well in writing for clear reporting and timely updates on progress and challenges.
- 8You manage your time and stay organized while working independently on a remote project.
Who Should Apply
This role fits someone who already lives inside Gmail and Google Calendar, books appointments and travel online without hesitation, and has used AI assistants for real tasks. You should be based in the US, have an iPhone with iMessage, and hold a Facebook or Instagram account. Prior experience with AI evaluation, data labeling, user testing, or prompt writing will strengthen your application. The role is less suitable for people who rarely coordinate over email or text, who have not used AI tools for practical work, or who need close supervision to stay on schedule. Candidates often get rejected when they cannot show daily, hands-on Gmail and Calendar use, or when their written feedback lacks the precision needed for grading AI output.
Salary Insight
The pay range is $15 to $30 per hour. The final rate depends on your background and the project scope, and it will be discussed during the hiring process.
Pay and demand for AI Training roles
AggregatedTypical pay
$70/hour
This role
$15–$30/hr
Most AI Training roles pay $38–$95 per hour. This role's pay sits below that range.
Based on 951 similar roles that publish pay · 300 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,080
- Listed in last 30 days
- 363
- Remote
- 98%
Hiring most right now: micro1 (284) · SME Careers (253) · Handshake AI (132)
Most requested skills · share of roles
- ai training15%
- ai evaluation13%
- llm evaluation12%
- data annotation10%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$15–30/hr
Required Skills
Application Tip
In your application, describe two or three specific times you used Gmail or Google Calendar to coordinate a real plan, such as scheduling a group trip or rescheduling a meeting, and mention any AI tools you used to help. If you have prior AI evaluation, data labeling, or prompt writing experience, name the platform and the type of output you reviewed.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Micro1
VerifiedEnglish Teacher
micro1 is hiring English teachers to work on a customer project that improves AI assistants by evaluating real-world tasks. You will use your classroom experience, including parent communication and scheduling, to train and assess AI models. The work involves Google Classroom, Gmail, and Google Calendar tasks, plus reviewing AI-generated writing for grammar, tone, and clarity. This is a remote contractor role open to candidates in the United States.
Micro1
VerifiedAI Agent Evaluator
This contract role puts you on the front line of testing how well AI agents handle real errands. You will run two agents side by side on your own phone, using your personal accounts, and judge how they perform on tasks like paying bills, booking trips, and buying groceries. Each run takes about 1.5 hours, including evidence and scoring. The project kicks off Monday, October 12, with onboarding happening today through Sunday so you are ready to start. You will need an active personal AI account (Free, Go, or Plus, not Pro) and a smartphone that can record your screen.
Micro1
VerifiedAI Evaluation Specialist
As an AI Evaluation Specialist, you'll help train next-generation AI systems by designing and executing hands-on evaluation tasks. Your insights will directly shape how models learn, reason, and perform on practical computer-based workflows. This is a fully remote contract role where meticulous observation and clear documentation are key.
Turing
VerifiedAI Quality Analyst - English
This role puts you inside Gemini's personalization quality loop. You will design multi-turn prompts that draw on your own Google activity, including Gmail, Search, and YouTube history, then judge whether the model's responses are grounded, integrated, and helpful. The work involves side-by-side SxS evaluations, writing rationales that reference specific turns, and verifying debug info to confirm the model used your data correctly. This 3-month contractor engagement requires at least 4 hours per day with a 4-hour overlap with PST.
Micro1
VerifiedAI Product Evaluator
micro1 is hiring AI Product Evaluators to support a customer's high-impact AI initiative. You will assess AI models and AI agents against detailed scenarios, then document what you find in structured reports. The work is operational and often runs against strict timeframes and usage limit resets. Your input helps shape how these systems learn, reason, and respond.
Micro1
VerifiedEveryday AI Agent Tester
This is a chance to put two AI agents through their paces on real errands like paying bills, booking trips, and handling groceries. You will use your own phone and personal AI accounts to run each scenario, approve or halt steps, and record the screen. After each run, you score the agent on completion, quality, control issues, satisfaction, and time. The project kicks off Monday, October 12, and onboarding happens today, Saturday, or Sunday so you are ready to start. Expect about 1.5 hours per task, including evidence and scoring.