Clinical Psychologist AI Reviewer
Listing checked October 6, 2026 · pay as published by AfterQuery
Overview
AfterQuery assembles the expert evaluation data that frontier AI labs use to measure how their models handle mental health conversations. Licensed psychologists join a three week review starting this month, judging model answers to clinical psychology scenarios on clinical reasoning, ethics and risk assessment. Reviewers point out where a response goes wrong and describe what a licensed clinician would do in that spot. A subset of contributors also drafts realistic clinical vignettes with matching reference answers. The work stays remote and async, with hours you pick around your practice and no screen recording or keystroke tracking.
What You'll Do6
- 1Score AI model replies to clinical psychology prompts on reasoning quality, ethical soundness and how well they handle risk
- 2Call out responses that skip suicide risk, safety planning steps or reporting obligations a clinician would flag
- 3Write notes that name the exact gap in a model answer and the clinical principle it violates
- 4Spell out the approach a licensed practitioner would take in place of the model's suggested response
- 5Build realistic clinical vignettes paired with reference answers when assigned to that track
- 6Keep every written justification detailed enough for another psychologist to follow the logic
Requirements9
- 1PhD or PsyD in psychology from a US institution
- 2Active, unencumbered US psychology license
- 3Current clinical practice within the United States
- 4Background in clinical, counseling, health or neuropsychology work
- 5Ability to document clinical reasoning in writing that another psychologist can trace
- 6Written English strong enough for detailed clinical notes
- 7Preferred: hands-on work with risk assessment, safety planning or crisis response
- 8Preferred: past writing of clinical documentation, supervision notes or teaching content
- 9Preferred: genuine interest in how AI systems handle mental health exchanges
Who Should Apply
The strongest fit is a doctoral-level psychologist with an active US license who sees patients now and can translate clinical judgment into written reviews. Candidates from clinical, counseling, health or neuropsychology backgrounds all work here, and no minimum years of practice applies. Prior crisis or risk assessment work gives you an edge, since much of the review turns on how models handle safety situations. Applications get turned down when the license details are missing, expired or tied to another country, or when the candidate holds a master's-level credential instead of a PhD or PsyD. Reviewers who write vague feedback, such as calling an answer wrong without naming the missed clinical step, tend to score low on fit.
Salary Insight
The listing sets pay at $90.00/hr and sends it each week through Stripe. That rate sits near the top of what expert review and clinical documentation work pays, and it matches the doctoral-level licensure and active practice this project expects. You track your own hours as an independent contractor.
Pay and demand for Mental Health & Counseling roles
AggregatedTypical pay
$88/hour
This role
$90/hr
Most Mental Health & Counseling roles pay $70–$100 per hour. This role's pay falls inside that range.
Based on 9 similar roles that publish pay
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 9
- Listed in last 30 days
- 7
- Remote
- 100%
Hiring most right now: AfterQuery (4) · micro1 (3) · Mercor (2)
Most requested skills · share of roles
- risk assessment44%
- crisis intervention44%
- safety planning33%
- clinical documentation33%
Figures from Mental Health & Counseling roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$90/hr
Required Skills
Application Tip
Send your resume alongside your psychologist license details, including license number, issuing state and active status, since the listing names the license as the credential reviewers check first. In the resume, quantify any risk assessment, safety planning or crisis work you have done and point to samples of clinical writing such as supervision notes. The application takes about five minutes and every submission gets read and answered.
See NearSkill jobs more often in your search
Application & verification flow
1Instant rubric match
Your resume is scanned against this role’s requirements to check qualification fit.
2Screened before the employer sees it
Only profiles that clear screening are passed on.
3Outcome by email
We notify you at the address on your resume once the screening is reviewed.
Similar open positions
Explore active roles that match your skills and interests.
AfterQuery
VerifiedPsychiatrist Expert Clinical Review
AfterQuery builds expert evaluation data that frontier AI labs use to assess and improve how models handle mental health. The company seeks licensed psychiatrists for a three-week review project that starts this month. You will examine AI model answers to psychiatric cases and judge whether the diagnosis, treatment plan, medication considerations and risk assessment hold up. Some contributors also draft realistic clinical vignettes and reference responses. Work takes place remote and async, so you set your own hours around a clinical schedule, with pay at $125 per hour through Stripe.
AfterQuery
VerifiedLicensed Psychologist - Remote AI Safety Contract
AfterQuery builds evaluation and training data that frontier AI labs use to measure model performance in professional work. The company hires licensed psychologists as independent contractors to create and grade the clinical and behavioral scenarios behind those tests. You will write clinical vignettes that cover risk assessment and ethical dilemmas, then score model responses for clinical accuracy, ethics and safety handling. The role is remote and async, with at least 10 hours each week and no caseload. Your work shapes how frontier models respond to mental health situations.
Mercor
VerifiedClinical Mental Health Expert AI Conversation Review
Mercor needs qualified clinical mental health professionals for a short remote task tied to an AI research project. You will compare pairs of simulated therapy or counselling conversations and decide which one feels more like a real clinical exchange. The review centers on realism and authenticity. The task takes up to 30 minutes, and you complete it through an online interface.
AfterQuery
VerifiedLicensed Counselor - AI Safety Evaluation
AfterQuery produces the expert evaluation data that frontier AI labs draw on to test how models handle professional work. This contract role places licensed counselors inside that pipeline, writing the scenarios, reference answers, and grading decisions that shape how a model reasons about mental health situations. The work leans on risk assessment, treatment planning, and clinical ethics instead of a client caseload. Hours stay remote and self-scheduled, with a floor of 10 per week and no ceiling. Each specialty area gets matched to live project work, often within a week of onboarding.
Mercor
VerifiedBehavioral Health Expert - AI Safety Evaluation
Join a leading AI lab's extended workforce to review how models handle sensitive but non-crisis conversations about relationships, family tension, emotional wellbeing, personal beliefs, and hard life choices. Your behavioral health background will shape rubrics, reference replies, and test scenarios that show whether a model stays neutral, avoids taking sides, and respects the limits of its role. The work sits at the intersection of AI safety and model evaluation, with written rationale as a core output. Cincinnatus LLC employs this W-2 part-time role, which starts at 20 hours per week and can grow to 40. You will partner with researchers and fellow experts to keep standards calibrated.
AfterQuery
VerifiedPsychology Research Expert
AfterQuery prepares evaluation data that frontier AI labs use to gauge how models reason in professional fields. For this social science project, the company seeks psychology researchers to write and score behavioral science scenarios that test model judgment. You will design realistic studies, document the methods behind each answer, and review model responses for construct validity and replication awareness. The contract runs remote and async, with a minimum of 10 hours per week and no ceiling on hours. Every psychology specialty is welcome.