Psychiatrist Expert Clinical Review
Listing checked October 6, 2026 · pay as published by AfterQuery
Overview
AfterQuery builds expert evaluation data that frontier AI labs use to assess and improve how models handle mental health. The company seeks licensed psychiatrists for a three-week review project that starts this month. You will examine AI model answers to psychiatric cases and judge whether the diagnosis, treatment plan, medication considerations and risk assessment hold up. Some contributors also draft realistic clinical vignettes and reference responses. Work takes place remote and async, so you set your own hours around a clinical schedule, with pay at $125 per hour through Stripe.
What You'll Do6
- 1Evaluate AI model replies to psychiatric cases for diagnostic accuracy, treatment reasoning, medication considerations and risk management.
- 2Identify where a model response goes wrong and explain what a practicing psychiatrist would do instead.
- 3Document clinical reasoning in clear written English so another psychiatrist can follow your judgment.
- 4For selected contributors, compose realistic psychiatric vignettes and write reference answers that set the expected standard.
- 5Apply expertise in psychopharmacology, risk assessment or emergency and inpatient psychiatry when reviewing complex cases.
- 6Review how models handle mental health conversations, including safety and escalation decisions.
Requirements7
- 1Hold an MD or DO from a US medical institution.
- 2Maintain an active US medical license, either full or training license.
- 3Practice or train in psychiatry within the US, in any subspecialty.
- 4Write clinical reasoning in clear English that another psychiatrist can follow.
- 5Preferred experience includes work with psychopharmacology, risk assessment, emergency psychiatry or inpatient psychiatry.
- 6Preferred background includes teaching residents or writing clinical or board-review content.
- 7Preferred interest includes how AI systems handle mental health conversations.
Who Should Apply
Attending psychiatrists and residents or fellows in US psychiatry programs fit this project, and all subspecialties are welcome. The strongest applicants hold a US MD or DO, keep an active US license, and can explain diagnostic and risk decisions in writing for peers. Candidates who lack a current US license or who have never practiced or trained in US psychiatry will not pass credential review. A common reason applications score low is vague clinical writing that does not show how a licensed psychiatrist would correct a model response. Another is leaving license details out of the application, since credentials are requested during the five-minute apply step.
Salary Insight
The listing states $125 per hour, paid through Stripe each week. For a remote, async independent contractor project, that rate reflects the specialized clinical judgment required and the credential burden of an active US medical license. Because the project runs three weeks, treat the pay as project-based income rather than a salaried package.
Location
Compensation
$125/hr
Required Skills
Application Tip
Submit your resume with active US medical license details ready, because the application asks for credentials and takes about five minutes. In your materials, name your psychiatry role, subspecialty and training stage, then give one short example of clinical reasoning you wrote for another psychiatrist. If you have psychopharmacology, risk assessment, emergency or inpatient experience, or resident teaching and board-review writing, call that out. Clear diagnostic reasoning and written English matter more than a long CV here.
See NearSkill jobs more often in your search
Application & verification flow
1Instant rubric match
Your resume is scanned against this role’s requirements to check qualification fit.
2Screened before the employer sees it
Only profiles that clear screening are passed on.
3Outcome by email
We notify you at the address on your resume once the screening is reviewed.
Similar open positions
Explore active roles that match your skills and interests.
AfterQuery
VerifiedClinical Psychologist AI Reviewer
AfterQuery assembles the expert evaluation data that frontier AI labs use to measure how their models handle mental health conversations. Licensed psychologists join a three week review starting this month, judging model answers to clinical psychology scenarios on clinical reasoning, ethics and risk assessment. Reviewers point out where a response goes wrong and describe what a licensed clinician would do in that spot. A subset of contributors also drafts realistic clinical vignettes with matching reference answers. The work stays remote and async, with hours you pick around your practice and no screen recording or keystroke tracking.
AfterQuery
VerifiedMedical Expert - AI Clinical Reasoning Contract
AfterQuery brings physicians, nurses, PAs and other clinicians into a remote contract role on its Medicine team. You will write tough clinical prompts and score AI answers for accuracy and sound medical reasoning. The work touches clinical diagnosis, treatment planning, pharmacology and patient safety. Plan for 40 hours each week at $50 to $200 per hour, with an assessment before anyone reviews your application.
Mercor
VerifiedMedical Expert - Remote AI Evaluation & Review
Mercor recruits health professionals who can supply the medical judgment that top AI research teams cannot generate on their own. The medicine pool is an open call, not a single opening, so it remains live while projects start on short notice. When a project launches, you may write a case from your practice with the presentation, workup, constraints, and reference answer that sets the standard for grading a model's attempt. You may also review model output for clinical reasoning, checking whether the differential follows a sensible order, whether a guideline applies to the patient, and whether the care plan is safe to carry out. Mercor sets rates per project, and most work is remote and part-time.
Handshake AI
VerifiedPhysician AI Medical Content Evaluator
Handshake AI needs licensed physicians to shape how future AI models handle complex medical questions. You will write challenging clinical questions, supply evidence-based reference answers, and judge model outputs for medical accuracy, reasoning, and safety. The role runs as a remote, asynchronous fellowship, so you set your own hours. Most contributors log 5 to 20 hours each week, with no minimum requirement. You join as a 1099 independent contractor and receive payment through Stripe for each completed task.
AfterQuery
VerifiedMedical MD Expert - Remote Contract Role
AfterQuery, a YC-backed startup, needs practicing or recently graduated physicians to build and grade the clinical material that trains its medical AI. You will write case studies and decision scenarios drawn from real practice, then score how model outputs hold up against clinical guidelines and standard care. The work sits at the meeting point of medical education and digital health, with roughly 20 hours a week on a remote, asynchronous schedule. Cases you design directly shape whether these systems give sound advice when clinicians and patients rely on them.
Mercor
VerifiedMedical Expert (M.D./D.O.) - Remote Part-Time
Mercor keeps this listing open for physicians who want to shape how frontier AI models handle clinical reasoning. The work fits around your practice: you might write a clinical vignette from a real case, complete with presentation, labs, and imaging, then supply the attending-level answer used as a reference. Other projects ask you to grade model output on diagnostic reasoning, checking whether a differential follows a sensible order, whether the model anchors on a first impression, and whether the proposed workup matches guidelines. You also flag recommendations that read well in a textbook but fail the patient in front of you because of comorbidities, contraindications, or access limits. Projects start on short notice, so Mercor draws from this pool when client demand matches your specialty.