
Context Elicitation & Conversation Evaluation Specialist
Listing checked October 27, 2026 · details as published by Turing
Key details
- Pay
- Not published
- Location
- RemoteLatam, Southeastern Europe, Asia, Africa
- Job type
- full-time
- Posted
- October 27, 2026
Overview
Turing runs a short research project that examines how well AI models gather context before offering recommendations. You will review real conversations between participants and AI systems, judging whether the model asked enough questions and where it missed chances to clarify. Qualitative coding and structured case review sit at the center of the work, and you will document conclusions using shared evaluation guidelines. The engagement lasts about three weeks, starts around 1 October, and pays per task with an average handling time near 75 minutes.
What You'll Do6
- Examine transcripts of AI conversations drawn from everyday interpersonal and decision-making situations.
- Flag information the AI failed to request and propose follow-up questions that would close the gap.
- Judge whether extra details would have shifted the recommendation the model gave.
- Separate information that is load-bearing for a recommendation from details that are merely descriptive.
- Apply the project's evaluation framework to keep assessments consistent across reviewers.
- Record findings in structured write-ups and discuss edge cases with the research team.
Requirements6
- 3-5 years of direct practice in social work, counseling, psychology, qualitative research, HCI, communication, mediation, coaching, or a related advisory field.
- A graduate degree plus an active credential such as MSW/LCSW/LICSW/LMSW, LMFT/LPC/LCPC, or a PhD/PsyD in clinical, counseling, social, or industrial-organizational psychology.
- For research backgrounds: an MA/PhD in HCI, communication, anthropology, sociology, or qualitative research, with hands-on work in interviews, thematic analysis, or qualitative coding.
- For advisory backgrounds: a recognized professional qualification or proven subject-matter expertise in coaching, mediation, student services, or organizational consulting.
- Documented experience drawing out context when clients start with incomplete information.
- Comfort reviewing client interactions, consultations, or coaching sessions to spot missed chances to clarify.
Who Should Apply
Licensed social workers, counselors, psychologists, and qualitative or HCI researchers with 3-5 years of practice fit this role. Mediators, coaches, and student-services advisers who routinely gather context and give recommendations also qualify. You must live in Latam, Southeastern Europe, Asia, or Africa.
Salary Insight
Pay-per-task engagement; no rates or salary figures are stated.
Pay and demand for AI Training roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
Pay not disclosed
The employer did not publish pay for this role.
Typical pay · estimated
$70/hour
Median of 1,274 similar roles that publish pay · 301 publish only a top rate; those count at the rate they gave
Most AI Training roles pay $40–$95 per hour.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,485
- Listed in last 30 days
- 761
- Remote
- 98%
Hiring most right now: micro1 (398) · SME Careers (253) · Mercor (215)
Most requested skills · share of roles
- ai evaluation14%
- llm evaluation12%
- data annotation12%
- ai training11%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to Turing’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
MercorBehavioral Health Expert - AI Safety Evaluation
TuringAI Benchmark & Red-Teaming Specialist
MercorManagement Consultant - Remote AI Evaluation
MercorRemote Survey Research Expert for AI Evaluation
TuringBusiness Analyst (Computer Use Agent)
AfterQuery
