Overview
The role centers on evaluating and improving Large Language Models (LLMs) using deep knowledge of art history, visual arts, architecture, and design. You will design prompts that range from simple to advanced and assess model answers for factual accuracy, reasoning, completeness, and nuance. Each day involves comparing multiple AI outputs, ranking them, and explaining correct or incorrect responses with reliable references. You will also create benchmark datasets and adversarial test cases to expose hallucinations and logical gaps. The position is an 8-week contractor role requiring 40 hours per week with at least 4 hours of PST overlap.
What You'll Do11
- 1Create advanced prompts that cover fine arts, visual arts, architecture, design, art history, museums, and artists.
- 2Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
- 3Spot hallucinations, logical inconsistencies, outdated information, and edge cases in model outputs.
- 4Develop benchmark datasets and adversarial test cases to challenge model knowledge.
- 5Provide evidence-based feedback with reliable references.
- 6Work with AI researchers to improve model performance.
- 7Keep annotation quality consistent and document decisions.
- 8Write domain-specific prompts at varying difficulty levels.
- 9Compare multiple AI responses and rank them according to quality.
- 10Explain why a response is correct or incorrect using authoritative sources.
- 11Identify ambiguous questions and propose clearer prompt versions.
Requirements8
- 1Master’s degree or higher in any field; degrees in art history, fine arts, visual arts, museum studies, cultural studies, design, humanities, or related disciplines are preferred.
- 2Strong knowledge of major artists, artworks, art movements, styles, periods, techniques, museums, cultural traditions, and developments in visual arts.
- 3At least 3 years of professional experience in art research, academia, museums, galleries, curation, art criticism or journalism, education, publishing, arts and cultural content, or a related field.
- 4Excellent written English, research, and analytical skills.
- 5Strong attention to detail and the ability to assess artistic, historical, and cultural information with accuracy and within the proper context.
- 6Experience with LLMs, generative AI, prompt engineering, or AI evaluation (preferred).
- 7Published research, industry recognition, or teaching experience is a plus.
- 8Ability to work independently and deliver objective, evidence-backed reviews.
Who Should Apply
Candidates with a graduate degree in art history, fine arts, or museum studies and at least 3 years of professional art research experience will thrive in this role. The work demands meticulous evaluation of AI responses, so strong written English and the ability to cite authoritative references are essential. This role is less suitable for people who prefer creating art over analyzing it or who cannot commit to an 8-week contract with a 4-hour PST overlap. Many applicants score low on fit because their domain knowledge is broad but shallow, or because their written explanations do not include specific references from museums, journals, or scholarly sources.
Location
Required Skills
Application Tip
During the assessment, craft prompts that require knowledge of specific art movements and cite authoritative references in your explanations, as the team evaluates factual accuracy and evidence-backed reasoning.
See NearSkill jobs more often in your search
How your application is processed
1Application received
Your resume and details are logged the moment you apply.
2ATS + eligibility screening
We check your profile against the role’s skills, seniority, and requirements.
3Employer sees qualified profiles only
Only candidates who clear screening move forward.
Similar open positions
Explore active roles that match your skills and interests.
Turing
VerifiedDomain Expert- Sports
This role focuses on improving Large Language Models (LLMs) by applying deep sports knowledge and analytical rigor. The expert will craft challenging prompts across global sports, leagues, athletes, tournaments, rules, statistics, and analytics. Each response gets checked for factual accuracy, reasoning quality, completeness, and nuance, with evidence-backed feedback. The work also involves building benchmark datasets and adversarial test cases to expose model gaps. This is a remote contractor assignment lasting 8 weeks with a 40-hour weekly commitment.
Turing
VerifiedDomain Expert- Music
This contractor role focuses on refining large language models through expert-level music knowledge. You will create advanced prompts that span music theory, genres, composers, artists, production, and instruments. Work involves assessing AI outputs for factual accuracy, reasoning quality, and completeness, while documenting shortcomings with evidence. You will also build benchmark datasets and adversarial test cases to expose edge cases. The position requires a 40-hour weekly commitment with at least 4 hours of PST overlap.
Turing
VerifiedDomain Expert- Politics
Turing seeks a Politics Domain Expert to evaluate and improve Large Language Models with a focus on political science, governance, elections, public policy, and international relations. The role involves designing challenging prompts that test factual accuracy, reasoning, completeness, and nuance in AI-generated responses. You will build benchmark datasets and adversarial test cases to expose hallucinations, logical inconsistencies, outdated information, and edge cases. Work happens remotely on a contractor basis for 8 weeks at 40 hours per week with a 4-hour PST overlap.
Turing
VerifiedDomain Expert - TV Show & Movies
Turing is hiring a TV Shows & Movies Domain Expert for an 8-week contractor assignment focused on evaluating and improving large language models. The day-to-day work centers on creating prompts of varying difficulty across entertainment topics, then comparing and ranking AI responses. The expert will judge responses for factual accuracy, reasoning, completeness, and nuance, and will flag hallucinations, outdated information, and edge cases. This remote role is open to US-based candidates who can commit 40 hours per week with 4 hours of daily overlap with PST.
Micro1
VerifiedAi Domain Expert Focused on Domain Knowledge and Evaluation
Remote, part-time contractor role focused on guiding AI systems through real-world input. You’ll review AI outputs for accuracy, craft prompts that test reasoning, and provide precise written feedback to improve model performance. Your domain knowledge matters most, even if you’re not required to have AI prior experience. You’ll join a global, distributed team and help shape how models learn and reason. Bolded areas reflect core competencies like data annotation, prompt engineering, and ethical awareness in AI.
Micro1
VerifiedData Science Domain Expert for AI Evaluation and Prompting
Remote contractor role focusing on AI data science with a domain expert lens. You’ll assess AI outputs, refine prompts, and annotate data to support high-quality model training. The work centers on applying deep domain knowledge to review research-style documents, technical reports, and experiment notes, shaping how models learn and reason. Strong writing, precise attention to detail, and independent research are essential as you contribute to rubric-based evaluations and content quality.