Domain Expert- Music
Listing checked August 26, 2026 · pay as published by Turing
Overview
This contractor role focuses on refining large language models through expert-level music knowledge. You will create advanced prompts that span music theory, genres, composers, artists, production, and instruments. Work involves assessing AI outputs for factual accuracy, reasoning quality, and completeness, while documenting shortcomings with evidence. You will also build benchmark datasets and adversarial test cases to expose edge cases. The position requires a 40-hour weekly commitment with at least 4 hours of PST overlap.
What You'll Do7
- 1Design complex prompts that draw on music theory, composers, artists, genres, instruments, and production techniques.
- 2Judge AI-generated answers for factual correctness, reasoning depth, completeness, and subtlety in musical topics.
- 3Spot hallucinations, logical errors, stale references, and unusual edge cases in model responses.
- 4Create benchmark datasets and adversarial test cases to probe model weaknesses.
- 5Deliver feedback grounded in authoritative sources and verifiable references.
- 6Work with AI researchers to refine model performance based on your annotations.
- 7Keep annotation standards consistent and document your evaluation process.
Requirements7
- 1Hold a master's degree or higher in any discipline; a music-focused degree such as musicology, ethnomusicology, music theory, music production, or audio engineering is preferred.
- 2Demonstrate deep musical expertise across theory, composition, genres, composers, artists, instruments, music history, notation, production, and modern trends.
- 3Bring at least 3 years of professional work in music education, performance, composition, production, journalism, research, content creation, or audio engineering.
- 4Write clear, accurate English and show solid research and analytical skills.
- 5Evaluate music information with precision, detect factual inconsistencies, and reason across a broad range of musical subjects.
- 6Preferred: hands-on experience with LLMs, generative AI, prompt engineering, or AI evaluation.
- 7Preferred: published research, teaching experience, or industry recognition.
Who Should Apply
The ideal candidate for this contract role holds an advanced degree in music or a related field and has years of hands-on professional experience with music content, whether through performance, production, research, or education. They bring a meticulous eye for factual inaccuracies and can defend their evaluations with strong references. This role is less suitable for early-career professionals without a master's degree or for those without deep knowledge of diverse musical genres and production techniques. Candidates often get rejected when their feedback lacks concrete evidence or when their writing fails to meet the high standard of clarity required. Another common pitfall is not being able to commit to 40 hours per week with the required PST overlap.
Pay and demand for AI Training roles
AggregatedTypical pay
$70/hour
This role
Pay not disclosed
Most AI Training roles pay $40–$98 per hour.
Based on 1,035 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,182
- Listed in last 30 days
- 440
- Remote
- 98%
Hiring most right now: micro1 (342) · SME Careers (253) · Mercor (144)
Most requested skills · share of roles
- ai training14%
- llm evaluation12%
- ai evaluation12%
- data annotation9%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
Undisclosed by Turing
Comparable roles pay
1,035 roles$40 – $98/ hr
Not this role’s pay. Turing has not published a range.
Confirmed during Turing profile screening.
Required Skills
Application Tip
Include a short sample evaluation of an AI-generated music response. Point out a factual or reasoning error and back it with a reliable source. Also mention your experience with prompt design or AI evaluation to show you can craft high-quality test cases.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Handshake AI
VerifiedMusic Professional - AI Music Evaluation
Handshake AI seeks experienced music professionals for a part-time, remote fellowship. The work centers on evaluating AI-generated music and building reference material that helps models grasp styles, traditions, and cultural context. Contributors draw on hands-on skill in instrumental performance, composition, or music production to judge accuracy and relevance. Projects run on an asynchronous schedule, with most participants logging 5 to 20 hours per week during active assignments. No background in AI is needed, and a master's degree or higher is required, with a DMA preferred.
Turing
VerifiedDomain Expert - Art
The role centers on evaluating and improving Large Language Models (LLMs) using deep knowledge of art history, visual arts, architecture, and design. You will design prompts that range from simple to advanced and assess model answers for factual accuracy, reasoning, completeness, and nuance. Each day involves comparing multiple AI outputs, ranking them, and explaining correct or incorrect responses with reliable references. You will also create benchmark datasets and adversarial test cases to expose hallucinations and logical gaps. The position is an 8-week contractor role requiring 40 hours per week with at least 4 hours of PST overlap.
Turing
VerifiedMusic and Audio experts
Turing, based in San Francisco, California, supplies frontier AI labs and global enterprises with high-quality training data and specialized researchers. This project recruits music professionals to evaluate AI-generated audio by naming the instrument family and the specific instrument heard in short clips. The work is fully remote, with flexible hours inside a two-day window, and strong performers may receive additional project work. Candidates begin with a 15-minute qualifying assessment before onboarding, and formal music education plus experience in audio engineering or production is expected.
Turing
VerifiedDomain Expert- Sports
This role focuses on improving Large Language Models (LLMs) by applying deep sports knowledge and analytical rigor. The expert will craft challenging prompts across global sports, leagues, athletes, tournaments, rules, statistics, and analytics. Each response gets checked for factual accuracy, reasoning quality, completeness, and nuance, with evidence-backed feedback. The work also involves building benchmark datasets and adversarial test cases to expose model gaps. This is a remote contractor assignment lasting 8 weeks with a 40-hour weekly commitment.
Turing
VerifiedDomain Expert - TV Show & Movies
Turing is hiring a TV Shows & Movies Domain Expert for an 8-week contractor assignment focused on evaluating and improving large language models. The day-to-day work centers on creating prompts of varying difficulty across entertainment topics, then comparing and ranking AI responses. The expert will judge responses for factual accuracy, reasoning, completeness, and nuance, and will flag hallucinations, outdated information, and edge cases. This remote role is open to US-based candidates who can commit 40 hours per week with 4 hours of daily overlap with PST.
Turing
VerifiedDomain Expert- Politics
Turing seeks a Politics Domain Expert to evaluate and improve Large Language Models with a focus on political science, governance, elections, public policy, and international relations. The role involves designing challenging prompts that test factual accuracy, reasoning, completeness, and nuance in AI-generated responses. You will build benchmark datasets and adversarial test cases to expose hallucinations, logical inconsistencies, outdated information, and edge cases. Work happens remotely on a contractor basis for 8 weeks at 40 hours per week with a 4-hour PST overlap.