Board Game Reasoning Expert (AI Training & Evaluation)
Listing checked August 25, 2026 · pay as published by Turing
Overview
Turing seeks Board Game Reasoning Experts to build and assess tasks that sharpen the reasoning of frontier AI models. The work centers on board games, game mechanics, and complex rule systems, requiring analysis of strategic decision trees and scenario-based puzzles. Experts create, review, and score game-based datasets, checking AI outputs for logical consistency and rule adherence. The role is a fully remote contractor assignment lasting about 2 months, with a commitment of at least 4 hours per day and 20 hours per week, including 4 hours of overlap with PST.
What You'll Do7
- 1Create and review game-based reasoning tasks that test AI decision-making and rule comprehension.
- 2Analyze board game scenarios, including strategic decision trees and rule-based systems, to identify edge cases and logical gaps.
- 3Evaluate AI-generated responses for correctness, consistency, and reasoning quality across strategy-heavy prompts.
- 4Write prompts, rubrics, and evaluation guidelines for board game and strategy-focused tasks.
- 5Flag logical errors, rule violations, and flawed reasoning in AI outputs with clear justifications.
- 6Support the creation of benchmarks and quality assurance processes for AI evaluation projects.
- 7Work with project teams to refine dataset quality and evaluation methods.
Requirements10
- 1Bachelor's degree in Computer Science, Mathematics, Cognitive Science, Game Design, Philosophy, Economics, or a related analytical field.
- 2At least 2 years of professional or semi-professional experience in board game design, playtesting, tabletop game communities, or strategy-focused environments.
- 3Solid command of logic, probabilistic reasoning, game mechanics, and complex rule systems.
- 4Background in game theory, behavioral economics, decision science, or formal logic.
- 5Familiarity with modern board games, trading card games (TCGs), tabletop RPGs, strategy games, or competitive game systems.
- 6Strong analytical and problem-solving skills, plus clear written communication.
- 7Prior experience in data annotation, AI training, prompt engineering, QA, game design, puzzle design, or rules-based system analysis.
- 8Experience building evaluation rubrics, benchmark datasets, or quality assurance frameworks.
- 9Working knowledge of Python, SQL, or data analysis tools.
- 10Hands-on experience with RLHF, model evaluation, synthetic data generation, or LLM benchmarking.
Who Should Apply
Candidates with a strong background in board games, game design, or tabletop communities who can reason about probabilistic scenarios and rule systems will fit naturally. The role suits people who enjoy careful analysis, writing evaluation criteria, and spotting subtle logical errors in AI outputs. The role is less suitable for those who want to design original games or lead creative work, since the focus is on dataset creation and evaluation. Applications tend to score low when they lack concrete examples of rule-system mastery or prior annotation or benchmark experience. Reviewers also reject candidates who cannot commit to the required PST overlap and weekly hours, so confirm availability before applying.
Pay and demand for AI Training roles
AggregatedTypical pay
$70/hour
This role
Pay not disclosed
Most AI Training roles pay $40–$97 per hour.
Based on 1,035 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,182
- Listed in last 30 days
- 438
- Remote
- 98%
Hiring most right now: micro1 (341) · SME Careers (253) · Handshake AI (140)
Most requested skills · share of roles
- ai training14%
- llm evaluation12%
- ai evaluation12%
- data annotation10%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
Undisclosed by Turing
Comparable roles pay
1,035 roles$40 – $97/ hr
Not this role’s pay. Turing has not published a range.
Confirmed during Turing profile screening.
Required Skills
Application Tip
Show off your rule-system depth by naming specific board games or TCGs you have mastered and describe how you would break down their decision trees. Quantify any playtesting or dataset work, such as the number of tasks reviewed or rubrics created, and call out direct experience with LLM evaluation or RLHF in your application.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
SME Careers
VerifiedPython Data Scientist for AI Reasoning Review
Work remotely as a contract Data Scientist who reviews AI-generated analytical reasoning, code, and model outputs, and crafts precise reference solutions for data problems. You will assess prompts for accuracy and clarity, then write step-by-step explanations that demonstrate correct methods. Rate and compare AI responses on correctness and reasoning quality to guide improvements in machine learning workflows. This remote, hourly role supports projects in data science and analytics for a fast-growing AI data services company.
Turing
VerifiedSoftware Engineer – AI Code Evaluation & Benchmarking (US candidates only)
This contract role places an experienced software engineer inside an evaluation workflow for frontier AI models. You will review AI-generated code for correctness, efficiency, and maintainability, validate solutions against real engineering tasks, and debug failures across different environments. You will also help build and refine evaluation datasets, benchmarks, and grading rubrics. The assignment runs for one month, requires at least 4 hours per day and 20 hours per week with a 4-hour overlap with PST, and is open only to candidates in the US. Work is fully remote.
Turing
VerifiedSenior Software Engineer - AI Coding Agent Evaluation
Turing seeks experienced software engineers to assess how well AI coding agents handle real repositories. You will treat the agent like a colleague whose pull requests you review: checking whether it read the task, picked a sound design, and produced working code. The work spans Python, TypeScript/JavaScript, and Go codebases, plus the evaluation rubrics and data pipelines that sharpen model behavior. Researchers rely on your written judgment to turn one-off observations into repeatable quality signals. This is a freelance contract, roughly three months long, with 40 hours per week preferred.
AfterQuery
VerifiedLegal Expert - AI Legal Reasoning Evaluation
AfterQuery recruits legal experts to teach and test how AI models handle legal reasoning. Your work can range from composing hard legal prompts to checking model answers for accuracy, sound logic, and hidden mistakes such as invented citations or rules used in the wrong context. You may also draft reference answers and explanations, or build grading rubrics that separate strong legal analysis from weak output. This contract role runs remote at 40 hours per week, with pay from $50 to $200 per hour.
Micro1
VerifiedAI Evaluation Specialist
As an AI Evaluation Specialist, you'll help train next-generation AI systems by designing and executing hands-on evaluation tasks. Your insights will directly shape how models learn, reason, and perform on practical computer-based workflows. This is a fully remote contract role where meticulous observation and clear documentation are key.
Turing
VerifiedData Scientist/Analyst
This contract role focuses on improving AI model performance through hands-on Python development and rigorous data analysis. You will build and maintain code for model training, run evaluations, and rank model responses across diverse domains. The work includes creating high-quality datasets for supervised fine-tuning and collaborating with researchers on RLHF efforts. The position is fully remote and requires a minimum of 20 hours per week with 4 hours of overlap with Pacific Time.