Science Research Expert - AI Evaluation

What You'll Do7

• Write original research problems from your field, complete with the system, data, assumptions, and the reference answer used to grade a model's attempt.
• Assess model-written analysis for method fit, statistical support, and whether conclusions follow from evidence.
• Identify outputs that seem coherent but fail peer review because of study design, sample limits, or measurement constraints.
• Create or refine grading criteria that turn your scientific standards into a repeatable rubric.
• Explain your reasoning in writing so project leads and model teams can follow the calls you made.
• Flag unclear task instructions or missing context instead of guessing at what a client wants.
• Review model interpretations across disciplines such as biology, physics, economics, or political science.

Requirements7

• Graduate degree in a life, physical, or social science.
• Hands-on research experience where you designed studies and interpreted data yourself.
• Ability to explain methodological and statistical choices in clear written English.
• Comfort working with ambiguous prompts and incomplete specifications.
• Willingness to raise questions when instructions lack detail.
• Research background close enough in time that you can defend the decisions you made.
• Domain depth in at least one listed area, such as chemistry, astronomy, psychology, or policy research.

Who Should Apply

Researchers who hold a graduate degree in a science field and have designed studies, run analyses, and defended their interpretations in writing fit this pool best. The work suits people who can read a model's answer, spot weak statistical support, and explain why a conclusion does not follow. Candidates without graduate-level research training or without direct data interpretation experience tend to score low, even when they know a subject well from coursework. Applications also lose fit when candidates cannot point to specific studies they designed or when their writing leaves the reasoning behind a judgment unclear. The role is less suitable for people who want a fixed schedule, a defined project from day one, or tasks with complete instructions at every step.

Salary Insight