Arts and Design AI Evaluation Expert

What You'll Do6

• Turn delivered creative work into a brief that names the audience, limits, and quality bar, plus a reference answer for grading model attempts.
• Score model-generated design, writing, and imagery on craft: check whether hierarchy holds, type and colour choices look deliberate, and prose length earns its place.
• Point out outputs that look competent on the surface but would fail to ship because of brand rules, accessibility, licensing, or medium constraints.
• Explain your reasoning in writing so researchers can see the standard behind each judgment.
• Flag unclear instructions instead of guessing at the intended task.
• Bring professional judgment from your discipline to evaluation rubrics and model comparisons.

Requirements5

• Professional experience in design, writing, or a creative production field.
• Ability to write clear explanations of why a piece works or fails.
• Comfort with open-ended tasks and changing project details.
• Willingness to ask for clarification when a brief leaves gaps.
• A portfolio that shows finished work and the thinking behind it.

Who Should Apply

The best fit is a working designer, writer, or production professional who can point to a portfolio and explain craft choices in plain language. You should enjoy judging work against a stated standard, not just making new work. This pool suits people less if they want a fixed schedule or a single named client from day one. Candidates often score low when their written reasoning stays vague, such as saying a layout feels off without naming hierarchy, type, or accessibility issues. Another common miss is refusing to flag ambiguous instructions, which makes grading unreliable.

Salary Insight