Linguistics Expert - AI Model Evaluation

What You'll Do5

• Build linguistic scenarios that test analytical reasoning across syntactic ambiguity, semantic entailment, and phonological pattern.
• Write reference analyses that set out the reasoning behind each judgment, with supporting data, the broader pattern, and any exceptions.
• Grade model output for analytical accuracy and for honest treatment of the data.
• Flag responses that sound plausible but misread the sentence or mislabel the linguistic phenomenon.
• Contribute items from your subfield, whether morphology, sociolinguistics, psycholinguistics, or another area.

Requirements8

• Advanced degree in linguistics or a related field.
• At least two years of research, teaching, or applied linguistics work.
• Deep knowledge of a subfield such as syntax, semantics, phonology, or sociolinguistics.
• Clear written English for documenting linguistic analysis and defending judgments.
• Availability of at least 10 hours per week.
• Preferred: a PhD with peer reviewed publications.
• Preferred: experience with computational linguistics or corpus methods.
• Preferred: fieldwork or documentation of understudied languages.

Who Should Apply

Linguists with an advanced degree and two or more years of research, teaching, or applied work fit this contract. Depth in syntax, semantics, phonology, or another subfield and the ability to reason from data to generalization matter here. You need clear written English and at least 10 hours per week.

Salary Insight