Operations Specialist | $20-$45/hr Remote
Overview
This role involves applying domain expertise to train next-generation AI systems by analyzing authentic workplace communications such as Slack messages, email threads, and internal files. The specialist will extract key information, identify decisions and action items, and synthesize complex data into realistic multi-step tasks for evaluating advanced AI agents. The position requires strong communication skills, comfort with ambiguity, and a startup-oriented mindset.
What You'll Do7
- 1Analyze authentic workplace communications (Slack, email, internal files) to extract key information and context
- 2Identify decisions, action items, dependencies, blockers, and unresolved questions within unstructured business conversations
- 3Synthesize complex, multi-source data into realistic, multi-step tasks for evaluating AI agents in a reinforcement learning environment
- 4Develop clear prompts and robust evaluation rubrics rooted in real startup workflows
- 5Distinguish relevant details from irrelevant context while tracing information across multiple channels and timelines
- 6Handle ambiguity and incomplete data with systematic, structured approaches to ensure task realism and accuracy
- 7Maintain confidentiality and uphold data integrity when handling sensitive workplace materials
Requirements7
- 1Expert-level written and verbal communication skills with emphasis on clarity and precision
- 2Ability to interpret and connect fragmented workplace communications across diverse formats
- 3Experience synthesizing and organizing messy, unstructured information into actionable insights
- 4Proven capacity to identify key decisions, action items, and contextual dependencies in fast-paced business environments
- 5Strong generalist skills, ideally with experience in startups or dynamic operational roles
- 6Comfort working with evolving business scenarios, distributed knowledge, and shifting priorities
- 7High attention to detail and commitment to maintaining confidentiality
Who Should Apply
Ideal candidates have expert communication skills, experience in startup operations or similar dynamic roles, and a knack for synthesizing messy information into clear actionable outputs. They thrive in ambiguous environments, are highly detail-oriented, and understand the importance of confidentiality when handling sensitive data. No prior AI experience is required, but a generalist mindset and ability to trace context across diverse channels are essential.
Salary Insight
$20-$45 per hour, based on experience and skill level.
Required Skills
Application Tip
In your cover letter, provide a concrete example of how you synthesized complex, fragmented information from multiple sources (e.g., cross-functional emails or Slack threads) into a clear summary or action plan to demonstrate your ability to handle ambiguity and detail.