Senior Backend Engineer (Python/FastAPI) – AI Evaluation (US-based)

What You'll Do7

• Curate high-quality code samples and craft precise solutions to train and evaluate LLMs.
• Review and improve AI-generated code for efficiency, scalability, and reliability.
• Build automated verification tools and agents in Python to detect error patterns and check code quality.
• Hypothesize steps across the software engineering cycle (prototyping, architecture, API design, implementation, launch, experiments, monitoring, maintenance) and evaluate model performance on them.
• Design verification mechanisms that automatically validate solutions to software engineering tasks.
• Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry benchmarks.
• Produce clear, structured rationales for evaluation decisions.

Requirements6

• 3+ years of software engineering experience.
• Strong Python expertise, including frameworks, tooling, and best practices for production software.
• Experience building full-stack applications and deploying scalable software with modern languages and tools.
• Deep understanding of software architecture, design, development, debugging, and code quality assessment.
• Excellent written and verbal communication skills for clear evaluation rationales.
• Candidates must be based in the United States.

Preferred Qualifications2

• Experience at frontier AI companies such as OpenAI, NVIDIA, Databricks, Palantir, or Snowflake.
• Degree from a strong CS program (e.g., University of Washington, UIUC, UT Austin, University of Michigan, Purdue) — exceptional experience takes precedence.

Who Should Apply

The role suits engineers with 3+ years of backend experience and deep Python skills who have worked on AI systems or production software at scale. Candidates based in the US who enjoy evaluating and improving code quality will find a strong fit.