Senior Backend Engineer (Python/FastAPI) – AI Evaluation (US-based)

What You'll Do7

• Curate code examples, write solutions, and correct code to support AI model training, mainly in Python with secondary work in JavaScript, C/C++, Java, Rust, and Go.
• Assess AI-generated code for efficiency, scalability, and reliability, then refine it to meet production standards.
• Design and build agents and automated verification tools in Python that check code quality and flag error patterns.
• Form hypotheses about stages of the software engineering cycle (prototyping, architecture design, API design, implementation, launch, experiments, monitoring, maintenance) and test model capabilities against them.
• Create verification mechanisms that automatically validate solutions to software engineering tasks.
• Work with cross-functional teams to improve AI-driven coding solutions against industry performance benchmarks.
• Provide clear, structured rationales for evaluation decisions in both written and spoken communication.

Requirements6

• 3+ years of software engineering experience, including building production systems.
• Strong Python expertise, with deep knowledge of frameworks, tooling, and best practices for production-grade software.
• Experience building full-stack applications and deploying scalable software using modern languages and tools.
• Solid grasp of software architecture, design, development, debugging, and code quality assessment.
• Excellent oral and written communication skills for explaining evaluation reasoning.
• Must be based in the United States.

Preferred Qualifications3

• Experience at high-scale engineering organizations such as Google, Microsoft, Apple, Amazon, or Meta.
• Degree from a top computer science program like Stanford, MIT, Carnegie Mellon, UC Berkeley, or Georgia Tech.
• Familiarity with JavaScript (including ReactJS), C/C++, Java, Rust, or Go.

Who Should Apply

The role suits engineers with at least three years of production software experience, particularly those who have built scalable systems at major tech firms. Candidates with deep Python skills and a strong grasp of architecture and debugging will thrive in this AI evaluation work. Exceptional skill and experience matter more than pedigree, though graduates from top CS programs are especially welcome.