Senior Python Engineer – LLM Evaluation (US-based)

What You'll Do6

• Create and curate code examples, build solutions, and fix code in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS).
• Assess and improve AI-generated code with attention to systems-level correctness, performance, and reliability.
• Work with cross-functional teams to enhance AI-driven coding solutions against industry benchmarks.
• Develop agents that verify the quality of systems-level and infrastructure code and detect error patterns.
• Form hypotheses about stages of the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and test model capabilities on them.
• Design automated verification mechanisms to check solutions for software engineering tasks.

Requirements6

• 3+ years of software engineering experience.
• Strong expertise in systems programming, infrastructure, or backend development using languages such as Python, C/C++, Rust, and Go.
• Experience building and deploying scalable, production-grade software with modern languages and tools.
• Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
• Excellent oral and written communication skills for clear, structured evaluation rationales.
• Must be based in the United States.

Preferred Qualifications2

• Experience at high-growth companies like Stripe, Airbnb, Cloudflare, Datadog, or Coinbase.
• Graduation from top computer science programs such as Stanford, MIT, Carnegie Mellon, UC Berkeley, or Georgia Tech.

Who Should Apply

Candidates with at least 3 years of software engineering experience, strong systems programming skills in Python, C/C++, Rust, or Go, and a track record of building scalable production software. The role suits engineers who enjoy code review, debugging, and designing verification mechanisms, and who can communicate evaluation rationales clearly.