Senior Python Engineer – LLM Evaluation (US-based)
Listing checked November 8, 2026 · details as published by Turing
Key details
- Pay
- Not published
- Location
- RemoteUnited States
- Job type
- contract
- Posted
- November 7, 2026
Overview
Turing seeks a senior software engineer to join its evaluation team, focusing on improving large language models through curated datasets and code assessment. You will work with Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS) to create, correct, and refine code examples that train and benchmark AI systems. The role emphasizes systems-level code, performance-critical applications, and infrastructure, requiring close collaboration with researchers and cross-functional teams. Expect to design verification mechanisms, hypothesize on software engineering stages, and evaluate model capabilities in areas like prototyping, API design, and production implementation. This is a flexible contractor position with a minimum commitment of 10 hours per week, up to 40 hours, for an initial one-month term with possible extension.
What You'll Do8
- Curate code examples, build solutions, and correct code in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS) for AI model training.
- Assess and improve AI-generated code with a focus on systems-level correctness, performance, and reliability.
- Partner with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks.
- Build agents that verify the quality of systems-level and infrastructure code and detect error patterns.
- Formulate hypotheses about stages of the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and test model capabilities on them.
- Design automated verification mechanisms for solutions to software engineering tasks.
- Provide precise evaluation rationales through clear oral and written communication.
- Refine datasets for benchmarking and advancing large language models in collaboration with researchers.
Requirements6
- Several years of software engineering experience (3 years or more).
- Strong expertise in systems programming, infrastructure, or backend development using languages such as Python, C/C++, Rust, and Go.
- Experience building and deploying scalable, production-grade software with modern languages and tools.
- Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
- Excellent oral and written communication skills for structured evaluation rationales.
- Must be based in the United States.
Who Should Apply
Candidates with 3+ years of software engineering experience and strong systems programming skills in Python, C/C++, Rust, or Go will thrive in this role. The position suits engineers who have worked on performance-critical systems, infrastructure, or backend development and can communicate evaluation findings clearly. If you are based in the US and excited about advancing LLM capabilities through rigorous code assessment, apply.
Pay and demand for AI Training roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
Pay not disclosed
The employer did not publish pay for this role.
Typical pay · estimated
$70/hour
Median of 1,325 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Most AI Training roles pay $40–$95 per hour.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,548
- Listed in last 30 days
- 798
- Remote
- 97%
Hiring most right now: micro1 (421) · SME Careers (254) · Mercor (227)
Most requested skills · share of roles
- ai evaluation14%
- llm evaluation12%
- data annotation11%
- ai training11%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to Turing’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
TuringSenior Python Engineer – LLM Evaluation (US-based)
TuringSenior Python Engineer – LLM Evaluation (US-based)
TuringSenior Python Engineer – LLM Evaluation (US-based)
TuringSenior Software Engineer – LLM Evaluation (US-based)
TuringSenior Python Engineer – LLM Evaluation (US-based)
Turing