Senior Software Engineer – LLM Evaluation (US-based)
Listing checked November 8, 2026 · details as published by Turing
Key details
- Pay
- Not published
- Location
- Remote
- Job type
- contract
- Posted
- November 5, 2026
Overview
Turing is hiring experienced software engineers to create datasets that train and benchmark large language models. You will produce code examples, correct AI outputs, and design verification methods across Python, JavaScript (React, Node.js), and additional languages such as C/C++, Java, Rust, and Go. The role focuses on evaluating AI-generated code for efficiency, scalability, and reliability while working with researchers to advance model capabilities. This remote contractor position starts at a minimum of 10 hours per week, with the possibility of up to 40 hours, and is initially for one month with potential extensions.
What You'll Do9
- Build and curate datasets of code examples and precise solutions for AI model training and benchmarking.
- Evaluate AI-generated code across backend and frontend contexts for efficiency, scalability, and reliability.
- Correct code written in Python and JavaScript (React, Node.js), as well as C/C++, Java, Rust, and Go.
- Develop agents that verify code quality and identify error patterns in full-stack applications.
- Collaborate with cross-functional teams to improve AI-driven coding solutions against industry benchmarks.
- Hypothesize on stages of the software engineering cycle (e.g., prototyping, architecture, API design, production, launch, monitoring) and assess model capabilities on them.
- Design automated verification mechanisms for software engineering tasks.
- Provide clear, structured rationales for evaluation decisions.
- Work closely with AI researchers to refine training data and evaluation protocols.
Requirements6
- 3+ years of software engineering experience.
- Strong expertise in building full-stack applications with Python and JavaScript (React, Node.js), comfortable working across backend and frontend codebases.
- Experience deploying scalable, production-grade software using modern languages and tools.
- Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
- Excellent oral and written communication skills for clear, structured evaluation rationales.
- Must be based in the United States.
Preferred Qualifications2
- Experience at frontier AI companies such as OpenAI, NVIDIA, Databricks, Palantir, or Snowflake.
- Graduation from top computer science programs like Stanford, MIT, Carnegie Mellon, UC Berkeley, or Georgia Tech.
Who Should Apply
Candidates with at least 3 years of software engineering experience, strong full-stack skills in Python and JavaScript, and a background in production software deployment. The role suits engineers who have worked at frontier AI labs or top tech companies and can communicate evaluation rationales clearly. Exceptional skill and experience take precedence over pedigree.
Pay and demand for Software Engineering roles
Market estimates from live NearSkill listings — separate from this job's published terms.
This role · as published
Pay not disclosed
The employer did not publish pay for this role.
Typical pay · estimated
$70/hour
Median of 1,325 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Most Software Engineering roles pay $40–$95 per hour.
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,548
- Listed in last 30 days
- 801
- Remote
- 97%
Hiring most right now: micro1 (421) · SME Careers (254) · Mercor (227)
Most requested skills · share of roles
- ai evaluation14%
- llm evaluation12%
- data annotation11%
- ai training11%
Figures from Software Engineering roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesRequired skills
How applying works
1. Pre-screen on NearSkill
A quick application on NearSkill checks your fit against this role.
2. Finish on the employer’s site
We hand you to Turing’s official application page to complete the form.
3. Wait for a response
The employer’s hiring team reviews applications and gets back to you.
Similar jobs
Open roles that match this listing's skills and level.
TuringSenior Software Engineer – LLM Evaluation (US-based)
TuringSenior Software Engineer – LLM Evaluation (US-based)
TuringSenior Software Engineer – LLM Evaluation (US-based)
TuringSenior Software Engineer – LLM Evaluation (US-based)
TuringSenior Software Engineer – LLM Evaluation (US/Canada/WEU based)
Turing