Senior Software Engineer for AI Code Evaluation and Model Review
Listing checked September 12, 2026 · pay as published by Micro1
Overview
micro1 is hiring senior software engineers to work with a leading AI lab. Your main tasks involve evaluating AI-generated code for correctness and design, writing challenging coding problems with reference solutions and test cases, and reviewing model reasoning on architecture, debugging, and system design. You will provide detailed technical feedback to help improve model performance on real-world software tasks. This is a remote contractor role with a pay range of $245 to $280 per hour.
What You'll Do6
- 1Assess AI-generated code for correctness, quality, and design principles.
- 2Create difficult coding problems along with reference solutions and test cases.
- 3Examine model reasoning on architecture, debugging, and system design.
- 4Deliver detailed technical feedback to enhance model performance.
- 5Collaborate with the AI lab team to refine evaluation criteria.
- 6Document findings and suggest improvements for model training.
Requirements5
- 1At least one year of software engineering experience at a top technology company, with some of that experience in the past 7 years.
- 2Undergraduate degree from a top-ranked university.
- 3Residency in an English-speaking country.
- 4Ability to explain technical decisions clearly in writing.
- 5Strong grasp of system design, code review, debugging, algorithms, data structures, and software architecture.
Who Should Apply
This role suits senior software engineers who have worked at top tech firms and hold a degree from a top-ranked university. You should be based in an English-speaking country and excel at written technical communication. Candidates without recent experience at a top company or who lack a degree from a top university may find this role less suitable. A common reason for rejection is not having at least one year of experience at a top tech company within the last seven years. Another is difficulty explaining technical decisions in writing.
Salary Insight
The pay range is $245 to $280 per hour. This is a contractor position, so benefits are not included.
Pay and demand for AI Training roles
AggregatedTypical pay
$71/hour
This role
$245–$280/hr
Most AI Training roles pay $42–$100 per hour. This role's pay sits above that range.
Based on 1,080 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,243
- Listed in last 30 days
- 479
- Remote
- 97%
Hiring most right now: micro1 (362) · SME Careers (253) · Mercor (156)
Most requested skills · share of roles
- ai training13%
- llm evaluation11%
- ai evaluation11%
- data annotation9%
Figures from AI Training roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$245–280/hr
Required Skills
Application Tip
In your application, highlight specific examples of evaluating or writing code, and quantify your experience at top tech companies. Mention your degree from a top-ranked university and provide a writing sample that shows how you explain technical decisions.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Micro1
VerifiedJunior Software Engineer
micro1 is working with a top AI lab to bring on junior software engineers who will assess AI-generated code and craft engineering problems that test model capabilities. Your day-to-day involves reviewing code for correctness, quality, and design, then writing reference solutions and test cases that push models on real-world software tasks. You will also examine how models reason about system design, debugging, and algorithms, and give detailed technical feedback to help improve performance. This is a remote contractor role, and the team is looking for engineers who can explain their technical choices in writing.
Handshake AI
VerifiedSoftware Engineer - AI Evaluation
Handshake AI seeks practicing software engineers for an ongoing part-time contract. You will create expert-level problems rooted in system design, software architecture, and real implementation work, then judge AI answers for technical accuracy and practical feasibility. The role runs remote and asynchronous, so you choose your own hours with no minimum. Your structured written feedback helps models reason more like engineers who build production systems.
Turing
VerifiedSoftware Engineer – AI Code Evaluation & Benchmarking (US candidates only)
This contract role places an experienced software engineer inside an evaluation workflow for frontier AI models. You will review AI-generated code for correctness, efficiency, and maintainability, validate solutions against real engineering tasks, and debug failures across different environments. You will also help build and refine evaluation datasets, benchmarks, and grading rubrics. The assignment runs for one month, requires at least 4 hours per day and 20 hours per week with a 4-hour overlap with PST, and is open only to candidates in the US. Work is fully remote.
Micro1
VerifiedSenior Software Engineer
micro1 is hiring Senior Software Engineers to build Reinforcement Learning Environments that test how well AI models handle real coding problems. You will design tasks around bug fixing, feature implementation, refactoring, and performance tuning, then create a reproducible setup and a golden reference solution for each. This is a remote contractor role at roughly 15 hours per week, and no prior AI experience is needed. Your software engineering depth is what matters here.
Turing
VerifiedSenior Software Engineer - AI Coding Agent Evaluation
Turing seeks experienced software engineers to assess how well AI coding agents handle real repositories. You will treat the agent like a colleague whose pull requests you review: checking whether it read the task, picked a sound design, and produced working code. The work spans Python, TypeScript/JavaScript, and Go codebases, plus the evaluation rubrics and data pipelines that sharpen model behavior. Researchers rely on your written judgment to turn one-off observations into repeatable quality signals. This is a freelance contract, roughly three months long, with 40 hours per week preferred.
Micro1
VerifiedSenior Software Engineer – Remote Contract
This remote contractor role at micro1 puts your backend engineering skills to work on training next-generation AI systems. You will design realistic coding challenges that involve feature implementation and bug fixes, then build deterministic verifiers that accept valid solutions and reject everything else. The schedule is flexible, you choose your hours and days, including weekends. No prior AI experience is needed. Your domain knowledge in languages like Python, Java, Rust, or TypeScript is what matters.