Database Systems Evaluation Expert
Listing checked October 7, 2026 · pay as published by Mercor
Overview
Mercor seeks specialists to build tasks that probe how AI agents handle database engineering. The work spans database-engine implementation, production diagnosis, or application migration, depending on your specialty. Each task carries a problem statement, a reproducible repository or environment, a working reference solution, tests, and grading criteria that separate a solid engineering answer from one that appears correct without holding up under scrutiny. The engagement runs remote and task-based, with a one-time payment of $2,200 for about 25 hours of work, followed by technical review and feedback.
What You'll Do8
- 1Design one challenging, self-contained task in database engineering that focuses on your specialty.
- 2Create a problem statement that gives candidates or AI agents enough context to work the task without extra hints.
- 3Build a reproducible repository or environment so reviewers can run the task from a clean state.
- 4Write a working reference solution that demonstrates the expected engineering approach.
- 5Develop checks for correctness, failure handling, concurrency, retries, and regressions where the task calls for them.
- 6Measure performance with latency, throughput, and memory use in mind.
- 7Define grading criteria that reveal engineering judgment, not just passing tests.
- 8Partner with technical reviewers to refine and validate the task before release.
Requirements5
- 1Five or more years of hands-on work with database-engine internals, or a PhD in database systems.
- 2Deep knowledge of at least one area: storage engines, query execution, query optimization, transactions, replication, or low-latency systems.
- 3Strong implementation skills, with the ability to explain correctness and performance tradeoffs in plain terms.
- 4Experience that comes from DBA work, SQL analytics, ETL, or application-level database use does not meet the bar on its own.
- 5You do not need expertise across every task area. The role values depth in your specialty.
Who Should Apply
Candidates with at least five years inside database-engine internals or a database-systems PhD will find the strongest fit here. You should bring depth in storage engines, query execution, transactions, replication, or another low-latency area, and you should enjoy explaining why one engineering choice beats another. The role suits people who can build a reproducible task, write a reference solution, and judge performance through latency, throughput, and memory use. This work is a poor match for someone whose background centers on DBA duties, SQL analytics, ETL pipelines, or application-only database work, because those areas do not qualify on their own. A common reason applicants score low is that they describe database usage at the application layer without showing engine-level implementation or tradeoff analysis. Another is treating the assessment as a generic coding test instead of demonstrating deep database systems judgment.
Salary Insight
Mercor pays a one-time fee of $2,200 for this task. The selected expert completes about 25 hours of work, then moves through technical review and feedback. That payment structure matches a specialized, senior-level evaluation project rather than a standard hourly contract, and the source does not list a separate hourly rate. If the pilot expands, completed assessments may lead to future work.
Pay and demand for Enterprise Systems (ERP/CRM) roles
AggregatedTypical pay
$70/hour
This role
$2,200 fixed
Most Enterprise Systems (ERP/CRM) roles pay $42–$98 per hour.
Based on 1,113 similar roles that publish pay · 302 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 1,304
- Listed in last 30 days
- 507
- Remote
- 96%
Hiring most right now: micro1 (378) · SME Careers (254) · Mercor (166)
Most requested skills · share of roles
- ai training12%
- llm evaluation11%
- ai evaluation11%
- data annotation9%
Figures from Enterprise Systems (ERP/CRM) roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$2,200 fixed
Required Skills
Application Tip
Before the assessment, set up your own editor, terminal, Python 3.8 or newer, and a compiler for C, C++, Rust, Go, or Java. During the recorded verbal responses, name the exact database-engine area you know best, such as storage engines, query optimization, transactions, or replication, and walk through a concrete correctness or performance tradeoff you have handled. In the coding exercise, focus on reproducible tests and failure cases rather than a solution that compiles but lacks depth. Complete every section without outside AI help, because the assessment checks independent problem solving and the source calls for that standard.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedEngineering Expert - Remote AI Evaluation
Mercor supports research teams behind well-known AI models by supplying engineering judgment that models cannot generate on their own. Your design standards and analysis habits become the rubric used to grade a model's engineering output. The company keeps a standing, part-time listing for engineers who want AI evaluation and training work, not a single opening. Projects can start with short notice, so Mercor draws from this pool when a client needs a discipline such as structural engineering, mechanical engineering, or electrical engineering. Past engineering projects posted at $60.00 to $125.00 per hour.
Mercor
VerifiedData Analysis Expert - Remote AI Evaluation
Mercor maintains a standing pool for data analysis experts who want to train and evaluate frontier AI models. Research teams bring their hardest data judgment calls here, and your standards help build the rubrics that grade model answers. The pool spans business intelligence, data engineering, statistics, and machine learning, with part-time project work that starts on short notice. A matching project may arrive within a week or take several months, depending on client needs. The listing stays open even when no project is active.
AfterQuery
VerifiedAdvanced Coding Expert
AfterQuery hires experienced engineers to create long-horizon coding tasks that test and train advanced coding agents. You will draw real bugs, features, regressions and migrations from a substantial codebase you own, then shape them into prompts that demand genuine investigation from an agent. Each task needs a Docker setup that builds and runs the same way every time. You also design test suites and review rules that separate correct work from shortcut solutions. The contract runs 30 hours per week, remote, with pay from $70.00 to $100.00 per hour.
Mercor
VerifiedEngineering & Software Domain Expert
Frontier AI models improve only when someone with real engineering experience checks their work. This role puts you inside a leading AI lab's GenAI team, where you will review engineering knowledge tasks, write instruction specs and golden solutions, and build benchmarks that measure model progress. You will work in the client's own tools, on-site in the Bay Area several days each week, and your output directly shapes how the model reasons about software and systems. Employment is W-2 through Cincinnatus LLC, with client-issued accounts and equipment.
Mercor
VerifiedSoftware Engineer Expert (Remote) Part-Time
Mercor keeps a standing pool of software engineers who help grade and train frontier AI models. The work is part-time and remote, and projects span frontend, backend, mobile, embedded, DevOps, QA, and security engineering. Assignments range from writing original engineering problems with reference answers to reviewing model-written code for edge cases, complexity, and production failure modes. Past software engineering projects on Mercor paid between $70 and $150 per hour, with scope and depth setting the exact rate.
Handshake AI
VerifiedSoftware Engineer - AI Evaluation
Handshake AI seeks practicing software engineers for an ongoing part-time contract. You will create expert-level problems rooted in system design, software architecture, and real implementation work, then judge AI answers for technical accuracy and practical feasibility. The role runs remote and asynchronous, so you choose your own hours with no minimum. Your structured written feedback helps models reason more like engineers who build production systems.