QA / Software Engineering Reviewer – Browser Test Validation | $30-$60/hr Remote
Listing checked September 8, 2026 · pay as published by Mercor
Overview
QA and test automation engineers with hands-on experience review browser-based evaluation workflows for AI-generated web applications. Your core job is to decide whether a given test is sound, deterministic, and able to produce a clear pass or fail result before it enters benchmark data. That means checking test isolation, fixtures, setup, and execution flow, while also scrutinizing every assertion. If you can spot hidden dependencies or ambiguous validation steps, this role puts your judgment to work.
What You'll Do6
- 1Inspect browser test workflows built for AI-generated web apps and verify they execute as expected.
- 2Determine whether each browser interaction is technically possible and repeatable across runs.
- 3Confirm that tests keep their state isolated, fixtures load correctly, and the execution order produces consistent results.
- 4Check that every assertion leads to a clear pass or fail, with no gray area that could confuse interpretation.
- 5Hunt down flaky tests, hidden state dependencies, or validation logic that leaves room for doubt.
- 6Deliver concise, rubric-aligned feedback that tells the test author exactly what needs to change.
Requirements6
- 13+ years building tests in software engineering, QA, SDET, or test automation roles.
- 2Hands-on experience testing modern web applications across browsers.
- 3Working knowledge of at least one browser automation tool such as Playwright, Cypress, or Selenium.
- 4Proven track record writing automated UI or end-to-end tests.
- 5Solid grasp of test isolation, fixture design, reproducibility, and reliable browser automation.
- 6Strong debugging skills with a high attention to detail and logic.
Who Should Apply
The ideal candidate has spent at least three years writing and debugging automated tests for web applications, and feels at home with Playwright, Cypress, or Selenium. You regularly think about why a test might pass one day and fail the next, and you can articulate the difference between a flaky check and a deterministic one. This role is not a good fit for engineers whose experience is mainly manual QA, nor for those who only write unit tests without ever touching browser-level automation. Candidates often miss out when they cannot point to a concrete example of diagnosing a flaky test or restructuring a test to remove hidden dependencies.
Salary Insight
The hourly rate for this work is $30 to $60, and your pay will come from time invested in each review. The range fits what specialized QA consultants earn on remote projects, and your position within it reflects your seniority and familiarity with Playwright, Cypress, or similar tools.
Pay and demand for Software Engineering roles
AggregatedTypical pay
$65/hour
This role
$30–$60/hr
Most Software Engineering roles pay $45–$85 per hour. This role's pay falls inside that range.
Based on 336 similar roles that publish pay · 115 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 386
- Listed in last 30 days
- 222
- Remote
- 94%
Hiring most right now: micro1 (129) · SME Careers (112) · Mercor (33)
Most requested skills · share of roles
- llm evaluation24%
- ai training23%
- trainer feedback20%
- python20%
Figures from Software Engineering roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
$30–60/hr
Required Skills
Application Tip
Before applying, prepare a short case study of a flaky end-to-end test you debugged. Focus on how you identified the hidden dependency or non-deterministic assertion, then explain the fix you applied and how you verified the test remained reliable over repeated executions. This signals that you understand the core challenge of this reviewer role.
See NearSkill jobs more often in your search
Application & verification flow
1Instant rubric match
Your resume is scanned against this role’s requirements to check qualification fit.
2Screened before the employer sees it
Only profiles that clear screening are passed on.
3Outcome by email
We notify you at the address on your resume once the screening is reviewed.
Similar open positions
Explore active roles that match your skills and interests.
Micro1
VerifiedQA Automation Engineer
In this remote role, you'll put your QA automation skills to work helping train cutting-edge AI systems. Your day-to-day testing experience will directly influence how these models learn and perform, no AI background required — just strong automation expertise.
Micro1
VerifiedQA Automation Engineer
We're looking for a QA Automation Engineer to join a remote team focused on ensuring top-notch quality for critical applications. You'll design and improve automated tests using tools like Selenium, Cypress, and Postman. This role offers flexibility and the chance to work with a collaborative, distributed team.
Micro1
VerifiedQa Engineer With Manual And Automated Testing Expertise
A full-time QA Engineer is needed to ensure our products perform reliably and meet quality standards. The role involves testing new features, documenting issues, and expanding test coverage while collaborating with engineers and product teams throughout the development cycle. You’ll balance manual testing with automation work to uphold a high quality bar as we ship rapidly. You should bring solid manual testing fundamentals and hands-on automation experience to the team. Automation Testing and QA practices are central to the role.
Micro1
VerifiedQA Engineer for AI Training (Remote)
micro1 seeks QA Engineers to support a high-volume project that trains next-generation AI systems. You will evaluate AI-generated technical outputs against rubrics, design test cases, and document defects. The role is fully remote and open to candidates with strong QA backgrounds plus prior paid experience in human data annotation, RLHF, or model evaluation. No AI experience is needed, but software QA alone without a human-in-the-loop AI component does not meet the requirement.
SME Careers
VerifiedHTML CSS Team Lead for Remote Frontend QA Contract
As an HTML and CSS Team Lead, you oversee quality and consistency for AI training projects guided by remote contributors. Review AI-generated HTML and CSS snippets against detailed rubrics, delivering precise feedback on semantics, accessibility, and responsive layouts. Lead conversations on ARIA basics, CSS specificity, and cross‑browser compatibility while guiding trainers through updated guidelines on Discord and shared docs. This remote, hourly contract with SME Careers focuses on frontend quality leadership for training data that must be accessible, well-structured, and aligned with client expectations.
SME Careers
VerifiedJavaScript QA Lead for AI Training Projects Remote Contract
This hourly remote contract places you at the forefront of JavaScript quality for AI training projects. You review AI-generated JavaScript code and trainer/QA outputs, measuring results against detailed rubrics and guidelines. Deliver precise written feedback and maintain clear documentation of quality standards for remote teams. You drive consistency through structured code review and LLM evaluation across the program.