Job details
Hourly contract
Remote
$30 – $60 per hour
We’re seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. You’ll validate whether browser tests are technically sound, deterministic, and capable of producing clear pass/fail outcomes before they become part of benchmark datasets.
What You’ll Do
- Review browser-based testing workflows for AI-generated web applications.
- Assess whether browser interactions are technically feasible and reliable.
- Validate test isolation, fixtures, setup, and execution flow.
- Ensure assertions produce deterministic, unambiguous pass/fail results.
- Identify flaky tests, hidden dependencies, or ambiguous validation logic.
- Provide structured technical feedback following project review rubrics.
We’re Looking For
- 3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation.
- Strong experience testing modern web applications.
- Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.
- Experience writing automated UI and end-to-end tests.
- Strong understanding of test isolation, fixtures, reproducibility, and reliable browser automation.
- Excellent debugging skills and attention to detail.
Why Join?
- Contribute to the development of AI systems by ensuring browser-based evaluation workflows are technically robust and reliable.
- Review realistic web application testing scenarios involving automation, test design, and software quality engineering.
- Collaborate with a high-calibre team helping establish quality standards for AI-generated software evaluation.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms
- You will be engaged as an independent contractor.
- This is a fully remote role that can be completed on your own schedule.
- Projects can be extended, shortened, or concluded early depending on needs and performance.
- Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
- Payments are weekly on Stripe or Wise based on services rendered.
- Please note: We are unable to support H1-B or STEM OPT candidates at this time.
