Job details
Hourly contract
Remote
Pay: $150-$220 per hour
1. Role Overview
Mercor is partnering with a leading AI research organization to engage experienced management consultants for a project focused on evaluating how well AI systems perform real-world consulting work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.
2. Key Responsibilities
- Design precise, task-specific grading criteria for real-world consulting deliverables (market analyses, strategy recommendations, financial models, client-ready slide decks, and implementation roadmaps)
- Score AI-generated and human work samples against those criteria, with detailed written justifications for every score
- Apply consistent, evidence-based judgment so that scores are reproducible and defensible
- Incorporate structured feedback from senior reviewers and iterate quickly on your work
3. Ideal Qualifications
- 5+ years of professional management consulting experience
- Background at a top-tier strategy or management consulting firm (e.g., McKinsey, Bain, BCG, or equivalent)
- Deep fluency in structured problem solving, market sizing, financial modeling and business-case building, and slide-based executive communication
- Exceptionally strong written communication
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers
- Prior experience with AI training, evaluation, or human-data projects is a strong plus
💡 Important Note for Applicants: To maximize your chances of success, please read our Mercor Candidate Guide before applying. It covers crucial information about their AI matching process, background checks, and payment policies.
4. Application Process
- Submit your resume or relevant professional background to get started
- Qualified applicants may be asked to complete a brief assessment or submit additional information
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms
- You will be engaged as an independent contractor.
- This is a fully remote role that can be completed on your own schedule.
- Projects can be extended, shortened, or concluded early depending on needs and performance.
- Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
- Payments are weekly on Stripe or Wise based on services rendered.
- Please note: We are unable to support H1-B or STEM OPT candidates at this time.