Other open roles

View all opportunities

JSON-fluent & Rubrics Expert

$175
per hour
Hourly contract Remote Last verified 21 Jul 2026
Affiliate disclosure

Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Mercor. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →

About the Role

Mercor is recruiting detail-oriented graders for a fast-turnaround sprint assessing JSON-formatted AI model outputs against defined rubrics for a leading AI research organization, without the assistance of AI tools.

What You'll Do

  • Read and understand written task descriptions and rubrics
  • Parse JSON-based model outputs and grade contents against the rubrics provided
  • Apply rubric criteria with attention to detail and consistency

You're a Good Fit If You

  • Comfortable reading and interpreting JSON files
  • Prior Mercor rubric/evaluation experience is a plus; US-based
  • Available 20-40 hours/week with a desktop or laptop (no Chromebooks)

Role Highlights

Pay
$50-$175/h
Contract
Hourly contract
Location
Remote
Category
Model evaluation
Posted
2 days ago
Job ID
WE-5013

Pay & Payout

Independent contractor engagement; short sprint with possible extension. Mercor pays weekly via Stripe or Wise.

Apply on Mercor

Opens Mercor in a new tab. You pay nothing; we may earn a referral fee.