Other open roles
RLHF Preference Labeler
Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Surge AI. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →
About the Role
Surge AI runs large preference-labeling batches. You pick the better of two model responses and justify it in one line; volume is high and steady.
What You'll Do
- Compare paired model responses
- Choose the better one against the guidelines
- Add a one-line justification
You're a Good Fit If You
- You read quickly and consistently
- You can hold guidelines in your head
- You have strong written English
Role Highlights
Pay & Payout
Flat $16 per completed batch item, shown up front. Paid on Surge’s standard schedule.
Apply on Surge AIOpens Surge AI in a new tab. You pay nothing; we may earn a referral fee.
Similar roles
More data annotation work you may qualify for.
Coding & Chatbot Feedback
Label and critique model outputs across coding and conversation tasks; onboarding starter project first.
AI Writing Evaluator - Generalist
Rank and edit chatbot responses for helpfulness and safety across everyday prompts; volume varies weekly.
Senior Backend Engineer - Coding-Agent Eval
Review autonomous coding-agent trajectories in Python and Go; flag reward-hacking and unsafe tool calls.