RemoteListed Jun 18, 2026
Analytical Evaluator - AI Feedback
mercor
The role
Job description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Generalist Expert
Type:Contract
Compensation:$70/hour
Location:Remote
Role Responsibilities
Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
Provide structured written feedback to improve AI model outputs.
Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content.
Write clear, precise, and well-evidenced rationales beyond surface-level observations.
Work independently and asynchronously to meet deadlines and improve AI model performance.
Qualifications
Must-Have
Bachelor's degree from a top-500 globally ranked university preferred.
Strong analytical and written communication skills.
Ability to work independently and follow detailed task guidelines.
Strong critical reading skills.
Native English fluency required.
Preferred
None specified.
Application Process (Takes 20–30 mins to complete)
Upload resume
AI interview based on your resume
Submit form
Resources & Support
For details about the interview process and platform information, please check: [link removed]For any help or support, reach out to: [link removed]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas
Keep exploring
Related remote jobs
Product Engineer
SuperPlane
Machine LearningAI Transformation Owner, Marketing
GitLab
Machine LearningTechnical Project Manager — AI & Data Products (Databricks) | Remote
Toptal
Machine LearningAI Engineer — AWS Bedrock AgentCore & Production Agentic Systems | LATAM & Europe
Toptal
Machine LearningAI-Native Software Developer
OnTheGoSystems
Machine Learning
Listing details
- Listed location
- Ireland
- Employment
- Contractor
- Published
- Jun 18, 2026
Listing trust
- Observed through
- Himalayas
- Listing last observed
- Jul 27, 2026
Work-from eligibility is based on normalized evidence in the listing: Ireland.
How verification and eligibility workReport this listing· Checking sign-in before opening the report form…