AI Generalist (High-Accuracy Data Evaluation)
Job description
About the Role
Mercor is hiring AI Generalists to support high-quality data pipelines used to train and evaluate advanced AI systems.
This role focuses on precision, consistency, and deep attention to detail — ideal for contributors who excel at structured evaluation and spotting subtle errors.
What You’ll Do
- Review and evaluate AI-generated outputs with high accuracy
- Annotate and label data based on detailed guidelines
- Identify:
- Subtle errors
- Edge cases
- Inconsistencies in outputs
- Provide clear, structured feedback to improve AI performance
- Maintain consistent quality across high-volume tasks
- Flag unclear instructions or ambiguous cases
What We’re Looking For
- Extremely detail-oriented and quality-focused mindset
- Experience in:
- AI data annotation
- Content reviewing / rating (CB, QA, etc.)
- Strong ability to follow complex instructions precisely
- Excellent written communication and reasoning skills
- High consistency and reliability across repetitive workflows
- Ability to work independently and stay focused
Nice to Have
- Experience with large-scale AI training or evaluation programs
- Background in:
- QA / Quality Assurance
- Trust & Safety
- Operations or structured review work
- Familiarity with rubric-based evaluations
- Ability to provide calibrated, structured feedback
Compensation
- $50/hour
- Weekly payments via Stripe or Wise
Role Details
- Remote (U.S. only)
- Flexible schedule
- Project duration may vary based on performance and needs
Why Join Mercor
- Work directly on training next-generation AI systems
- High pay compared to typical annotation roles
- Quality-first environment with clear expectations
- Opportunity for long-term, consistent work
About Mercor
Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. Contributors work on high-impact projects that directly shape the capabilities of advanced AI systems.
You will be redirected to the company's website to complete your application.
Mercor
Discover more opportunities that match your skills and interests.