About this role
Responsibilities
- Complete all Generalist/Rater tasks when needed (image review, keep/discard decisions, five defect group assessments, comments, and markups)
- Audit a sample of Generalists completed work against the guideline; verify each PASS/FAIL, defect item(s) selected, markup location(s), and comment clarity/accuracy
- Provide clear, specific feedback and coaching notes on what to correct and why
- Handle rework on flagged tasks to ensure they meet guideline standards
- Track common errors, flag unclear guideline cases, and collaborate with the project team on clarifications and calibration
- Support calibration sessions; help maintain high inter-rater reliability and gold-standard alignment
- Meet audit throughput and accuracy targets; maintain organized records of audits and feedback
Must-Have Qualifications
- All Generalist/Rater must-haves (English, visual detail, rule application, product familiarity, sensitivity readiness, equipment/connectivity)
- Prior experience in one or more of: image annotation, content moderation, quality rating, QA, or similar review roles
- Proven ability to give constructive, actionable written feedback
- Discipline to apply binary rules (PASS/FAIL) consistently and resist severity drift or over-flagging
- Comfort working with audit queues, sampling plans, and quality metrics
Nice-to-Have Qualifications
- Experience reviewing AI-generated images/outputs, e-commerce product/catalog quality, or search quality
- Experience implementing/maintaining SOPs and meeting gold-standard accuracy thresholds
- Familiarity with calibration methods, inter-rater reliability, and quality dashboards