About this role
Careerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products.
About the role
Lead annotators in producing accurate, high-quality AI training data. You will manage daily operations, coach team members, monitor productivity and quality, and ensure timely delivery in a fast-paced environment with tight, often 24-hour, turnaround times.
Key Responsibilities
- Manage annotation batches from launch through delivery.
- Review client guidelines and convert them into clear team instructions.
- Lead annotators and Pod Leads, set daily targets, and maintain staffing.
- Monitor productivity and quality metrics.
- Conduct coaching, retraining, and remediation when required.
- Collaborate with QA and tooling teams to improve processes.
- Develop high-performing team members for future leadership roles.
- Report project progress, risks, and blockers to the Project Lead.
Required Qualifications
- 4–6 years of overall experience, including 2+ years of team leadership.
- Experience managing teams against productivity and quality targets.
- Strong communication, organizational, and problem-solving skills.
- Ability to simplify complex guidelines and manage competing priorities.
- Experience in annotation, data labeling, or AI training data projects is preferred.
Offer Details:
- This is a project-based role involving a defined number of evaluation tasks.
- Each task will involve comparing multiple chatbots and providing a final assessment.
- Work Schedule: Five working days per week, including weekends as required, with two weekdays off.
- Work Hours - 7am-4pm PST
- Duration: 16 weeks.