Modern architecture with geometric shapes and neon lights

Quality Review Lead

Own the second layer of review: calibrate reviewers, resolve disagreements and keep delivery quality high.

Location -

Remote

Posted -

We are looking for a Quality Review Lead to run quality control across client projects. You will review batches, calibrate annotators, adjudicate disagreements and turn what you learn into clearer guidelines.

Quality is managed, not assumed. This role is how we manage it.

Responsibilities

  • Review sampled and full batches before delivery to clients.

  • Run calibration sessions and track agreement between reviewers.

  • Resolve disagreements and document the outcomes in guidelines.

  • Report quality metrics and issues to the project team.

Requirements

  • Prior experience reviewing technical work, ideally code, math or evaluation tasks.

  • Clear, fair written feedback and a practical, structured approach.

  • Comfort working with several projects and deadlines at once.

  • Experience leading or mentoring reviewers is a plus.

We provide vetted developers and domain experts for AI training data, evaluation and RLHF โ€” powered by expertise, driven by quality.

Follow Us:

We provide vetted developers and domain experts for AI training data, evaluation and RLHF โ€” powered by expertise, driven by quality.

Follow Us:

We provide vetted developers and domain experts for AI training data, evaluation and RLHF โ€” powered by expertise, driven by quality.

Follow Us: