
Quality Review Lead
Own the second layer of review: calibrate reviewers, resolve disagreements and keep delivery quality high.
Location -
Remote
Posted -
We are looking for a Quality Review Lead to run quality control across client projects. You will review batches, calibrate annotators, adjudicate disagreements and turn what you learn into clearer guidelines.
Quality is managed, not assumed. This role is how we manage it.
Responsibilities
Review sampled and full batches before delivery to clients.
Run calibration sessions and track agreement between reviewers.
Resolve disagreements and document the outcomes in guidelines.
Report quality metrics and issues to the project team.
Requirements
Prior experience reviewing technical work, ideally code, math or evaluation tasks.
Clear, fair written feedback and a practical, structured approach.
Comfort working with several projects and deadlines at once.
Experience leading or mentoring reviewers is a plus.


