Senior Data Labeling Specialist — DataForce by TransPerfect
Carried out entity extraction and coreference resolution on legal documents with performance measured against a gold standard. Improved annotator alignment by designing annotation guidelines for a complex multi-label intent task, reducing disagreement from 18% to 5% over 3 sprints. Built Python scripts to automate annotation quality checks and reduce manual QA effort. • Performed entity extraction and coreference resolution on legal texts • Reduced inter-annotator disagreement via guideline authoring and iterations • Automated QA verification with Python scripts for faster review • Used agreement and metric tracking to monitor labeling quality