Senior Data Annotator at Azumo (04/2025 - Present): human-in-the-loop evaluation, RLHF protocol refinement, and integration of Snorkel-based programmatic labeling
Led human-in-the-loop evaluation for 10,000+ technical and qualitative data points using structured, logic-based guidelines to achieve 98% accuracy. Partnered with an AI research team to guide training of multiple machine learning models using domain analysis for 97% precision and recall. Delivered RLHF-focused assessment and refinement of annotation protocols to handle edge cases and speed up the evaluation workflow. • Applied complex guidelines for consistent evaluations across large datasets • Supported training of 5 machine learning models through high-quality annotations • Performed RLHF activities to improve protocol robustness and edge-case coverage • Reduced processing and evaluation time by 30% using programmatic labeling (Snorkel) while maintaining high-fidelity outputs