Generalist (Data Labeling & AI Evaluation)
As a Generalist focusing on Data Labeling & AI Evaluation at Mercor, I annotated and labeled various datasets including text, image, and structured data to enhance AI models. My responsibilities included classification, ranking, and quality evaluation tasks in strict accordance with evolving guidelines. I maintained high standards of accuracy and quality assurance across diverse labeling projects. • Conducted RLHF prompt evaluation and response ranking on text-based datasets • Ensured annotation quality via human-in-the-loop review and calibration exercises • Identified edge cases, ambiguities, and biases for data escalation and process improvement • Provided detailed feedback and collaborated with distributed teams to meet project objectives.