Senior Data Annotation Specialist (Lead annotator) — RLHF and SFT annotation for LLM fine-tuning
Lead annotator for RLHF and SFT data used in large language model fine-tuning, including instruction following, summarization, code generation, and safety alignment tasks. Authored and revised annotation guidelines across three product verticals to improve consistency and accelerate onboarding for new annotators. Conducted systematic quality audits on weekly batches and escalated ambiguous edge cases and policy conflicts to project stakeholders. • Labeled instruction-following and summarization outputs for model alignment • Evaluated code correctness and performed safety alignment judgments • Performed QA audits on 500–1,000 items per week with reliability checks • Escalated policy conflicts and documented edge-case guidance for training