Senior AI Trainer & RLHF Specialist (Scale AI)
Built and evaluated high-quality preference datasets for RLHF pipelines to support frontier LLM fine-tuning. Conducted hallucination audits and factuality assessments to identify errors and produce corrected exemplars for supervised fine-tuning datasets. Led adversarial red teaming to surface safety vulnerabilities, jailbreak patterns, and model failure modes. • Preference data creation for reasoning, coding, and instruction-following tasks • Hallucination/factuality assessment with corrected exemplars for SFT • Adversarial red teaming and safety evaluation across production LLMs • Reasoning step verification and multi-step output review for math and code generation