PRINCIPAL AI DATA SCIENTIST & LLM EVALUATION LEAD (CONTRACT) – Google DeepMind/Scale AI/OpenAI/Meta-AI
Directed RLHF initiatives and led advanced evaluation and annotation processes for enterprise-scale Large Language Models. Oversaw large-scale NLP dataset validation, annotation, and alignment to support generative AI model fine-tuning. Developed structured model feedback methodologies to enhance AI system reliability and safety. • Led AI alignment tasks, including hallucination detection and factual consistency evaluation. • Collaborated with distributed global AI teams focused on generative AI safety and performance. • Designed frameworks for toxicity analysis and edge-case identification in high-stakes AI systems. • Conducted LLM safety testing to ensure alignment with ethical and compliance standards.