Product Operations Specialist - Quora Inc / Poe AI
You rated AI responses for LLM alignment by evaluating outputs against engineering rubrics across multiple ML projects. You contributed human evaluation signals that directly informed model fine-tuning and quality improvements. You also worked on building review workflows and quality rubrics to operationalize human evaluation at scale. • Rated AI responses for quality per engineering rubrics • Supported RLHF-style human evaluation for fine-tuning inputs • Defined review workflows, quality rubrics, and escalation SOPs • Conducted QA calibration on edge cases to maintain rating consistency