Scale AI — Contributor onboarding support and RLHF training/rating review (11/2024 - Present)
Performed RLHF training for AI models by providing ratings across multiple evaluation dimensions such as accuracy, instruction following, and presentation. Supervised contributor onboarding and supported their understanding of project requirements to maintain consistent labeling quality. Audited submitted work to ensure ratings and outputs matched client expectations. • Provided model ratings across specified rubric dimensions • Facilitated communication and resolved contributor challenges • Quality assurance audits of contributor tasks for compliance • Participated in prompt and rubric design to control prompt complexity