Senior AI Data Annotator & Evaluator - Toloka AI
Senior AI Data Annotator & Evaluator. Evaluated search engine queries, web pages, and LLM-generated responses against complex, multi-page project guidelines. Conducted side-by-side model comparisons, ranking outputs based on helpfulness, accuracy, safety, and instruction adherence. Executed RLHF tasks, model ranking, and hallucination checks, maintaining a consistent 98%+ quality rating. Identified edge cases and logical errors, providing clear, grammatically flawless written feedback for model fine-tuning.