AI Data Annotator & Evaluator | Independent / Freelance Platforms | Remote | Nov 2025 – Present
Currently working as an AI data annotator and evaluator for AI-generated text. The work involves structured annotation and quality evaluation across multiple dimensions such as accuracy, helpfulness, tone, coherence, and instruction-following. Decisions are supported with detailed written rationales and guideline-based classification of response behaviors including failure modes. • Perform rubric-based ratings for prompt-response pairs across diverse domains • Classify failure modes such as hallucinations, bias, refusals, and formatting errors • Conduct comparative preference labeling and pairwise ranking for RLHF workflows • Maintain inter-annotator consistency via edge-case escalation and guideline updates