AI Data Annotator (AI Trainer & Data Annotator) at DataAnnotation.tech (remote)
Data Annotation Tech
TextAnnotated and quality-reviewed datasets covering technical STEM content, code generation tasks, and conversational AI responses for model training pipelines. Evaluated AI outputs for accuracy, coherence, and logical consistency, providing structured written rationale and flags for issues such as hallucinations and reasoning gaps. Collaborated with distributed annotation teammates while following platform style guides and maintaining inter-rater consistency across tasks. • Used preference and justification documentation to support supervised fine-tuning of LLMs. • Performed factual QA/QC by cross-checking outputs and identifying errors. • Applied comparative judgment workflows aligned with RLHF feedback concepts. • Delivered clear, actionable feedback to improve annotation quality and model responses.