Freelance Data Annotation and Labeling (Quality Control) - Outlier AI / Prolific.com / Alignerr AI
Performed quality control evaluations of fellow annotators’ completed tasks to ensure consistency and accuracy against project guidelines. Evaluated AI outputs, prompts, and responses using predefined quality metrics and provided written feedback to annotators to resolve complex labeling issues. Executed pixel-level analysis and edge detection using optimized hyperparameters while tracking recall, precision, and accuracy for quality assurance. • Pixel-level image analysis and edge detection • QA reviews for inter-annotator consistency • Feedback loops to correct prompt/output alignment • Bias and overfitting checks during pattern identification