AI Training & Data Annotation Specialist (Remote) — Search Relevance Judgments
You performed search relevance assessments aligned with user intent to evaluate AI and search system outputs. You conducted side-by-side (SxS) comparisons of results and rated usefulness and intent match. You ensured query–intent alignment and consistent judgment quality using evolving project guidelines. • Query–intent matching and relevance judgments • Side-by-side result comparisons • Usefulness scoring and ranking quality evaluation • Search results evaluation against user queries