AI Data Analyst (Human-in-the-loop evaluation and annotation)
Performed human-in-the-loop side-by-side evaluation for a Google Maps “Full Personalization” feature. Recorded annotator screenshots and measured “Personalization Gain” by comparing personalized versus non-personalized AI responses. Completed structured client feedback sheets with visual evidence embedded in specified cells to satisfy formatting requirements. • Conducted SbS comparisons using desktop-submitted query sets • Captured and reviewed screenshots as labeling evidence for each comparison • Measured and documented personalization gain outcomes consistently • Followed strict template and cell-level formatting standards for reporting