Gen AI Knowledge Expert | Data Labeling Analyst (Contract) — Meta / Social Media
Provided rubric-based QA audits and scoring for LLM-generated responses focused on factual accuracy, evidence validation, reasoning quality, and search-grounded response assessment. Performed hallucination detection and instruction-adherence checks, then evaluated completeness, relevance, specificity, and policy compliance for each output. Conducted comparative response analysis and preference ranking to support conversational AI evaluation and long-form reasoning assessment. • Reviewed outputs for misclassified items, incorrect categorizations, and reporting inconsistencies • Validated information extraction and spreadsheet-reconciliation tasks within retrieval-based workflows • Audited large datasets for accuracy, consistency, and compliance with reporting standards • Documented root causes for process improvements and prepared progress/quality tracking reports.