Vivian Y.

Key Skills

Software

No software listed

Top Subject Matter

Sociology Domain Expertise

Humanities Domain Expertise

public policy

Top Data Types

Text

Video

Document

Top Task Types

Classification

Text Summarization

Evaluation/Rating

Freelancer Overview

Research-oriented AI Content Evaluator with a Master's degree in Sociology from the University of Science and Technology Beijing. Brings internship experience at Tencent, JD.com, and Canva, with strengths in qualitative research, content quality evaluation, data analysis, and structured reasoning. Designed 60+ evaluation tasks for large language models covering sociology, humanities, and public policy, and evaluated AI-generated responses for factual accuracy, reasoning quality, coherence, completeness, and instruction following. Experienced in text annotation, content evaluation, and evidence-based analysis.

Labeling Experience

LLM Response Evaluation & Prompt Assessment

TextClassification

Conducted expert LLM response evaluation on sociology, humanities, and public policy prompts. Rated outputs for factual accuracy, reasoning quality, coherence, completeness, and instruction adherence. Compared multiple model responses using structured criteria to identify hallucinations and unsupported claims. • Authored 60+ evaluation tasks and rubrics for large language model assessment. • Performed structured evaluations across multiple quality dimensions. • Flagged logical inconsistencies and unsupported statements in generated text. • Delivered detailed human feedback to support dataset and evaluation quality improvements.

2026 - 2026

Content Research & Quality Analysis

TextEvaluation/Rating

Supported content research and verification activities using audience feedback to inform editorial strategy. Analyzed top user comments and produced weekly insight reports based on cross-platform performance signals. Contributed to content optimization initiatives that improved content performance metrics. • Reviewed and verified industry and performance-related information for content planning. • Analyzed Top 50 user comments to derive recurring themes and insights. • Performed cross-platform performance comparisons to guide editorial decisions. • Supported optimization work that contributed to measurable engagement gains.

2025 - 2025

Content Quality Evaluation & Video Classification

VideoClassification

Developed quality evaluation standards for short-form videos to support large-scale content governance. Produced quality assessment reports and collaborated with cross-functional teams to improve content performance and user engagement. Conducted research for a live-streaming initiative and proposed content strategy recommendations. • Defined and operationalized video content quality evaluation criteria. • Assessed short-form video content against the established standards. • Generated evaluation/quality assessment reports for stakeholders. • Partnered with cross-functional teams to improve engagement outcomes.

2024 - 2024

Education

Work History