Melissa A.

Key Skills

Software

Don't disclose

Other

Top Subject Matter

LLM prompt/response evaluation for RLHF training

Text data annotation and preference/ranking evaluation for AI training

Legal Services & Contract Review

Top Data Types

Text

Document

Top Task Types

RLHF

Freelancer Overview

AI Prompt Evaluator & QA Specialist (Remote Contract). Brings 6+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Don't disclose and Other. Education includes Bachelor of Arts, University of California, Los Angeles (UCLA) (2018). AI-training focus includes data types such as Text and labeling workflows including RLHF, Evaluation, and Rating.

Labeling Experience

AI Prompt Evaluator & QA Specialist (Remote Contract)

Don't discloseTextRLHF

Served as an AI Prompt Evaluator & QA Specialist, reviewing AI-generated prompts and responses against project QA rubrics. Performed RLHF preference ranking by comparing multiple candidate responses and selecting the best option per guidelines. Wrote concise, constructive rationales to justify preference choices for reward model training. • Reviewed correctness, clarity, safety, and factual accuracy • Conducted response-pair comparisons for preference ranking • Maintained inter-batch consistency via calibration to gold tasks • Performed content safety analysis and basic bias detection

2024 - Present

Data Annotation Specialist (Freelance)

OtherText

Worked as a Data Annotation Specialist (Freelance), labeling and annotating text-based data for AI model training. Completed ranking and preference-based tasks to assess which responses best conformed to project guidelines. Applied structured QA rubrics to ensure labeling consistency across large batches. • Performed response/conformance evaluations using detailed guidelines • Executed ranking and preference-based annotation tasks • Ensured inter-annotator consistency via QA rubric adherence • Achieved above-threshold accuracy on gold task validations

2023 - 2024

Education

Work History