AI Content Reviewer & Prompt Annotator (Freelance / Independent Contracts)
Text
Prompt + Response Writing (SFT)Reviewed and annotated prompt-response pairs for LLM training datasets using rubrics focused on helpfulness, harmlessness, honesty, and overall quality. Wrote and labeled original prompts across multiple domains, and performed comparative ranking of model responses with rationale-based decisions. Maintained consistent annotation quality while adapting to updated guidelines and changing project requirements.• Assessed LLM outputs against quality and safety rubrics for RLHF/SFT-style dataset improvement.• Authored original prompts for domains such as science, technology, history, creative writing, and everyday tasks.• Performed response ranking and comparative annotation with detailed written explanations for each decision.• Updated labeling work based on guideline changes to ensure ongoing dataset consistency.