AI Data Quality Specialist
As an AI Data Quality Specialist at CrowdWorks AI, I evaluated large language model (LLM) outputs for quality and alignment with guidelines. The work involved crafting prompt-response pairs and refining annotation frameworks to facilitate responsible AI training. I contributed to enhanced annotation processes and curated high-quality datasets for multiple domains. • Evaluated over 500 LLM-generated responses per week for accuracy, coherence, and safety • Authored prompt-response pairs for RLHF datasets across STEM, law, medicine, and creative writing • Improved annotation agreement by collaborating on guidelines and mentoring junior annotators • Flagged edge cases and policy violations, contributing to AI safety datasets