AI数据标注与LLM评估项目（AI Data Annotation & LLM Evaluation Project）
Text
Entity (NER) ClassificationWorked as a data annotation specialist for AI training and LLM evaluation on a major OpenTrain AI platform project. Responsible for entity extraction, text summarization, prompt rewriting, data classification, and quality assurance tasks totaling over 10,000 samples. Expertise included LLM evaluation using advanced techniques and contributing to RLHF data preparation and process improvement. • Labeled and reviewed text data for entity extraction, classification, and prompt engineering tasks. • Conducted LLM evaluation using rubric scoring and pairwise ranking to enhance model performance. • Actively participated in RLHF data curation by creating high-quality preference datasets. • Collaborated with a remote team to streamline annotation workflows and improve project efficiency.