LLM Data Pipeline Builder & Annotator (MiniMind Reproduction)
I built an end-to-end LLM pipeline in PyTorch focused on data cleaning, supervised fine-tuning, and reinforcement learning from human feedback. This involved structuring raw textual data, formatting prompts and responses, and crafting supervised learning datasets for AI model training. The work also included workflow design for various training stages and adaptation methods. • Processed and cleaned raw textual data for model training. • Generated prompt-response pairs for supervised fine-tuning. • Supported RLHF/DPO stages with prompt curation and quality checking. • Facilitated effective training dataset creation for Transformer-based models.