LLM Fine-tuning and Dialogue Summarization Project
Fine-tuned FLAN-T5 on the DialogSum dataset utilizing the LoRA technique to enhance dialogue summarization performance. Implemented Reinforcement Learning from Human Feedback (RLHF) with PPO to further improve model behavior and reduce toxicity in generated summaries. Utilized a hate speech classifier for reward modeling and achieved a substantial reduction in toxicity. • Created sophisticated dialogue summaries using advanced LLM training techniques • Labeled and generated high-quality data for fine-tuning on text summarization tasks • Applied RLHF and PPO methods for safer output generation • Employed third-party evaluation models to assess and refine output