Improving Implicit Discourse Relation Recognition with Natural Language Explanations from LLMs
Heng Wang, Changxing Wu
Abstract
Implicit Discourse Relation Recognition (IDRR) remains a challenging task due to the requirement for deep semantic understanding in the absence of explicit discourse markers. A further limitation is that existing methods only predict relations without providing any supporting explanations. Recent advances in large language models (LLMs) have shown strong reasoning capabilities in both deep language understanding and...
Summary
The paper proposes a classification-generation framework for implicit discourse relation recognition that jointly predicts relations and generates natural language explanations, trained using explanations distilled from a prompted LLM. This page includes benchmark evidence for Implicit discourse relation recognition on ChatGPT baseline setting. Reproduction guidance focuses on implementation viability and concrete risk controls.
Key Contributions
- The paper proposes a classification-generation framework for implicit discourse relation recognition that jointly predicts relations and generates natural language explanations, trained using explanations distilled.
- The proposed IDRR framework is designed as a plug-and-play module that can be easily integrated with most existing implicit discourse relation recognition models to add explanation generation and leverage LLM.
- On the IDRR task evaluated with macro-averaged F1 and accuracy, the proposed EIDRR model achieves around 73.14% accuracy and 68.01% F1, outperforming LLaMA-based IDRR generation setups that reach at most 70.36%.
- Human evaluation indicates that explanations produced by EIDRR achieve a higher average human quality score of 4.20 compared to 1.71 for the e-INFERSENT baseline, while maintaining slightly higher classification.
- For aspect-based sentiment classification and natural language inference, adding explanations increases accuracy by about 1–2 points, from 85.59% to 87.44% for ATSC and from 74.83% to 75.83% for NLI, with corresponding.
Reproducibility Notes
- Estimate is based on paper-only reproduction flow.
Results & Benchmarks
| Task | Dataset | Metric | Value |
|---|---|---|---|
| Natural language processing | ChatGPT | A c c Acc | 50.24 |
| Natural language processing | LLaMA-3B + IDRR gt | A c c Acc | 65.11 |
| Natural language processing | LLaMA-8B + IDRR gt | A c c Acc | 70.36 |
| Natural language processing | e-INFERSENT | A c c Acc | 73.04 |
| Natural language processing | EIDRR | A c c Acc | 73.14 |
Hardware Requirements
- Expect multi-day setup/compute for meaningful reproduction based on current guidance.
Best Implementation
Maintained implementation evidence is not confirmed for this paper yet.
Use the Implementation Status and Reproduction Path sections below for the current action plan.
Reproduction Path
Follow this baseline workflow to decide if this paper is worth immediate prototyping.
- 1
Use the paper and benchmark evidence to scope a baseline reproduction plan.
- 2
Track assumptions and missing details in an experiment log before coding.
Additional Implementations
No additional verified repositories beyond the primary recommendation.
Hugging Face Artifacts
No trustworthy direct or curated related Hugging Face artifacts were found yet.
Continue with targeted Hugging Face searches: