Prototype-Based Disentanglement for Controllable Dysarthric Speech Synthesis
Haoshen Wang, Xueli Zhong, Bingbing Lin, Jia Huang, Xingduo Pan +3 more
Abstract
Dysarthric speech exhibits high variability and limited labeled data, posing major challenges for both automatic speech recognition (ASR) and assistive speech technologies. Existing approaches rely on synthetic data augmentation or speech reconstruction, yet often entangle speaker identity with pathological articulation, limiting controllability and robustness. In this paper, we propose ProtoDisent-TTS, a prototype-b...
Results & Benchmarks
| Task | Dataset | Metric | Value |
|---|---|---|---|
| Controllable Dysarthric Speech Synthesis | Mod-Severe | FS2D | 0.4960 |
| Controllable Dysarthric Speech Synthesis | Moderate | FS2D | 0.3680 |
| Speech | CMHR | M04 | 0.1803 |
| Speech | 0.1519 | M01 | 0.2197 |
| Speech | Ours | M01 | 0.3667 |
Hardware Requirements
- Expect multi-day setup/compute for meaningful reproduction based on current guidance.
Best Implementation
Maintained implementation evidence is not confirmed for this paper yet.
Use the Implementation Status and Reproduction Path sections below for the current action plan.
Reproduction Path
Follow this baseline workflow to decide if this paper is worth immediate prototyping.
- 1
Use the paper and benchmark evidence to scope a baseline reproduction plan.
- 2
Track assumptions and missing details in an experiment log before coding.
Additional Implementations
No additional verified repositories beyond the primary recommendation.
Hugging Face Artifacts
No trustworthy direct or curated related Hugging Face artifacts were found yet.
Continue with targeted Hugging Face searches: