Multi-Speaker and Wide-Band Simulated Conversations as Training Data for End-to-End Neural Diarization
Abstract
Domain fit: AI-adjacent · Paper appears method- or tooling-adjacent to AI workflows with partial ecosystem coverage.
End-to-end diarization presents an attractive alternative to standard cascaded diarization systems because a single system can handle all aspects of the task at once. Many flavors of end-to-end models have been proposed but all of them require (so far non-existing) large amounts of annotated data for training. The compromise solution consists in generating synthetic data and the recently proposed simulated conversations (SC) have shown remarkable improvements over the original simulated mixtures (SM). In this work, we create SC with multiple speakers per conversation and show that they allow for substantially better performance than SM, also reducing the dependence on a fine-tuning stage. We also create SC with wide-band public audio sources and present an analysis on several evaluation sets. Together with this publication, we release the recipes for generating such data and models trained on public sets as well as the implementation to efficiently handle multiple speakers per conversation and an auxiliary voice activity detection loss.
Results and benchmarks
End-to-end diarization presents an attractive alternative to standard cascaded diarization systems because a single system can handle all aspects of the task at once.
Benchmark evidence is limited
Evidence graph: 4 refs, 4 links.
Utility signals: depth 60/100, grounding 85/100, status medium.
Implementation
Best maintained implementation now
BUTSpeechFIT/EEND
95 stars · 13 forks · Last push Apr 24, 2025
- License
- CI
- Dependencies
- Docker
Official implementation from Papers with Code · Repository link is mentioned in the paper metadata · Community adoption signal (95 stars)
butspeechfit/eend is the strongest maintained implementation based on ranking signals. Dependency/environment manifests are present.
Open butspeechfit/eend- License metadata missing
- No CI workflows detected
- Selected butspeechfit/eend as the strongest maintained implementation for new work.
- Includes dependency/environment manifest signals.
- Repository activity is within the last 24 months.
- Official repository is preserved separately as historical context.
Compare implementation paths
Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.
- Maintenance
- Stale
- Confidence
- High
- Reproducibility
- Limited
- Stars
- 95
- Last push
- Apr 24, 2025 (489d)
Official implementation from Papers with Code · Repository link is mentioned in the paper metadata
- No push in 12+ months
- No CI pipeline detected
- No tagged releases
- Maintenance
- Stale
- Confidence
- High
- Reproducibility
- Limited
- Stars
- 59
- Last push
- Mar 28, 2025 (516d)
Official implementation from Papers with Code · Community adoption signal (59 stars)
- No push in 12+ months
- No CI pipeline detected
- No tagged releases
- Maintenance
- Stale
- Confidence
- High
- Reproducibility
- Limited
- Stars
- 0
- Last push
- Nov 15, 2022 (1380d)
Official implementation from Papers with Code · Matched via arXiv identifier search
- No push in 12+ months
- No CI pipeline detected
- No tagged releases
Reproduction readiness
Setup required
Dependencies pinned, manual setup needed
- butspeechfit/eend has requirements.txt but requires manual environment setup.
- Last push was 489 days ago, so expect possible dependency version conflicts.
- No Dockerfile, so you will set up the environment manually.
- No CI pipeline, so test coverage is unknown.
Quick start
git clone https://github.com/butspeechfit/eend.git
pip install -r requirements.txt Validation caveat
Repositories and ecosystem
Official
- BUTSpeechFIT/AMI_2speaker_subsetConfidence: High
BUTSpeechFIT/AMI_2speaker_subset
0 stars · 0 forks · Last push Nov 15, 2022 · Apache-2.0 license
Community
No additional community repositories detected yet.
Hugging Face artifacts
No direct paper-linked artifacts were found. Showing strongest curated related artifacts for faster exploration.
Datasets
- Encuva/test_multi_speaker
12 downloads · 0 likes · Updated Feb 6, 2025
Broaden dataset search
Research context
Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.
Open in HFEPXData includes links from Papers with Code ( CC-BY-SA-4.0 ).