Skip to content
OpenTrain AIFor AI Companies

Multi-Speaker and Wide-Band Simulated Conversations as Training Data for End-to-End Neural Diarization

Federico Landini, Mireia Diez, Alicia Lozano-Diez, Lukáš BurgetPublished Nov 12, 2022
arXiv PDF
Researcher verdict
Starting point
Use as implementation starting point
Benchmark evidence
Missing
Not verified yet
Time to first repro
A few hours
Fast first run
Risk flags
2
Review before use

Abstract

Domain fit: AI-adjacent · Paper appears method- or tooling-adjacent to AI workflows with partial ecosystem coverage.

End-to-end diarization presents an attractive alternative to standard cascaded diarization systems because a single system can handle all aspects of the task at once. Many flavors of end-to-end models have been proposed but all of them require (so far non-existing) large amounts of annotated data for training. The compromise solution consists in generating synthetic data and the recently proposed simulated conversations (SC) have shown remarkable improvements over the original simulated mixtures (SM). In this work, we create SC with multiple speakers per conversation and show that they allow for substantially better performance than SM, also reducing the dependence on a fine-tuning stage. We also create SC with wide-band public audio sources and present an analysis on several evaluation sets. Together with this publication, we release the recipes for generating such data and models trained on public sets as well as the implementation to efficiently handle multiple speakers per conversation and an auxiliary voice activity detection loss.

Results and benchmarks

Freshness tier: cold
End-to-end diarization presents an attractive alternative to standard cascaded diarization systems because a single system can handle all aspects of the task at once.

Implementation

Best maintained implementation now

Recommended
Confidence: High
Reproducibility: Limited

BUTSpeechFIT/EEND

95 stars · 13 forks · Last push Apr 24, 2025

  • License
  • CI
  • Dependencies
  • Docker

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata · Community adoption signal (95 stars)

Why this implementation
Confidence: high

butspeechfit/eend is the strongest maintained implementation based on ranking signals. Dependency/environment manifests are present.

Open butspeechfit/eend
Reproduction risks
  • License metadata missing
  • No CI workflows detected
  • Selected butspeechfit/eend as the strongest maintained implementation for new work.
  • Includes dependency/environment manifest signals.
  • Repository activity is within the last 24 months.
  • Official repository is preserved separately as historical context.

Compare implementation paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

butspeechfit/eend
best maintained
Maintenance
Stale
Confidence
High
Reproducibility
Limited
Stars
95
Last push
Apr 24, 2025 (489d)

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

  • No push in 12+ months
  • No CI pipeline detected
  • No tagged releases
BUTSpeechFIT/EEND_dataprep
historical official
Maintenance
Stale
Confidence
High
Reproducibility
Limited
Stars
59
Last push
Mar 28, 2025 (516d)

Official implementation from Papers with Code · Community adoption signal (59 stars)

  • No push in 12+ months
  • No CI pipeline detected
  • No tagged releases
Maintenance
Stale
Confidence
High
Reproducibility
Limited
Stars
0
Last push
Nov 15, 2022 (1380d)

Official implementation from Papers with Code · Matched via arXiv identifier search

  • No push in 12+ months
  • No CI pipeline detected
  • No tagged releases

Reproduction readiness

Time to first repro: hours
Last checked: Aug 23, 2026

Setup required

Dependencies pinned, manual setup needed

  • butspeechfit/eend has requirements.txt but requires manual environment setup.
  • Last push was 489 days ago, so expect possible dependency version conflicts.
  • No Dockerfile, so you will set up the environment manually.
  • No CI pipeline, so test coverage is unknown.
Open butspeechfit/eend

Quick start

git clone https://github.com/butspeechfit/eend.git
pip install -r requirements.txt

Repositories and ecosystem

Official

Community

No additional community repositories detected yet.

Hugging Face artifacts

No direct paper-linked artifacts were found. Showing strongest curated related artifacts for faster exploration.

Models

Curated Related

Datasets

Curated Related

Spaces

Curated Related

Research context

Evaluation and human feedback data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX

Data includes links from Papers with Code ( CC-BY-SA-4.0 ).