SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization

Q: What is the best open-source implementation of "SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization"?

The best maintained implementation is xinghaochen/slab with 110 stars on GitHub. Confidence: high. Reproducibility: Limited.

Q: How reproducible is "SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization"?

Estimated time to first reproduction: a few days. Risk flags: License metadata missing, No CI workflows detected, Dependency manifest is missing. Start with xinghaochen/slab and validate setup instructions in README.

Q: Are there pretrained models available for "SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization"?

Yes, 1 Hugging Face model found. The top result is kernels-community/paged-attention with 860 downloads.

Q: What framework is used to implement "SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization"?

The primary implementation uses pytorch.

Published: May 1, 2024

Best maintained implementation now

Evidence: Direct

Domain fit: AI-core

Verified repos: 2

Top repo stars: 110

Core AI workload signals detected from paper context and implementation/artifact evidence.

Framework: pytorch

Time to first repro: a few days

3 risk flags

arXiv PDF

Technical details

Canonical key: arxiv-2405.11582

Cache status: Stale (SWR served)

Generated at: Jun 17, 2026, 10:59 PM

Artifact coverage: direct

HF provider: ok (token)

PWC source used: Yes

LLM status: not_generated

LLM model: n/a

LLM generated: Unknown

LLM content type: n/a

HF policy: hf-relevance-v27

implementation starting point

Benchmarks: missing

Time to repro: a few days

3 risk flags

pytorch

Results & Benchmarks

Freshness tier: cold

Direct + Inferred Evidence

No concrete benchmark grounding is available yet. Treat the page as context or an implementation starting point only.

SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization presents a transformer method.

Use This Implementation Because…

Confidence: high

xinghaochen/slab is the strongest maintained implementation based on ranking signals.

Open xinghaochen/slab

Reproduction Risks

License metadata missing
No CI workflows detected
Dependency manifest is missing

Hardware Notes

Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Evidence disclosure

Evidence graph: 4 refs, 4 links.

Utility signals: depth 65/100, grounding 85/100, status medium.

Implementation Comparison

Top 3 paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

xinghaochen/slab

best maintained

Maintenance: Stale

Confidence: High

Reproducibility: Limited

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

Stars: 110
Last push: Aug 23, 2024 (666d ago)

Releases

Risk flags

No push in 12+ months
No CI pipeline detected
No Docker setup

mindspore-lab/models

historical official

Maintenance: Unknown

Confidence: High

Reproducibility: Limited

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

Stars: 0
Last push: Unknown

Risk flags

No CI pipeline detected
No tagged releases
No Docker setup

xinghaochen/SLAB

alternative

Maintenance: Stale

Confidence: Low

Reproducibility: Limited

Strong overlap with paper title keywords · Community adoption signal (110 stars)

Stars: 110
Last push: Aug 23, 2024 (666d ago)

Releases

Risk flags

No push in 12+ months
No CI pipeline detected
No Docker setup

Best implementation now

xinghaochen/slab

Confidence: High

Reproducibility: Limited

[ICML 2024] Official PyTorch implementation of "SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization"

Stars: 110

Forks: 6

Last push: Aug 23, 2024

Official implementation from Papers with Code

Repository link is mentioned in the paper metadata

Strong overlap with paper title keywords

Community adoption signal (110 stars)

License –

CI –

Deps –

Docker –

Selected xinghaochen/slab as the strongest maintained implementation for new work.
Repository activity is within the last 24 months.
Official repository is preserved separately as historical context.

Historical official implementation

Preserved for provenance. Not recommended as the default path for new builds.

mindspore-lab/models

Reproduction readiness

Major Work

Time to first repro: days

Last checked: Jun 17, 2026

Hardware requirements

Expect multi-day setup/compute for meaningful reproduction based on current guidance.

No dependency manifest — manual reconstruction required

· xinghaochen/slab has no requirements.txt, environment.yml, pyproject.toml, or Dockerfile.
· You will need to reverse-engineer dependencies from import statements in the source code.
· Last push was 666 days ago.

Open xinghaochen/slab

No benchmark numbers could be verified. You will not be able to validate reproduction correctness against published numbers.