Skip to content
OpenTrain AIFor AI Companies

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence

Published Apr 1, 2024
arXiv PDF
Researcher verdict
Starting point
Use as implementation starting point
Benchmark evidence
Missing
Not verified yet
Time to first repro
A few days
Plan setup time
Risk flags
2
Review before use

Results and benchmarks

Freshness tier: cold
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence is the primary contribution described in this paper.

Implementation

Best maintained implementation now

Recommended
Confidence: Medium
Reproducibility: Limited
BlinkDL/RWKV-LM

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

14,683 stars · 1,020 forks · Last push Aug 21, 2026 · Apache-2.0 license

  • License
  • CI
  • Dependencies
  • Docker

Matched via arXiv identifier search · Strong overlap with paper title keywords · Community adoption signal (14683 stars)

Why this implementation
Confidence: medium

BlinkDL/RWKV-LM is the best available implementation candidate based on ranking signals, but recommendation confidence is not yet high. License is declared (Apache-2.0).

Open BlinkDL/RWKV-LM
Reproduction risks
  • No CI workflows detected
  • Dependency manifest is missing
  • Selected BlinkDL/RWKV-LM as the strongest maintained implementation for new work.
  • Repository activity is within the last 24 months.
  • Official repository is preserved separately as historical context.

Compare implementation paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

rwkv/rwkv-infctx-trainer
historical official
Maintenance
Stale
Confidence
High
Reproducibility
Strong
Stars
149
Last push
Aug 13, 2024 (743d)

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

  • No push in 12+ months
  • No Docker setup
rwkv/rwkv-lm
alternative
Maintenance
Stale
Confidence
High
Reproducibility
Limited
Stars
62
Last push
Mar 17, 2025 (527d)

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

  • No push in 12+ months
  • No CI pipeline detected
  • No tagged releases
sustcsonglin/flash-linear-attention
alternative
Maintenance
Active
Confidence
Low
Reproducibility
Strong
Stars
5,617
Last push
Aug 23, 2026 (2d)

Community adoption signal (5617 stars)

  • No Docker setup
  • Low confidence match

Reproduction readiness

Time to first repro: days
Last checked: Aug 25, 2026

Major work

No dependency manifest, manual reconstruction required

  • BlinkDL/RWKV-LM has no requirements.txt, environment.yml, pyproject.toml, or Dockerfile.
  • You will need to reverse-engineer dependencies from import statements in the source code.
Open BlinkDL/RWKV-LM

Hardware requirements

  • Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Repositories and ecosystem

Official

  • rwkv/rwkv-lm
    Confidence: High

    RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

    62 stars · 4 forks · Last push Mar 17, 2025 · Apache-2.0 license

Community

No additional community repositories detected yet.

Hugging Face artifacts

No trustworthy direct or curated related Hugging Face artifacts were found yet. Use targeted searches to quickly locate candidate models, datasets, and demos.

Search models Search datasets Search spaces

Tip: start with models, then check datasets and spaces if you need evaluation data or demos.

Research context

Evaluation and human feedback data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX

Data includes links from Papers with Code ( CC-BY-SA-4.0 ).