GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression

Q: What is the best open-source implementation of "GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression"?

The best maintained implementation is recursal/GoldFinch-paper with 46 stars on GitHub. Confidence: high. Reproducibility: Limited.

Q: How reproducible is "GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression"?

Estimated time to first reproduction: a few days. Risk flags: No CI workflows detected, Dependency manifest is missing. Start with recursal/GoldFinch-paper and validate setup instructions in README.

Q: Are there pretrained models available for "GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression"?

Yes, 1 Hugging Face model found. The top result is recursal/GoldFinch-paper with 0 downloads.

Q: What framework is used to implement "GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression"?

The primary implementation uses pytorch.

Published: Jul 1, 2024

Best maintained implementation now

Evidence: Direct

Domain fit: AI-core

Verified repos: 2

Top repo stars: 46

Core AI workload signals detected from paper context and implementation/artifact evidence.

Framework: pytorch

Time to first repro: a few days

2 risk flags

arXiv PDF

Technical details

Canonical key: arxiv-2407.12077

Cache status: Stale (SWR served)

Generated at: Jun 17, 2026, 3:54 AM

Artifact coverage: direct

HF provider: ok (token)

PWC source used: Yes

LLM status: not_generated

LLM model: n/a

LLM generated: Unknown

LLM content type: n/a

HF policy: hf-relevance-v27

implementation starting point

Benchmarks: missing

Time to repro: a few days

2 risk flags

pytorch

Results & Benchmarks

Freshness tier: cold

Direct + Inferred Evidence

No concrete benchmark grounding is available yet. Treat the page as context or an implementation starting point only.

GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression presents a transformer method.

Use This Implementation Because…

Confidence: high

recursal/GoldFinch-paper is the strongest maintained implementation based on ranking signals. License is declared (Apache-2.0).

Open recursal/GoldFinch-paper

Reproduction Risks

No CI workflows detected
Dependency manifest is missing

Hardware Notes

Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Evidence disclosure

Evidence graph: 4 refs, 4 links.

Utility signals: depth 65/100, grounding 85/100, status medium.

Implementation Comparison

Top 2 paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

recursal/GoldFinch-paper

best maintained

Maintenance: Stale

Confidence: High

Reproducibility: Limited

Official implementation from Papers with Code · Partial overlap with paper title keywords

Stars: 46
Last push: Jul 20, 2024 (698d ago)

Risk flags

No push in 12+ months
No CI pipeline detected
No tagged releases

SmerkyG/GoldFinch-paper

historical official

Maintenance: Stale risk

Confidence: High

Reproducibility: Limited

Official implementation from Papers with Code · Partial overlap with paper title keywords

Stars: 13
Last push: Dec 9, 2025 (191d ago)

Risk flags

No CI pipeline detected
No tagged releases
No Docker setup

Best implementation now

recursal/GoldFinch-paper

Confidence: High

Reproducibility: Limited

GoldFinch and other hybrid transformer components

Stars: 46

Forks: 2

Last push: Jul 20, 2024

License: Apache-2.0

Official implementation from Papers with Code

Partial overlap with paper title keywords

Community adoption signal (46 stars)

License ✓

CI –

Deps –

Docker –

Selected recursal/GoldFinch-paper as the strongest maintained implementation for new work.
Repository activity is within the last 24 months.
Official repository is preserved separately as historical context.

Historical official implementation

Preserved for provenance. Not recommended as the default path for new builds.

SmerkyG/GoldFinch-paper

Stars: 13

Last push: Dec 9, 2025

Reproduction readiness

Major Work

Time to first repro: days

Last checked: Jun 17, 2026

Hardware requirements

Expect multi-day setup/compute for meaningful reproduction based on current guidance.

No dependency manifest — manual reconstruction required

· recursal/GoldFinch-paper has no requirements.txt, environment.yml, pyproject.toml, or Dockerfile.
· You will need to reverse-engineer dependencies from import statements in the source code.
· Last push was 698 days ago.

Open recursal/GoldFinch-paper

No benchmark numbers could be verified. You will not be able to validate reproduction correctness against published numbers.