Results and benchmarks
Why Transformers Need Adam: A Hessian Perspective presents a transformer method.
Benchmark evidence is limited
Evidence graph: 3 refs, 3 links.
Utility signals: depth 65/100, grounding 75/100, status medium.
Implementation
Historical official implementation (not recommended for new builds)
Only a historical official implementation is available
Use with caution for new projects; verify against current tooling and maintained community alternatives.
zyushun/hessian-spectrum · 65 stars · Last push Mar 11, 2025
huggingface/pytorch-image-models is the closest maintained adjacent implementation (Matches contextual method/domain keyword: transformer). It is not paper-verified; validate algorithm and evaluation setup against the paper before trusting reported metrics. Community adoption signal: 37089 GitHub stars.
Open zyushun/hessian-spectrum- Adjacent implementations are not paper-verified
- Recommended repository is adjacent and not paper-verified.
- No direct maintained implementation is currently verified.
- Only historical official repository was found: zyushun/hessian-spectrum.
- No maintained paper-verified implementation met reliability thresholds.
Compare implementation paths
Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.
- Maintenance
- Stale
- Confidence
- High
- Reproducibility
- Limited
- Stars
- 65
- Last push
- Mar 11, 2025 (532d)
Official implementation from Papers with Code · Repository link is mentioned in the paper metadata
- No push in 12+ months
- No CI pipeline detected
- No tagged releases
- Maintenance
- Stale
- Confidence
- Low
- Reproducibility
- Limited
- Stars
- 460
- Last push
- May 13, 2025 (470d)
Community adoption signal (460 stars)
- No push in 12+ months
- No CI pipeline detected
- No tagged releases
Reproduction readiness
Major work
No dependency manifest, manual reconstruction required
- zyushun/hessian-spectrum has no requirements.txt, environment.yml, pyproject.toml, or Dockerfile.
- You will need to reverse-engineer dependencies from import statements in the source code.
- Last push was 532 days ago.
Hardware requirements
- Expect multi-day setup/compute for meaningful reproduction based on current guidance.
Validation caveat
Framework baselines
- PyTorch Adam optimizer docs
Reference implementation of Adam in PyTorch.
- Optax Adam optimizer docs
JAX/Flax baseline for Adam variants.
- Keras Adam optimizer docs
TensorFlow/Keras baseline for Adam.
- Hugging Face Transformers training guide
Modern transformer training baseline.
Repositories and ecosystem
Closest related implementations
These are not paper-verified. Use them as reference points when no direct implementation is available.
- huggingface/pytorch-image-models Adjacent · Confidence: Medium · 37,089 stars
Matches contextual method/domain keyword: transformer
- lucidrains/x-transformers Adjacent · Confidence: Medium · 5,941 stars
Matches contextual method/domain keyword: transformer
No additional verified repositories beyond the primary recommendation.
These repositories had low-confidence matching signals and are hidden by default.
- zyushun/adam-mini
Confidence: Low · 460 stars
Hugging Face artifacts
No trustworthy direct or curated related Hugging Face artifacts were found yet. Use targeted searches to quickly locate candidate models, datasets, and demos.
Tip: start with models, then check datasets and spaces if you need evaluation data or demos.
Research context
Tasks
None detected
Methods
Transformer, Stochastic optimization
Domains
None detected
Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.
Open in HFEPXJump to Paper2Code search queries derived from this paper's research context.
Data includes links from Papers with Code ( CC-BY-SA-4.0 ).