OpenTrain AI
Maintained implementation availablepytorchPretrained Models Available

KAISA: An Adaptive Second-Order Optimizer Framework for Deep Neural Networks

July 1, 2021arXiv: 2107.01739
1 repo95 stars~a few hours to reproduce
arXiv PDF

Abstract

Best Implementation

gpauloski/kfac_pytorch

Distributed K-FAC preconditioner for PyTorch

95 25 Apr 2026 MIT
License ✓
CI ✓
Deps ✓
Docker –
  • Selected gpauloski/kfac_pytorch as the strongest maintained implementation for new work.
  • Includes CI workflow signals.
  • Includes dependency/environment manifest signals.
  • Repository activity is within the last 24 months.

Reproduction Path

  1. 1

    Start with gpauloski/kfac_pytorch and validate setup instructions in README.

  2. 2

    Reproduce the baseline result with the provided defaults before modifying hyperparameters.

  3. 3

    Log exact dependency versions and runtime environment for reproducibility.

Framework baselines

Time to first repro: a few hoursNo repository-level red flags were detected, but paper-specific preprocessing and hyperparameter details may still be under-specified.

Additional Implementations

No additional verified repositories beyond the primary recommendation.

Hugging Face Artifacts

No direct paper-linked artifacts were found. Showing strongest curated related artifacts.

Curated Related

Research Context