Skip to content
implementation starting point
Benchmarks: thin evidence
Time to repro: a few days
1 risk flag
none

Results & Benchmarks

Freshness tier: cold
Direct + Inferred Evidence

Some benchmark signal exists in the extracted evidence, but it is not structured strongly enough yet for a confident benchmark decision.

Assessing Project-Level Fine-Tuning of ML4SE Models is the primary contribution described in this paper.

Use This Implementation Because…

Confidence: low

Only historical official repository was found (JetBrains-Research/fine-tuning-ml-models).

Open JetBrains-Research/fine-tuning-ml-models

Reproduction Risks

  • Only historical official implementation is available
  • No direct maintained implementation is currently verified.

Hardware Notes

Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Evidence disclosure

Evidence graph: 2 refs, 1 links.

Utility signals: depth 95/100, grounding 68/100, status medium.

Implementation Comparison

Top 1 paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

Maintenance: Stale
Confidence: Medium
Reproducibility: Strong

Official implementation from Papers with Code · Strong overlap with paper title keywords

Stars
6
Last push
Apr 21, 2022 (1522d ago)
CIDependencies

Risk flags

  • No push in 12+ months
  • No tagged releases
  • No Docker setup

Best implementation now

Only a historical official implementation is available.

Use with caution for new projects; verify against current tooling and maintained community alternatives.

JetBrains-Research/fine-tuning-ml-models
Historical official
Stars: 6
Last push: Apr 21, 2022
  • Only historical official repository was found: JetBrains-Research/fine-tuning-ml-models.
  • No maintained paper-verified implementation met reliability thresholds.

Reproduction readiness

Setup Required
Time to first repro: days
Last checked: Jun 18, 2026

Hardware requirements

  • Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Dependencies pinned, manual setup needed

  • · JetBrains-Research/fine-tuning-ml-models has requirements.txt but requires manual environment setup.
  • · Last push was 1522 days ago — expect possible dependency version conflicts.
  • · No Dockerfile — you will set up the environment manually.
Open JetBrains-Research/fine-tuning-ml-models

Quick start

git clone https://github.com/JetBrains-Research/fine-tuning-ml-models.git
pip install -r requirements.txt

Hugging Face artifacts

No trustworthy direct or curated related Hugging Face artifacts were found yet.

Continue with targeted Hugging Face searches derived from the paper title and method context:

Tip: start with models, then check datasets/spaces if you need evaluation data or demos.

Direct artifact matches are currently sparse. Use targeted Hugging Face searches to quickly locate candidate models, datasets, and demos.

Research context

Evaluation & Human Feedback Data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX

Need human evaluators for your AI research? Scale annotation with expert AI Trainers.