Skip to content
implementation starting point
Benchmarks: thin evidence
Time to repro: a few days
2 risk flags
tf

Results & Benchmarks

Freshness tier: cold
Direct + Inferred Evidence

Some benchmark signal exists in the extracted evidence, but it is not structured strongly enough yet for a confident benchmark decision.

Distilling Effective Supervision from Severe Label Noise is the primary contribution described in this paper.

Use This Implementation Because…

Confidence: high

google-research/google-research is the strongest maintained implementation based on ranking signals. License is declared (Apache-2.0).

Open google-research/google-research

Reproduction Risks

  • No CI workflows detected
  • Dependency manifest is missing

Hardware Notes

Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Evidence disclosure

Evidence graph: 3 refs, 3 links.

Utility signals: depth 100/100, grounding 85/100, status high.

Implementation Comparison

Top 1 paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

google-research/google-research
best maintained
Maintenance: Active
Confidence: High
Reproducibility: Limited

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

Stars
37,832
Last push
Apr 30, 2026 (2d ago)

Risk flags

  • No CI pipeline detected
  • No tagged releases
  • No Docker setup

Best implementation now

google-research/google-research
Confidence: High
Reproducibility: Limited

Google Research

Stars: 37,832
Forks: 8,399
Last push: Apr 30, 2026
License: Apache-2.0
Official implementation from Papers with Code
Repository link is mentioned in the paper metadata
Community adoption signal (37832 stars)
License ✓
CI –
Deps –
Docker –
  • Selected google-research/google-research as the strongest maintained implementation for new work.
  • Repository activity is within the last 24 months.

Reproduction readiness

Major Work
Time to first repro: days
Last checked: May 2, 2026

Hardware requirements

  • Expect multi-day setup/compute for meaningful reproduction based on current guidance.

No dependency manifest — manual reconstruction required

  • · google-research/google-research has no requirements.txt, environment.yml, pyproject.toml, or Dockerfile.
  • · You will need to reverse-engineer dependencies from import statements in the source code.
Open google-research/google-research

Hugging Face artifacts

No direct paper-linked artifacts were found. Showing strongest curated related artifacts for faster exploration.

Models

No trustworthy model matches right now.

Search models on Hugging Face

Datasets

Broaden dataset search

arxiv:1910.00701

Spaces

No trustworthy demo spaces right now.

Search spaces on Hugging Face
Search models Search datasets Search spaces

Research context

Evaluation & Human Feedback Data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX

Need human evaluators for your AI research? Scale annotation with expert AI Trainers.

Post a Job Get a Quote