Skip to content
implementation starting point
Benchmarks: thin evidence
Time to repro: a few hours
1 risk flag
pytorch

Results & Benchmarks

Freshness tier: cold
Direct + Inferred Evidence
Instruction tuning
Pick & Place
Seq2Seq
0.0
Source: paper fulltext

Benchmark evidence drill-down

1 findings

Audit each benchmark finding before selecting an implementation path. Evidence refs map to the disclosure section below.

Task Dataset Metric Value Source Evidence refs
Instruction tuning Pick & Place Seq2Seq 0.0 paper-derived No explicit refs

ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks focuses on instruction tuning.

Use This Implementation Because…

Confidence: high

askforalfred/alfred is the strongest maintained implementation based on ranking signals. License is declared (MIT). Dependency/environment manifests are present.

Open askforalfred/alfred

Reproduction Risks

  • No CI workflows detected
Evidence disclosure

Evidence graph: 4 refs, 4 links.

Utility signals: depth 90/100, grounding 95/100, status high.

Implementation Comparison

Top 3 paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

askforalfred/alfred
best maintained
Maintenance: Recently updated
Confidence: High
Reproducibility: Moderate

Official implementation from Papers with Code · Matched via arXiv identifier search

Stars
517
Last push
Feb 5, 2026 (135d ago)
DockerfileDependencies

Risk flags

  • No CI pipeline detected
  • No tagged releases
alfworld/alfworld
alternative
Maintenance: Recently updated
Confidence: Low
Reproducibility: Moderate

Matched via arXiv identifier search · Community adoption signal (770 stars)

Stars
770
Last push
Feb 8, 2026 (132d ago)
DockerfileReleasesDependencies

Risk flags

  • No CI pipeline detected
  • Low confidence match
alexpashevich/E.T.
alternative
Maintenance: Stale
Confidence: Low
Reproducibility: Moderate

Community adoption signal (93 stars) · Repository appears stale (>24 months since last push)

Stars
93
Last push
Jul 11, 2023 (1075d ago)
Dependencies

Risk flags

  • No push in 12+ months
  • No CI pipeline detected
  • No tagged releases

Best implementation now

askforalfred/alfred
Confidence: High
Reproducibility: Moderate

ALFRED - A Benchmark for Interpreting Grounded Instructions for Everyday Tasks

Stars: 517
Forks: 104
Last push: Feb 5, 2026
License: MIT
Official implementation from Papers with Code
Matched via arXiv identifier search
Strong overlap with paper title keywords
Community adoption signal (517 stars)
License ✓
CI –
Deps ✓
Docker ✓
  • Selected askforalfred/alfred as the strongest maintained implementation for new work.
  • Includes dependency/environment manifest signals.
  • Repository activity is within the last 24 months.

Reproduction readiness

Ready to Run
Time to first repro: hours
Last checked: Jun 14, 2026

Ready to reproduce

  • · Clone askforalfred/alfred and install dependencies from requirements.txt.
  • · Dockerfile available for containerized reproduction.
  • · Last updated 135 days ago.
Open askforalfred/alfred

Quick start

git clone https://github.com/askforalfred/alfred.git
pip install -r requirements.txt

Additional implementations

No additional verified repositories beyond the primary recommendation.

These repositories had low-confidence matching signals and are hidden by default.

Hugging Face artifacts

No direct paper-linked artifacts were found. Showing strongest curated related artifacts for faster exploration.

Datasets

No trustworthy dataset matches right now.

Search datasets on Hugging Face

Spaces

No trustworthy demo spaces right now.

Search spaces on Hugging Face
Search models Search datasets Search spaces

Research context

Tasks

Instruction tuning

Methods

Transformer

Domains

Large Language Models

Evaluation & Human Feedback Data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX

Explore Similar Papers

Jump to Paper2Code search queries derived from this paper's research context.

Instruction tuning Transformer Large Language Models

Need human evaluators for your AI research? Scale annotation with expert AI Trainers.

Post a Job Get a Quote