Skip to content
OpenTrain AIFor AI Companies
implementation starting point
Benchmarks: thin evidence
Time to repro: a few days
1 risk flag
none

Results & Benchmarks

Freshness tier: hot
Direct + Inferred Evidence

Some benchmark signal exists in the extracted evidence, but it is not structured strongly enough yet for a confident benchmark decision.

CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City Space focuses on agentic tool use.

Use This Implementation Because…

Confidence: low

tsinghua-fib-lab/CityEQA is the closest maintained adjacent implementation (Official implementation from Papers with Code). It is not paper-verified; validate algorithm and evaluation setup against the paper before trusting reported metrics. Community adoption signal: 30 GitHub stars.

Open biluyong/cityeqa

Reproduction Risks

  • Adjacent implementations are not paper-verified
  • Recommended repository is adjacent and not paper-verified.
  • Adjacent implementation match confidence is low.
  • No direct maintained implementation is currently verified.

Hardware Notes

Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Evidence disclosure

Evidence graph: 3 refs, 3 links.

Utility signals: depth 100/100, grounding 85/100, status high.

Implementation Comparison

Top 2 paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

biluyong/cityeqa
historical official
Maintenance: Stale
Confidence: High
Reproducibility: Limited

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

Stars
11
Last push
Apr 1, 2025 (488d ago)

Risk flags

  • No push in 12+ months
  • No CI pipeline detected
  • No tagged releases
tsinghua-fib-lab/CityEQA
alternative
Maintenance: Stale
Confidence: High
Reproducibility: Limited

Official implementation from Papers with Code · Community adoption signal (30 stars)

Stars
30
Last push
Feb 20, 2025 (528d ago)

Risk flags

  • No push in 12+ months
  • No CI pipeline detected
  • No tagged releases

Best implementation now

Only a historical official implementation is available.

Use with caution for new projects; verify against current tooling and maintained community alternatives.

biluyong/cityeqa
Historical official
Stars: 11
Last push: Apr 1, 2025
  • Only historical official repository was found: biluyong/cityeqa.
  • No maintained paper-verified implementation met reliability thresholds.

Reproduction readiness

Major Work
Time to first repro: days
Last checked: Jul 26, 2026

Hardware requirements

  • Expect multi-day setup/compute for meaningful reproduction based on current guidance.

No dependency manifest — manual reconstruction required

  • · biluyong/cityeqa has no requirements.txt, environment.yml, pyproject.toml, or Dockerfile.
  • · You will need to reverse-engineer dependencies from import statements in the source code.
  • · Last push was 488 days ago.
Open biluyong/cityeqa

Closest related implementations

These are not paper-verified. Use them as reference points when no direct implementation is available.

Additional implementations

Official

Community

No additional community repositories detected yet.

Hugging Face artifacts

No trustworthy direct or curated related Hugging Face artifacts were found yet.

Continue with targeted Hugging Face searches derived from the paper title and method context:

Tip: start with models, then check datasets/spaces if you need evaluation data or demos.

Direct artifact matches are currently sparse. Use targeted Hugging Face searches to quickly locate candidate models, datasets, and demos.

Search models Search datasets Search spaces

Research context

Tasks

Agentic tool use

Methods

Transformer

Domains

Large Language Models, AI Agents

Evaluation & Human Feedback Data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX

Explore Similar Papers

Jump to Paper2Code search queries derived from this paper's research context.

Agentic tool use Transformer Large Language Models AI Agents