DIG In: Evaluating Disparities in Image Generations with Indicators for Geographic Diversity

Q: How reproducible is "DIG In: Evaluating Disparities in Image Generations with Indicators for Geographic Diversity"?

Estimated time to first reproduction: a few days. Risk flags: Adjacent implementations are not paper-verified. No maintained paper-verified implementation was found; start with the closest related repositories below.

Q: What framework is used to implement "DIG In: Evaluating Disparities in Image Generations with Indicators for Geographic Diversity"?

The primary implementation uses pytorch.

Published Aug 1, 2023

arXiv PDF

Researcher verdict

Starting point

Use as implementation starting point

Benchmark evidence

Missing

Not verified yet

Time to first repro

A few days

Plan setup time

Risk flags

Review before use

Results and benchmarks

Freshness tier: cold

DIG In: Evaluating Disparities in Image Generations with Indicators for Geographic Diversity is the primary contribution described in this paper.

Benchmark evidence is limited

No concrete benchmark grounding is available yet. Treat the page as context or an implementation starting point only.

Implementation

Historical official implementation (not recommended for new builds)

Only a historical official implementation is available

Use with caution for new projects; verify against current tooling and maintained community alternatives.

facebookresearch/dig-in · 20 stars · Last push Jun 3, 2024 · Archived

Why this implementation

Confidence: low

facebookresearch/evalgim is the closest maintained adjacent implementation (Strong overlap with paper title keywords). It is not paper-verified; validate algorithm and evaluation setup against the paper before trusting reported metrics. Community adoption signal: 92 GitHub stars.

Open facebookresearch/dig-in

Reproduction risks

Adjacent implementations are not paper-verified
Recommended repository is adjacent and not paper-verified.
Adjacent implementation match confidence is low.
No direct maintained implementation is currently verified.

Only historical official repository was found: facebookresearch/dig-in.
No maintained paper-verified implementation met reliability thresholds.

Compare implementation paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

facebookresearch/dig-in

historical official

Maintenance: Archived
Confidence: High
Reproducibility: Limited
Stars: 20
Last push: Jun 3, 2024 (812d)

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

Repository archived
No push in 12+ months
No CI pipeline detected

facebookresearch/EvalGIM

alternative

Maintenance: Stale risk
Confidence: Medium
Reproducibility: Moderate
Stars: 92
Last push: Feb 5, 2026 (200d)

Matched via arXiv identifier search · Strong overlap with paper title keywords

No CI pipeline detected
No tagged releases
No Docker setup

enhansome/enhansome-cultural-nlp

alternative

Maintenance: Active
Confidence: Low
Reproducibility: Limited
Stars: 0
Last push: Aug 21, 2026 (3d)

Matched via arXiv identifier search

No tagged releases
No Docker setup
Dependency manifest missing

Reproduction readiness

Time to first repro: days

Last checked: Aug 21, 2026

Major work

Repository archived, fork required

facebookresearch/dig-in has been archived. Fork the repository before using it.
No further updates or bug fixes will be made by the original authors.

Open facebookresearch/dig-in

Hardware requirements

Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Validation caveat

No benchmark numbers could be verified. You will not be able to validate reproduction correctness against published numbers.

Repositories and ecosystem

Closest related implementations

These are not paper-verified. Use them as reference points when no direct implementation is available.

facebookresearch/evalgim Adjacent · Confidence: Low · 92 stars

Strong overlap with paper title keywords

Official

No additional official repositories detected.

Community

facebookresearch/EvalGIM
Confidence: Medium

🦾 EvalGIM (pronounced as "EvalGym") is an evaluation library for generative image models. It enables easy-to-use, reproducible automatic evaluations of text-to-image models and supports customization with user-defined metrics, datasets, and visualizations.

92 stars · 4 forks · Last push Feb 5, 2026 · NOASSERTION license

Hugging Face artifacts

No trustworthy direct or curated related Hugging Face artifacts were found yet. Use targeted searches to quickly locate candidate models, datasets, and demos.

Search models Search datasets Search spaces

Models

arxiv:2308.06198 DIG In

Datasets

arxiv:2308.06198 DIG dataset DIG In dataset

Spaces

arxiv:2308.06198 DIG demo DIG In demo

Tip: start with models, then check datasets and spaces if you need evaluation data or demos.

Research context

Tasks

None detected

Methods

None detected

Domains

Computer vision

Evaluation and human feedback data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX

Explore similar papers

Jump to Paper2Code search queries derived from this paper's research context.