Results and benchmarks
Can Foundation Models Wrangle Your Data? is the primary contribution described in this paper.
Benchmark evidence is limited
Evidence graph: 3 refs, 3 links.
Utility signals: depth 100/100, grounding 85/100, status high.
Implementation
Historical official implementation (not recommended for new builds)
Only a historical official implementation is available
Use with caution for new projects; verify against current tooling and maintained community alternatives.
hazyresearch/fm_data_tasks · 112 stars · Last push May 15, 2023
fminference/flexgen is the closest maintained adjacent implementation (Community adoption signal (9355 stars)). It is not paper-verified; validate algorithm and evaluation setup against the paper before trusting reported metrics. Community adoption signal: 9355 GitHub stars.
Open hazyresearch/fm_data_tasks- Adjacent implementations are not paper-verified
- Recommended repository is adjacent and not paper-verified.
- Adjacent implementation match confidence is low.
- No direct maintained implementation is currently verified.
- Only historical official repository was found: hazyresearch/fm_data_tasks.
- No maintained paper-verified implementation met reliability thresholds.
Reproduction readiness
Setup required
Dependencies pinned, manual setup needed
- hazyresearch/fm_data_tasks has pyproject.toml but requires manual environment setup.
- Last push was 1198 days ago, so expect possible dependency version conflicts.
- No Dockerfile, so you will set up the environment manually.
- No CI pipeline, so test coverage is unknown.
Hardware requirements
- Expect multi-day setup/compute for meaningful reproduction based on current guidance.
Quick start
git clone https://github.com/hazyresearch/fm_data_tasks.git
pip install -e . Repositories and ecosystem
Closest related implementations
These are not paper-verified. Use them as reference points when no direct implementation is available.
- fminference/flexgen Adjacent · Confidence: Low · 9,355 stars
Community adoption signal (9355 stars)
No additional verified repositories beyond the primary recommendation.
Hugging Face artifacts
No trustworthy direct or curated related Hugging Face artifacts were found yet. Use targeted searches to quickly locate candidate models, datasets, and demos.
Tip: start with models, then check datasets and spaces if you need evaluation data or demos.
Research context
Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.
Open in HFEPXData includes links from Papers with Code ( CC-BY-SA-4.0 ).