Results and benchmarks
Fine-Tuning Language Models from Human Preferences is the primary contribution described in this paper.
Benchmark evidence is limited
Evidence graph: 3 refs, 3 links.
Utility signals: depth 65/100, grounding 75/100, status medium.
Implementation
Historical official implementation (not recommended for new builds)
Only a historical official implementation is available
Use with caution for new projects; verify against current tooling and maintained community alternatives.
openai/lm-human-preferences · 1,391 stars · Last push Jul 25, 2023 · Archived
volcengine/verl is the closest maintained adjacent implementation (Community adoption signal (23116 stars)). It is not paper-verified; validate algorithm and evaluation setup against the paper before trusting reported metrics. Community adoption signal: 23116 GitHub stars.
Open openai/lm-human-preferences- Adjacent implementations are not paper-verified
- Recommended repository is adjacent and not paper-verified.
- Adjacent implementation match confidence is low.
- No direct maintained implementation is currently verified.
- Only historical official repository was found: openai/lm-human-preferences.
- No maintained paper-verified implementation met reliability thresholds.
Compare implementation paths
Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.
- Maintenance
- Archived
- Confidence
- High
- Reproducibility
- Limited
- Stars
- 1,391
- Last push
- Jul 25, 2023 (1127d)
Official implementation from Papers with Code · Repository link is mentioned in the paper metadata
- Repository archived
- No push in 12+ months
- No CI pipeline detected
- Maintenance
- Stale
- Confidence
- Low
- Reproducibility
- Limited
- Stars
- 118
- Last push
- Dec 7, 2022 (1357d)
Community adoption signal (118 stars) · Repository appears stale (>24 months since last push)
- No push in 12+ months
- No CI pipeline detected
- No tagged releases
- Maintenance
- Stale
- Confidence
- Low
- Reproducibility
- Moderate
- Stars
- 60
- Last push
- Apr 28, 2023 (1215d)
Community adoption signal (60 stars) · Repository appears stale (>24 months since last push)
- No push in 12+ months
- No CI pipeline detected
- No tagged releases
Reproduction readiness
Major work
Repository archived, fork required
- openai/lm-human-preferences has been archived. Fork the repository before using it.
- No further updates or bug fixes will be made by the original authors.
Hardware requirements
- Expect multi-day setup/compute for meaningful reproduction based on current guidance.
Validation caveat
Repositories and ecosystem
Closest related implementations
These are not paper-verified. Use them as reference points when no direct implementation is available.
- volcengine/verl Adjacent · Confidence: Low · 23,116 stars
Community adoption signal (23116 stars)
- lvwerra/trl Adjacent · Confidence: Low · 19,147 stars
Partial overlap with paper title keywords
- huggingface/trl Adjacent · Confidence: Low · 19,143 stars
Partial overlap with paper title keywords
- carperai/trlx Adjacent · Confidence: Low · 4,754 stars
Strong overlap with paper title keywords
No additional verified repositories beyond the primary recommendation.
These repositories had low-confidence matching signals and are hidden by default.
- naver/gdc
Confidence: Low · 118 stars
- jackaduma/Alpaca-LoRA-RLHF-PyTorch
Confidence: Low · 60 stars
Hugging Face artifacts
No trustworthy direct or curated related Hugging Face artifacts were found yet. Use targeted searches to quickly locate candidate models, datasets, and demos.
Datasets
Spaces
Tip: start with models, then check datasets and spaces if you need evaluation data or demos.
Research context
Tasks
None detected
Methods
Transformer
Domains
Natural Language Processing
Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.
Open in HFEPXJump to Paper2Code search queries derived from this paper's research context.
Data includes links from Papers with Code ( CC-BY-SA-4.0 ).