Skip to content
OpenTrain AIFor AI Companies

RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models

Published Jan 1, 2024
arXiv PDF
Researcher verdict
Starting point
Use as implementation starting point
Benchmark evidence
Thin evidence
Verify before relying
Time to first repro
A few days
Plan setup time
Risk flags
2
Review before use

Results and benchmarks

Freshness tier: cold
RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models focuses on retrieval / indexing.
Task Dataset Metric Value Source
Summarization GPT-3.5-turbo-0613 Question Answering 75 paper-derived

Audit each benchmark finding before selecting an implementation path. Evidence refs map to the disclosure below.

Implementation

Best maintained implementation now

Recommended
Confidence: High
Reproducibility: Limited
particlemedia/ragtruth

Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"

267 stars · 35 forks · Last push Dec 2, 2024 · MIT license

  • License
  • CI
  • Dependencies
  • Docker

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata · Strong overlap with paper title keywords

Why this implementation
Confidence: high

particlemedia/ragtruth is the strongest maintained implementation based on ranking signals. License is declared (MIT).

Open particlemedia/ragtruth
Reproduction risks
  • No CI workflows detected
  • Dependency manifest is missing
  • Selected particlemedia/ragtruth as the strongest maintained implementation for new work.
  • Repository activity is within the last 24 months.

Compare implementation paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

particlemedia/ragtruth
best maintained
Maintenance
Stale
Confidence
High
Reproducibility
Limited
Stars
267
Last push
Dec 2, 2024 (631d)

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

  • No push in 12+ months
  • No CI pipeline detected
  • No Docker setup
liyan06/minicheck
alternative
Maintenance
Stale risk
Confidence
Low
Reproducibility
Moderate
Stars
218
Last push
Aug 27, 2025 (363d)

Community adoption signal (218 stars)

  • No CI pipeline detected
  • No tagged releases
  • No Docker setup
ParticleMedia/RAGTruth
alternative
Maintenance
Stale
Confidence
Medium
Reproducibility
Limited
Stars
267
Last push
Dec 2, 2024 (631d)

Matched via arXiv identifier search · Strong overlap with paper title keywords

  • No push in 12+ months
  • No CI pipeline detected
  • No Docker setup

Reproduction readiness

Time to first repro: days
Last checked: Aug 25, 2026

Major work

No dependency manifest, manual reconstruction required

  • particlemedia/ragtruth has no requirements.txt, environment.yml, pyproject.toml, or Dockerfile.
  • You will need to reverse-engineer dependencies from import statements in the source code.
  • Last push was 631 days ago.
Open particlemedia/ragtruth

Hardware requirements

  • Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Repositories and ecosystem

Official

No additional official repositories detected.

Community

  • ParticleMedia/RAGTruth
    Confidence: Medium

    Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"

    267 stars · 35 forks · Last push Dec 2, 2024 · MIT license

Hugging Face artifacts

No trustworthy direct or curated related Hugging Face artifacts were found yet. Use targeted searches to quickly locate candidate models, datasets, and demos.

Search models Search datasets Search spaces

Tip: start with models, then check datasets and spaces if you need evaluation data or demos.

Research context

Tasks

Retrieval / indexing

Methods

Transformer, Retrieval-augmented generation

Domains

Natural Language Processing, Information Retrieval

Evaluation and human feedback data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX
Explore similar papers

Jump to Paper2Code search queries derived from this paper's research context.

Retrieval / indexing Transformer Retrieval-augmented generation Natural Language Processing Information Retrieval

Data includes links from Papers with Code ( CC-BY-SA-4.0 ).