Skip to content
OpenTrain AIFor AI Companies

AD-LLM: Benchmarking Large Language Models for Anomaly Detection

Published Dec 1, 2024
arXiv PDF
Researcher verdict
Starting point
Use as implementation starting point
Benchmark evidence
Thin evidence
Verify before relying
Time to first repro
A few hours
Fast first run
Risk flags
0
None detected

Results and benchmarks

Freshness tier: cold
AD-LLM: Benchmarking Large Language Models for Anomaly Detection is the primary contribution described in this paper.
Task Dataset Metric Value Source
Natural language processing AG News “Normal Only” 552 paper-derived

Audit each benchmark finding before selecting an implementation path. Evidence refs map to the disclosure below.

Implementation

Best maintained implementation now

Recommended
Confidence: Medium
Reproducibility: Strong
yzhao062/pyod

A Python library for anomaly detection across tabular, time series, graph, text, image, and audio data. 60+ detectors, benchmark-backed ADEngine orchestration, and an agentic workflow for AI agents.

9,977 stars · 1,498 forks · Last push Aug 19, 2026 · BSD-2-Clause license

  • License
  • CI
  • Dependencies
  • Docker

Matched via arXiv identifier search · Strong overlap with paper title keywords · Community adoption signal (9977 stars)

Why this implementation
Confidence: medium

yzhao062/pyod is the best available implementation candidate based on ranking signals, but recommendation confidence is not yet high. CI workflows are present. License is declared (BSD-2-Clause).

Open yzhao062/pyod
Reproduction risks
  • No repository-level red flags were detected, but paper-specific preprocessing and hyperparameter details may still be under-specified.
  • Selected yzhao062/pyod as the strongest maintained implementation for new work.
  • Includes CI workflow signals.
  • Includes dependency/environment manifest signals.
  • Repository activity is within the last 24 months.

Compare implementation paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

usc-fortis/ad-llm
historical official
Maintenance
Stale risk
Confidence
High
Reproducibility
Limited
Stars
45
Last push
Oct 9, 2025 (321d)

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

  • No CI pipeline detected
  • No tagged releases
  • No Docker setup
yzhao062/pyod
best maintained
Maintenance
Active
Confidence
Medium
Reproducibility
Strong
Stars
9,977
Last push
Aug 19, 2026 (7d)

Matched via arXiv identifier search · Strong overlap with paper title keywords

  • No Docker setup
USC-FORTIS/AD-LLM
alternative
Maintenance
Stale risk
Confidence
Medium
Reproducibility
Limited
Stars
45
Last push
Oct 9, 2025 (321d)

Matched via arXiv identifier search · Strong overlap with paper title keywords

  • No CI pipeline detected
  • No tagged releases
  • No Docker setup

Reproduction readiness

Time to first repro: hours
Last checked: Aug 25, 2026

Ready to run

Ready to reproduce

  • Clone yzhao062/pyod and install dependencies from pyproject.toml.
  • CI pipeline detected, so automated tests are in place.
  • Last updated 7 days ago.
Open yzhao062/pyod

Quick start

git clone https://github.com/yzhao062/pyod.git
pip install -e .

Repositories and ecosystem

Official

No additional official repositories detected.

Community

  • USC-FORTIS/AD-LLM
    Confidence: Medium

    [ACL Findings 2025] A benchmark for anomaly detection using large language models. It supports zero-shot detection, data augmentation, and model selection, with scripts and data for GPT-4 and Llama experiments.

    45 stars · 9 forks · Last push Oct 9, 2025 · MIT license

Hugging Face artifacts

No direct paper-linked artifacts were found. Showing strongest curated related artifacts for faster exploration.

Models

Curated Related

Broaden model search

Transformer Natural language processing Transformer Natural Language Processing Natural language processing

Datasets

Curated Related

Broaden dataset search

Transformer Natural language processing dataset Natural language processing dataset

Spaces

No trustworthy spaces matches right now.

Search spaces on Hugging Face

Research context

Tasks

Natural language processing

Methods

Transformer

Domains

Natural Language Processing, Large Language Models

Evaluation and human feedback data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX
Explore similar papers

Jump to Paper2Code search queries derived from this paper's research context.

Natural language processing Transformer Natural Language Processing Large Language Models

Data includes links from Papers with Code ( CC-BY-SA-4.0 ).