Skip to content
implementation starting point
Benchmarks: missing
Time to repro: a few days
2 risk flags
pytorch

Results & Benchmarks

Freshness tier: cold
Direct + Inferred Evidence

No concrete benchmark grounding is available yet. Treat the page as context or an implementation starting point only.

"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models is the primary contribution described in this paper.

Use This Implementation Because…

Confidence: high

verazuo/jailbreak_llms is the strongest maintained implementation based on ranking signals. License is declared (MIT).

Open verazuo/jailbreak_llms

Reproduction Risks

  • No CI workflows detected
  • Dependency manifest is missing

Hardware Notes

Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Evidence disclosure

Evidence graph: 4 refs, 4 links.

Utility signals: depth 65/100, grounding 85/100, status medium.

Implementation Comparison

Top 3 paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

verazuo/jailbreak_llms
best maintained
Maintenance: Stale
Confidence: High
Reproducibility: Limited

Official implementation from Papers with Code · Repository link is mentioned in the paper metadata

Stars
3,718
Last push
Dec 24, 2024 (543d ago)

Risk flags

  • No push in 12+ months
  • No CI pipeline detected
  • No tagged releases
alexandrasouly/strongreject
alternative
Maintenance: Stale
Confidence: Low
Reproducibility: Moderate

Matched via arXiv identifier search · Community adoption signal (158 stars)

Stars
158
Last push
Nov 3, 2024 (594d ago)
Dependencies

Risk flags

  • No push in 12+ months
  • No CI pipeline detected
  • No tagged releases
TrustAIRLab/Comprehensive_Jailbreak_Assessment
alternative
Maintenance: Stale
Confidence: Low
Reproducibility: Limited

Community adoption signal (87 stars)

Stars
87
Last push
Jun 8, 2025 (377d ago)
Dependencies

Risk flags

  • No push in 12+ months
  • No CI pipeline detected
  • No tagged releases

Best implementation now

verazuo/jailbreak_llms
Confidence: High
Reproducibility: Limited

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

Stars: 3,718
Forks: 321
Last push: Dec 24, 2024
License: MIT
Official implementation from Papers with Code
Repository link is mentioned in the paper metadata
Partial overlap with paper title keywords
Community adoption signal (3718 stars)
License ✓
CI –
Deps –
Docker –
  • Selected verazuo/jailbreak_llms as the strongest maintained implementation for new work.
  • Repository activity is within the last 24 months.

Reproduction readiness

Major Work
Time to first repro: days
Last checked: Jun 20, 2026

Hardware requirements

  • Expect multi-day setup/compute for meaningful reproduction based on current guidance.

No dependency manifest — manual reconstruction required

  • · verazuo/jailbreak_llms has no requirements.txt, environment.yml, pyproject.toml, or Dockerfile.
  • · You will need to reverse-engineer dependencies from import statements in the source code.
  • · Last push was 543 days ago.
Open verazuo/jailbreak_llms

No benchmark numbers could be verified. You will not be able to validate reproduction correctness against published numbers.

Additional implementations

No additional verified repositories beyond the primary recommendation.

These repositories had low-confidence matching signals and are hidden by default.

Showing top 6 by score. 1 additional low-confidence matches are hidden.

Hugging Face artifacts

No direct paper-linked artifacts were found. Showing strongest curated related artifacts for faster exploration.

Models

Broaden model search

Transformer Natural Language Processing Transformer anything characterizing evaluating wild

Datasets

Broaden dataset search

Transformer Natural Language Processing dataset Transformer dataset anything characterizing evaluating wild dataset

Spaces

No trustworthy demo spaces right now.

Search spaces on Hugging Face
Search models Search datasets Search spaces

Research context

Tasks

None detected

Methods

Transformer

Domains

Natural Language Processing

Evaluation & Human Feedback Data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX

Explore Similar Papers

Jump to Paper2Code search queries derived from this paper's research context.

Transformer Natural Language Processing

Need human evaluators for your AI research? Scale annotation with expert AI Trainers.

Post a Job Get a Quote