Home/Model Training/jailbreak-evaluation

jailbreak-evaluation

Enrichment pending

controllability/jailbreak-evaluation

The jailbreak-evaluation is an easy-to-use Python package for language model jailbreak evaluation.

GitHub Website

GraphCanon updated today · GitHub synced today

Stars

Forks

Open issues

Watchers

Last push

Python Apache-2.0Created Mar 20, 2024

Trust & integrity

Full report

Maintenance: Dormant (614d since push); As of today · Source: github_public_v1
Provenance: Not a fork · Organization account; As of today · Source: github_public_v1
Security (OSV): No lockfile; As of today · Source: none

Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.

Overview

The jailbreak-evaluation is an easy-to-use Python package for language model jailbreak evaluation.

Capability facts

Languages: python
Source: github.language+pyproject.toml · Jul 11, 2026

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

OpenAI APIOpenAI API

Source: README excerpt (regex_v1, Jul 11, 2026)

You should have an OpenAI API key to use the jailbreak-evaluation, which can be obtained from [OpenAI Platfor

Source link

Python runtimePython

Source: README excerpt (regex_v1, Jul 11, 2026)

python -m pip install --upgrade pip

Source link

README

Installation

Note on PyTorch and FastChat Installation: The jailbreak-evaluation depends on PyTorch and FastChat. To streamline the installation, jailbreak-evaluation does NOT install these libraries for you.

It is recommended to use pip for installation. Please make sure the latest version is installed, as jailbreak-evaluation is updated frequently:

python -m pip install --upgrade pip

---

# Please install the PyTorch: https://pytorch.org/get-started/locally/

---

# Please install the FastChat: https://github.com/lm-sys/FastChat?tab=readme-ov-file#install

---

# Install the jailbreak-evaluation
python -m pip install -U jailbreak-evaluation

---

## Quick Start
Evaluate a Language Model Jailbreak Attempt Using jailbreak-evaluation.
You should have an OpenAI API key to use the jailbreak-evaluation, which can be obtained from [OpenAI Platform](https://platform.openai.com/api-keys).

```python
from jailbreak_evaluation import MultifacetedEvaluation

---

## License

The jailbreak-evaluation uses Apache License 2.0.