{"data":{"slug":"jailbreakbench-jailbreakbench","name":"jailbreakbench","tagline":"An Open Robustness Benchmark for Jailbreaking Language Models","github_url":"https://github.com/JailbreakBench/jailbreakbench","owner":"JailbreakBench","repo":"jailbreakbench","owner_avatar_url":"https://avatars.githubusercontent.com/u/151564101?v=4","primary_language":"Python","stars":626,"forks":74,"topics":[],"archived":false,"github_pushed_at":"2025-04-04T11:30:46+00:00","maintenance_label":"Dormant","url":"https://www.graphcanon.com/tools/jailbreakbench-jailbreakbench","markdown_url":"https://www.graphcanon.com/tools/jailbreakbench-jailbreakbench.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/jailbreakbench-jailbreakbench","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=jailbreakbench-jailbreakbench","description":"JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]","homepage_url":"https://jailbreakbench.github.io","license":"MIT","open_issues":11,"watchers":6,"ai_summary":"JailbreakBench provides a benchmark to evaluate the robustness of language models against jailbreaking attacks.","readme_excerpt":"## Installation\n\nThe `jailbreakbench` package can be installed by running the following command:\n\n```bash\npip install jailbreakbench\n```\n\nOptionally, if you plan to run an attack or defense _locally_, please install [vLLM](https://docs.vllm.ai/en/latest/):\n\n```bash\npip install jailbreakbench[vllm]\n```\n\nThis repository can also be locally installed in an editable way by running the following command from the root directory of this repository:\n\n```bash\npip install -e .\n```\n\n---\n\n## License\n\nThis codebase is released under [MIT License](https://github.com/JailbreakBench/jailbreakbench/blob/main/LICENSE).","github_created_at":"2023-11-13T18:33:08+00:00","created_at":"2026-07-11T23:42:05.088241+00:00","updated_at":"2026-07-12T09:52:51.483408+00:00","categories":[{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"}],"tags":[{"slug":"jailbreaking","name":"jailbreaking"},{"slug":"language-models","name":"language-models"},{"slug":"robustness-benchmark","name":"robustness-benchmark"},{"slug":"neurips-2024-datasets-and-benchmarks-tra","name":"neurips-2024-datasets-and-benchmarks-tra"}],"trust":{"provenance":{"is_fork":false,"github_id":718270289,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-11T23:42:07.176Z","maintenance":{"label":"Dormant","score":18,"methodology":"github_public_v1","releases_90d":0,"days_since_push":463,"last_release_at":"2024-06-13T09:02:16Z"},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T23:42:07.921Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-12T09:52:42.116Z"},"languages":{"value":["python"],"source":"github.language+pyproject.toml","observed_at":"2026-07-12T09:52:42.116Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-07-12T09:52:42.116Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":null,"constraints":null,"when_to_use":[],"when_not_to_use":[],"source":"enrich:decision_facts","observed_at":"2026-07-12T09:52:51.236Z"},"constraint_facets":null,"decision_summary":[{"label":"Adopt for","value":"JailbreakBench is an open robustness benchmark specifically designed to evaluate language models against jailbreaking attacks. It aims to quantify the resilience of language models under adversarial conditions."}]}}