--- title: "awesome-llm-security vs CipherChat" type: "comparison" canonical_url: "https://www.graphcanon.com/compare/corca-ai-awesome-llm-security-vs-robustnlp-cipherchat" tools: ["corca-ai-awesome-llm-security", "robustnlp-cipherchat"] --- # awesome-llm-security vs CipherChat *GraphCanon updated Aug 6, 2026* ## Verdict Pick awesome-llm-security if awesome LLM Security is a curated list of resources related to the security aspects of large language models. It covers various attack methodologies, defenses, and platform security through papers, benchmarks, tools, and; pick CipherChat if assess LLM safety alignment on non-natural texts like ciphers. [awesome-llm-security](https://github.com/corca-ai/awesome-llm-security) reports 1.7k GitHub stars, 312 forks, and 173 open issues, last pushed Aug 20, 2025. [CipherChat](https://github.com/RobustNLP/CipherChat) has 628 stars, 68 forks, and 0 open issues, last pushed Oct 9, 2025. Figures are from public GitHub metadata via [awesome-llm-security's repository](https://github.com/corca-ai/awesome-llm-security) and [CipherChat's repository](https://github.com/RobustNLP/CipherChat). | | [awesome-llm-security](/tools/corca-ai-awesome-llm-security.md) | [CipherChat](/tools/robustnlp-cipherchat.md) | | --- | --- | --- | | Tagline | A curation of tools, documents and projects about LLM Security | A framework to assess safety alignment generalization in LLMs for non-natural languages | | Stars | 1,672 | 628 | | Forks | 312 | 68 | | Open issues | 173 | 0 | | Language | - | Python | | Adopt for | Awesome LLM Security is a curated list of resources related to the security aspects of large language models. It covers various attack methodologies, defenses, and platform security through papers, benchmarks, tools, and | Assess LLM safety alignment on non-natural texts like ciphers. | | Persona | - | - | | Runtime | - | - | | License | - | MIT | | Categories | Evaluation & Observability | Evaluation & Observability, Model Training | ## Trust and health _Sourced signals - not a safety guarantee. No winner column._ | | [awesome-llm-security](/tools/corca-ai-awesome-llm-security.md) | [CipherChat](/tools/robustnlp-cipherchat.md) | | --- | --- | --- | | Days since push | 351d | 299d | | Open issues (now) | 173 | 0 | | Full report | [trust report](/tools/corca-ai-awesome-llm-security/trust.md) | [trust report](/tools/robustnlp-cipherchat/trust.md) | ## Decision facts: awesome-llm-security - **Hosting:** unknown - **Pricing:** freemium - As an open-source project without defined pricing models, its use is generally free under the terms of its license (license details are not provided). - **Adopt for:** Awesome LLM Security is a curated list of resources related to the security aspects of large language models. It covers various attack methodologies, defenses, and platform security through papers, benchmarks, tools, and ## Decision facts: CipherChat - **Adopt for:** Assess LLM safety alignment on non-natural texts like ciphers. ## Choose when ### Choose awesome-llm-security if… - Pricing: As an open-source project without defined pricing models, its use is generally free under the terms of its license (license details are not provided).. - Tags unique to awesome-llm-security: awesome-list, llm, security. - When you are specifically looking for detailed information on both white-box and black-box attacks targeted at Large Language Models (LLMs), which 'awesome-llm-security' comprehensively catalogs. ### Choose CipherChat if… - Tags unique to CipherChat: alignment, cipher analysis, llm-evaluation, safety alignment. - Also covers Model Training. - Need to evaluate how well an LLM's safety aligns when processing encrypted or encoded inputs ## When NOT to use awesome-llm-security - When your primary interest is in general software security or vulnerabilities unrelated to language models, since 'awesome-llm-security' zeroes in on attack vectors specifically for LLMs. - If you are solely interested in tools and methods that are not publicly discussed or peer-reviewed; the repository focuses on documented approaches within reputable academic publications. ## When NOT to use CipherChat - Looking for direct interaction with natural human language without encryption needs - Seeking tools that focus on typical text analysis for common languages like English, Spanish ## Common questions ### What is the difference between awesome-llm-security and CipherChat? awesome-llm-security: A curation of tools, documents and projects about LLM Security. CipherChat: A framework to assess safety alignment generalization in LLMs for non-natural languages. See the comparison table for live GitHub stats and shared categories. ### When should I choose awesome-llm-security over CipherChat? Choose awesome-llm-security over CipherChat when Pricing: As an open-source project without defined pricing models, its use is generally free under the terms of its license (license details are not provided).; Tags unique to awesome-llm-security: awesome-list, llm, security; When you are specifically looking for detailed information on both white-box and black-box attacks targeted at Large Language Models (LLMs), which 'awesome-llm-security' comprehensively catalogs. ### When should I choose CipherChat over awesome-llm-security? Choose CipherChat over awesome-llm-security when Tags unique to CipherChat: alignment, cipher analysis, llm-evaluation, safety alignment; Also covers Model Training; Need to evaluate how well an LLM's safety aligns when processing encrypted or encoded inputs. ### When should I avoid awesome-llm-security? When your primary interest is in general software security or vulnerabilities unrelated to language models, since 'awesome-llm-security' zeroes in on attack vectors specifically for LLMs. If you are solely interested in tools and methods that are not publicly discussed or peer-reviewed; the repository focuses on documented approaches within reputable academic publications. ### When should I avoid CipherChat? Looking for direct interaction with natural human language without encryption needs Seeking tools that focus on typical text analysis for common languages like English, Spanish ### Is awesome-llm-security or CipherChat more popular on GitHub? awesome-llm-security has more GitHub stars (1,672 vs 628). Stars measure visibility, not whether either tool fits your constraints. ### Are awesome-llm-security and CipherChat open source? Yes - both are open-source projects on GitHub. ### Where can I find alternatives to awesome-llm-security or CipherChat? GraphCanon lists graph-backed alternatives at [awesome-llm-security alternatives](/tools/corca-ai-awesome-llm-security/alternatives) and [CipherChat alternatives](/tools/robustnlp-cipherchat/alternatives) ([awesome-llm-security markdown twin](/tools/corca-ai-awesome-llm-security/alternatives.md), [CipherChat markdown twin](/tools/robustnlp-cipherchat/alternatives.md)), ranked by typed relationship edges rather than popularity votes. ### Is there a machine-readable version of this comparison? Yes. The markdown twin at [this comparison](/compare/corca-ai-awesome-llm-security-vs-robustnlp-cipherchat.md) mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers. ### Which is better maintained, awesome-llm-security or CipherChat? awesome-llm-security: Slowing. CipherChat: Slowing. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance. ### Where are the full trust reports for awesome-llm-security and CipherChat? GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: [awesome-llm-security trust report](/tools/corca-ai-awesome-llm-security/trust); [CipherChat trust report](/tools/robustnlp-cipherchat/trust). --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/graph?tool=corca-ai-awesome-llm-security`](/api/graphcanon/graph?tool=corca-ai-awesome-llm-security) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_