Comparison
chatgpt-plugin-eval vs awesome-ai-agents-security
Verdict
Pick chatgpt-plugin-eval if chatgpt-plugin-eval is an evaluation framework designed specifically to assess security, privacy, and safety concerns related to third-party plugins interfacing with large language models like ChatGPT; pick awesome-ai-agents-security if awesome-ai-agents-security is a curated list of open-source tools for securing autonomous AI agents, covering the security lifecycle from red teaming to runtime protection.
Markdown twin · chatgpt-plugin-eval alternatives · awesome-ai-agents-security alternatives
GraphCanon updated 2w
vs
Trust & integrity
| Signal | chatgpt-plugin-eval | awesome-ai-agents-security |
|---|---|---|
| Maintenance | Dormant (736d since push) As of 2w · github_public_v1 | Steady (58d since push) As of 2w · github_public_v1 |
| Provenance | Not a fork · Organization account As of 2w · github_public_v1 | Not a fork · Organization account As of 2w · github_public_v1 |
| OSV dependency advisories | No lockfile (source not queried) As of 1mo · osv@v1 | No lockfile (source not queried) As of 1mo · osv@v1 |
| deps.dev advisories | Not queried deps.dev@v1 | Not queried deps.dev@v1 |
| OpenSSF Scorecard | Not queried openssf-scorecard@v1 | Not queried openssf-scorecard@v1 |
Tagline
- chatgpt-plugin-eval
- Framework for Evaluating Security in LLM Plugin Ecosystems
- awesome-ai-agents-security
- A curated list of open-source tools and resources for securing autonomous AI agents.
Stars
- chatgpt-plugin-eval
- 29
- awesome-ai-agents-security
- 59
Forks
- chatgpt-plugin-eval
- 7
- awesome-ai-agents-security
- 74
Open issues
- chatgpt-plugin-eval
- 1
- awesome-ai-agents-security
- 61
Language
- chatgpt-plugin-eval
- HTML
- awesome-ai-agents-security
- -
Adopt for
- chatgpt-plugin-eval
- chatgpt-plugin-eval is an evaluation framework designed specifically to assess security, privacy, and safety concerns related to third-party plugins interfacing with large language models like ChatGPT.
- awesome-ai-agents-security
- awesome-ai-agents-security is a curated list of open-source tools for securing autonomous AI agents, covering the security lifecycle from red teaming to runtime protection.
Persona
- chatgpt-plugin-eval
- -
- awesome-ai-agents-security
- -
Runtime
- chatgpt-plugin-eval
- -
- awesome-ai-agents-security
- -
License
- chatgpt-plugin-eval
- The license information for chatgpt-plugin-eval is unknown.
- awesome-ai-agents-security
- Other
Last pushed
- chatgpt-plugin-eval
- Jul 29, 2024
- awesome-ai-agents-security
- Jun 12, 2026
Categories
- chatgpt-plugin-eval
- Evaluation & Observability
- awesome-ai-agents-security
- AI Agents, Evaluation & Observability
Trust and health
Maintenance
- chatgpt-plugin-eval
- Dormant (18%)
- awesome-ai-agents-security
- Steady (60%)
Days since push
- chatgpt-plugin-eval
- 736d
- awesome-ai-agents-security
- 58d
Open issues (now)
- chatgpt-plugin-eval
- 1
- awesome-ai-agents-security
- 61
Full report
- chatgpt-plugin-eval
- Trust report
- awesome-ai-agents-security
- Trust report
Choose chatgpt-plugin-eval if…
- Tags unique to chatgpt-plugin-eval: chatgpt, llm-plugins, privacy, security.
- - When evaluating the security risks of integrating third-party services into your LLM platform through plugins
- Leaner open-issue backlog (1).
When NOT to use chatgpt-plugin-eval
- - In cases where only generic, high-level security guidance is required without an in-depth framework analysis
- - When the primary focus is on improving performance metrics rather than addressing specific security and privacy concerns of LLM plugins
Choose awesome-ai-agents-security if…
- Tags unique to awesome-ai-agents-security: ai-agents, ai-security, autonomous-agents, awesome-list.
- Also covers AI Agents.
- When needing a comprehensive overview of open-source tools for securing autonomous AI agents across different phases such as red teaming and runtime protection
When NOT to use awesome-ai-agents-security
- When you require real-time threat intelligence feeds, which are not provided by this repository's static resource lists
- For organizations focusing on proprietary tools and resources that prefer not to use open-source solutions for their AI agents' security lifecycle management
Explore
Sources
Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.
- GitHub stars (llm-platform-security/chatgpt-plugin-eval) · observed Aug 5, 2026
- GitHub forks (llm-platform-security/chatgpt-plugin-eval) · observed Aug 5, 2026
- Last push (llm-platform-security/chatgpt-plugin-eval) · observed Jul 29, 2024
- License file (unknown) · observed Aug 5, 2026
- Decision facts (enrichment) · observed Jul 17, 2026
- Trust scan (lockfile / OSV) · observed Jul 11, 2026
- GitHub stars (ProjectRecon/awesome-ai-agents-security) · observed Aug 9, 2026
- GitHub forks (ProjectRecon/awesome-ai-agents-security) · observed Aug 9, 2026
- Last push (ProjectRecon/awesome-ai-agents-security) · observed Jun 12, 2026
- License file (Other) · observed Aug 9, 2026
- Decision facts (enrichment) · observed Jul 16, 2026
- Trust scan (lockfile / OSV) · observed Jul 15, 2026
GitHub stars on cards: chatgpt-plugin-eval 29 · awesome-ai-agents-security 59 (synced Aug 5, 2026).
Common questions
- What is the difference between chatgpt-plugin-eval and awesome-ai-agents-security?
- chatgpt-plugin-eval: Framework for Evaluating Security in LLM Plugin Ecosystems. awesome-ai-agents-security: A curated list of open-source tools and resources for securing autonomous AI agents.. See the comparison table for live GitHub stats and shared categories.
- When should I choose chatgpt-plugin-eval over awesome-ai-agents-security?
- Choose chatgpt-plugin-eval over awesome-ai-agents-security when Tags unique to chatgpt-plugin-eval: chatgpt, llm-plugins, privacy, security; - When evaluating the security risks of integrating third-party services into your LLM platform through plugins; Leaner open-issue backlog (1).
- When should I choose awesome-ai-agents-security over chatgpt-plugin-eval?
- Choose awesome-ai-agents-security over chatgpt-plugin-eval when Tags unique to awesome-ai-agents-security: ai-agents, ai-security, autonomous-agents, awesome-list; Also covers AI Agents; When needing a comprehensive overview of open-source tools for securing autonomous AI agents across different phases such as red teaming and runtime protection.
- When should I avoid chatgpt-plugin-eval?
- - In cases where only generic, high-level security guidance is required without an in-depth framework analysis - When the primary focus is on improving performance metrics rather than addressing specific security and privacy concerns of LLM plugins
- When should I avoid awesome-ai-agents-security?
- When you require real-time threat intelligence feeds, which are not provided by this repository's static resource lists For organizations focusing on proprietary tools and resources that prefer not to use open-source solutions for their AI agents' security lifecycle management
- Is chatgpt-plugin-eval or awesome-ai-agents-security more popular on GitHub?
- awesome-ai-agents-security has more GitHub stars (59 vs 29). Stars measure visibility, not whether either tool fits your constraints.
- Are chatgpt-plugin-eval and awesome-ai-agents-security open source?
- Yes - both are open-source projects on GitHub.
- Where can I find alternatives to chatgpt-plugin-eval or awesome-ai-agents-security?
- GraphCanon lists graph-backed alternatives at chatgpt-plugin-eval alternatives and awesome-ai-agents-security alternatives (chatgpt-plugin-eval markdown twin, awesome-ai-agents-security markdown twin), ranked by typed relationship edges rather than popularity votes.
- Is there a machine-readable version of this comparison?
- Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
- Which is better maintained, chatgpt-plugin-eval or awesome-ai-agents-security?
- chatgpt-plugin-eval: Dormant. awesome-ai-agents-security: Steady. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
- Where are the full trust reports for chatgpt-plugin-eval and awesome-ai-agents-security?
- GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: chatgpt-plugin-eval trust report; awesome-ai-agents-security trust report.