chatgpt-plugin-eval
Framework for Evaluating Security in LLM Plugin Ecosystems
GraphCanon updated Oct 6, 2026 · GitHub synced Oct 6, 2026
72views this month
Decision brief
chatgpt-plugin-eval is an evaluation framework designed specifically to assess security, privacy, and safety concerns related to third-party plugins interfacing with large language models like ChatGPT.
Good fit when
- - When evaluating the security risks of integrating third-party services into your LLM platform through plugins
- - If you are developing for OpenAI's plugin ecosystem and want a structured approach to mitigate potential attacks and vulnerabilities
Avoid when
- - In cases where only generic, high-level security guidance is required without an in-depth framework analysis
- - When the primary focus is on improving performance metrics rather than addressing specific security and privacy concerns of LLM plugins
- Pricing:
- freemium
Observed Jul 17, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (798d since push)
- As of Oct 6, 2026
- Provenance
- Not a fork · Organization account
- As of Oct 6, 2026
- Security (OSV)
- No lockfile
- As of Jul 11, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
git clone https://github.com/llm-platform-security/chatgpt-plugin-evalSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Introduces a systematic evaluation framework aimed at assessing security, privacy, and safety concerns associated with third-party plugins interfacing with large language models like ChatGPT.
Capability facts
- Languages
- html
Source: github.language · Oct 6, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Oct 6, 2026)
# LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT PluginsSource link
Tags
README
LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT Plugins Large language model (LLM) platforms, such as OpenAI's ChatGPT, have recently begun integrating a plugin ecosystem to interface with third party services on the internet. While these plu...
For agents
This page has a .md twin and JSON over the API.