BIPIA
Enrichment pendingA benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
GraphCanon updated today · GitHub synced today
Trust & integrity
Full report- Maintenance
- Dormant (817d since push)
- As of today · Source: github_public_v1
- Provenance
- Not a fork · Organization account
- As of today · Source: github_public_v1
- Security (OSV)
- No lockfile
- As of today · Source: none
Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.
Backing
Company and funding context for Microsoft. Display-only - not part of trust score or organic ranking.
- Company
- Microsoft·GitHub org profile·today
- Employees
- 221,000·Wikidata (P1128 employees)·today
- Commercial model
- Pure OSS·GitHub org profile (public repos)·today
Overview
A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
Capability facts
- Languages
- python
Source: github.language+pyproject.toml · Jul 11, 2026
Categories
Graph entities
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Tags
README
Software requirements
Install bipia and its dependencies from source:
git clone git@github.com:microsoft/BIPIA.git
pip install .
The package has been tested and verified to work on Linux: Ubuntu 20.04.6. It is recommended to use this operating system for optimal compatibility.
Hardware requirements
For the evaluation of the robustness of LLMs to indirect prompt injection attacks, we recommend using a machine with the following specifications:
- For experiments related to API-based models (such as GPT), you can complete them on a machine without a GPU. However, you will need to set up an account's API key.
- For open-source models of 13B and below, our code has been tested on a machine with 2 V100 GPUs. For models larger than 13B, 4-8 V100 GPUs are required. If there are GPUs with better performance, such as A100 or H100, you can also use them to complete the experiments. Fine-tuning-based experiments are completed on a machine with 8 V100 GPUs.
License
This project is licensed under the license found in the LICENSE file in the root directory of this source tree. Portions of the source code are based on the evaluate project.