{"data":{"slug":"microsoft-bipia","name":"BIPIA","tagline":"Benchmark for evaluating LLM robustness to indirect prompt injection attacks","github_url":"https://github.com/microsoft/BIPIA","owner":"microsoft","repo":"BIPIA","owner_avatar_url":"https://avatars.githubusercontent.com/u/6154722?v=4","primary_language":"Python","stars":145,"forks":19,"topics":["llm-security"],"archived":false,"github_pushed_at":"2024-04-15T02:08:17+00:00","maintenance_label":"Dormant","url":"https://www.graphcanon.com/tools/microsoft-bipia","markdown_url":"https://www.graphcanon.com/tools/microsoft-bipia.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/microsoft-bipia","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=microsoft-bipia","description":"A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.","homepage_url":null,"license":"Other","open_issues":4,"watchers":5,"ai_summary":"A tool for assessing and defending against indirect prompt injection attacks on Language Models (LLMs)","readme_excerpt":"### Software requirements\nInstall bipia and its dependencies from source:\n```bash\ngit clone git@github.com:microsoft/BIPIA.git\npip install .\n```\n\nThe package has been tested and verified to work on Linux: Ubuntu 20.04.6. It is recommended to use this operating system for optimal compatibility.\n\n---\n\n### Hardware requirements\nFor the evaluation of the robustness of LLMs to indirect prompt injection attacks, we recommend using a machine with the following specifications:\n1. For experiments related to API-based models (such as GPT), you can complete them on a machine without a GPU. However, you will need to set up an account's API key.\n2. For open-source models of 13B and below, our code has been tested on a machine with 2 V100 GPUs. For models larger than 13B, 4-8 V100 GPUs are required. If there are GPUs with better performance, such as A100 or H100, you can also use them to complete the experiments. Fine-tuning-based experiments are completed on a machine with 8 V100 GPUs.\n\n---\n\n## License\nThis project is licensed under the license found in the [LICENSE](https://github.com/microsoft/BIPIA/blob/main/LICENSE) file in the root directory of this source tree. Portions of the source code are based on the evaluate project.\n\n[Microsoft Open Source Code of Conduct](https://opensource.microsoft.com/codeofconduct)","github_created_at":"2024-01-04T11:47:59+00:00","created_at":"2026-07-11T23:41:37.609155+00:00","updated_at":"2026-07-12T08:16:48.302313+00:00","categories":[{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"}],"tags":[{"slug":"benchmarking","name":"benchmarking"},{"slug":"defense-mechanisms","name":"defense-mechanisms"},{"slug":"evaluation-tool","name":"evaluation-tool"},{"slug":"indirect-prompt-injection-attacks","name":"indirect-prompt-injection-attacks"},{"slug":"llm-security","name":"llm-security"},{"slug":"prompt-injection","name":"prompt-injection"},{"slug":"python-library","name":"python-library"},{"slug":"security-testing","name":"security-testing"}],"trust":{"provenance":{"is_fork":false,"github_id":738936550,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-11T23:41:38.988Z","maintenance":{"label":"Dormant","score":18,"methodology":"github_public_v1","releases_90d":0,"days_since_push":817,"last_release_at":null},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T23:41:39.635Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-12T08:16:48.240Z"},"languages":{"value":["python"],"source":"github.language+pyproject.toml","observed_at":"2026-07-12T08:16:48.240Z"},"license_spdx":{"value":"Other","source":"github.license","observed_at":"2026-07-12T08:16:48.240Z"}}}}