{"data":{"slug":"wearetyomsmnv-awesome-llmsecops","name":"Awesome-LLMSecOps","tagline":"LLM | Agentic | Security | Operations in one github repo with good links and pictures.","github_url":"https://github.com/wearetyomsmnv/Awesome-LLMSecOps","owner":"wearetyomsmnv","repo":"Awesome-LLMSecOps","owner_avatar_url":"https://avatars.githubusercontent.com/u/129667548?v=4","primary_language":"HTML","stars":144,"forks":51,"topics":["adversarial-ml-threat-modeling","ai-agents-security","ai-red-team","ai-safety-supply-chain-security","ai-security","awesome-list","genai-security","guardrails","jailbreak","llm-red-teaming","llm-security","mlsecops","owasp-top10-llm","prompt-injection","rag-security","red-teaming","russian-ai-security","security-by-design"],"archived":false,"github_pushed_at":"2026-07-13T22:01:40+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/wearetyomsmnv-awesome-llmsecops","markdown_url":"https://www.graphcanon.com/tools/wearetyomsmnv-awesome-llmsecops.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/wearetyomsmnv-awesome-llmsecops","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=wearetyomsmnv-awesome-llmsecops","description":"LLM | Agentic | Security | Operations in one github repo with good links and pictures.","homepage_url":null,"license":null,"open_issues":8,"watchers":4,"ai_summary":null,"readme_excerpt":"

\n \"LLMSecOps\"\n

\n\n
\n\n# šŸš€ Awesome LLMSecOps \n\n\n\n\n\n\nšŸ” A curated list of awesome resources for LLMSecOps (Large Language Model Security Operations) šŸ§ \n\n### by @wearetyomsmnv and people\n\n**Architecture | Vulnerabilities | Tools | Defense | Threat Modeling | Jailbreaks | RAG Security | PoC's | Study Resources | Books | Blogs | Datasets for Testing | OPS Security | Frameworks | Best Practices | Research | Tutorials | Companies | Community Resources**\n\n
\n\n>LLM safety is a huge body of knowledge that is important and relevant to society today. The purpose of this Awesome list is to provide the community with the necessary knowledge on how to build an LLM development process - safe, as well as what threats may be encountered along the way. Everyone is welcome to contribute. \n\n> [!IMPORTANT]\n>This repository, unlike many existing repositories, emphasizes the practical implementation of security and does not provide a lot of references to arxiv in the description.\n\n
\n\n
\n\n## Architecture risks\n\n*Overview of fundamental architectural risks and challenges in LLM systems.*\n\n| Risk | Description |\n|------|-------------|\n| Recursive Pollution | LLMs can produce incorrect output with high confidence. If such output is used in training data, it can cause future LLMs to be trained on polluted data, creating a feedback loop problem. |\n| Data Debt | LLMs rely on massive datasets, often too large to thoroughly vet. This lack of transparency and control over data quality presents a significant risk. |\n| Black Box Opacity | Many critical components of LLMs are hidden in a \"black box\" controlled by foundation model providers, making it difficult for users to manage and mitigate risks effectively. |\n| Prompt Manipulation | Manipulating the input prompts can lead to unstable and unpredictable LLM behavior. This risk is similar to adversarial inputs in other ML systems. |\n| Poison in the Data | Training data can be contaminated intentionally or unintentionally, leading to compromised model integrity. This is especially problematic given the size and scope of data used in LLMs. |\n| Reproducibility Economics | The high cost of training LLMs limits reproducibility and independent verification, leading to a reliance on commercial entities and potentially unreviewed models. |\n| Model Trustworthiness | The inherent stochastic nature of LLMs and their lack of true understanding can make their output unreliable. This raises questions about whether they should be trusted in critical applications. |\n| Encoding Integrity | Data is often processed and re-represented in ways that can introduce bias and other issues. This is particularly challenging with LLMs due to their unsupervised learning nature. |\n\n
\n\n**From [Berryville Institute of Machine Learning (BIML)](https://berryvilleiml.com/docs/BIML-LLM24.pdf) paper**\n\n
\n\n## Vulnerabilities description \n#### by Giskard\n\n*Common vulnerabilities and security issues found in LLM applications.*\n\n| Vulnerability | Description |\n|---------------|-------------|\n| Hallucination and Misinformation | These vulnerabilities often manifest themselves in the generation of fabricated content or the spread of false information, which can have far-reaching consequences such as disseminating misleading content or malicious narratives. |\n| Harmful Content Generation | This vulnerability involves the creation of harmful or malicious content, including violence, hate speech, or misinformation with malicious intent, posing a threat to individuals or communities. |\n| Prompt Injection | Users manipulating input prompts to bypass content filters or override model instructions can lead to the generation of inappropriate or biased content, circumventing intended safeguards. |\n| Robustness | The lack of","github_created_at":"2024-07-31T12:26:08+00:00","created_at":"2026-07-15T10:43:07.411097+00:00","updated_at":"2026-07-15T10:43:10.212401+00:00","categories":[{"slug":"ai-agents","name":"AI Agents","url":"https://www.graphcanon.com/categories/ai-agents","markdown_url":"https://www.graphcanon.com/categories/ai-agents.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/ai-agents"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"},{"slug":"model-training","name":"Model Training","url":"https://www.graphcanon.com/categories/model-training","markdown_url":"https://www.graphcanon.com/categories/model-training.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/model-training"}],"tags":[{"slug":"adversarial-ml-threat-modeling","name":"adversarial-ml-threat-modeling"},{"slug":"ai-agents-security","name":"ai-agents-security"},{"slug":"ai-red-team","name":"ai-red-team"},{"slug":"ai-safety-supply-chain-security","name":"ai-safety-supply-chain-security"},{"slug":"ai-security","name":"ai-security"},{"slug":"awesome-list","name":"awesome-list"},{"slug":"genai-security","name":"genai-security"},{"slug":"guardrails","name":"guardrails"}],"trust":{"provenance":{"is_fork":false,"github_id":836233224,"owner_type":"User","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-15T10:43:08.411Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":0,"days_since_push":1,"last_release_at":null},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-15T10:43:08.769Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-15T10:43:08.178Z"},"languages":{"value":["html"],"source":"github.language","observed_at":"2026-07-15T10:43:08.178Z"}}}}