--- title: "LLM Frameworks" type: "category" slug: "llm-frameworks" canonical_url: "https://www.graphcanon.com/categories/llm-frameworks" tool_count: 13 --- # LLM Frameworks 13 tools in this category. ## Tools - [hermes-agent](/tools/nousresearch-hermes-agent.md) - Self-improving AI agent with built-in learning loop and flexible model integration (★ 210,857) - [AutoGPT](/tools/significant-gravitas-autogpt.md) - Open-source platform for creating, deploying, and managing autonomous AI agents (★ 185,419) - [ollama](/tools/ollama-ollama.md) - Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. (★ 175,655) - [prompts.chat](/tools/f-prompts-chat.md) - Open-source prompt library for AI models and chatbots (★ 165,017) - [transformers](/tools/huggingface-transformers.md) - 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, (★ 162,343) - [dify](/tools/langgenius-dify.md) - Production-ready platform for agentic workflow development. (★ 148,061) - [vllm](/tools/vllm-project-vllm.md) - A high-throughput and memory-efficient inference and serving engine for LLMs (★ 85,604) - [mem0](/tools/mem0ai-mem0.md) - Universal memory layer for AI Agents (★ 60,304) - [litellm](/tools/berriai-litellm.md) - Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and (★ 52,864) - [qdrant](/tools/qdrant-qdrant.md) - Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud (★ 33,006) - [langfuse](/tools/langfuse-langfuse.md) - 🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTele (★ 30,621) - [chroma](/tools/chroma-core-chroma.md) - Search infrastructure for AI (★ 28,721) - [pgvector](/tools/pgvector-pgvector.md) - Open-source vector similarity search for Postgres (★ 22,104) --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/categories/llm-frameworks`](/api/graphcanon/categories/llm-frameworks) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_