LLM-Agents-Ecosystem-Handbook
oxbshw/LLM-Agents-Ecosystem-Handbook
Practical operating manual for modern LLM agent systems
Overview
Collection of resources including skeletons, tutorials, and evaluation tools for building and deploying LLM agents.
Categories
Tags
Similar tools
ECC
affaan-m/ECC
The agent harness performance optimization system
hermes-agent
NousResearch/hermes-agent
The self-improving AI agent built by Nous Research
AutoGPT
Significant-Gravitas/AutoGPT
AutoGPT: Build, Deploy, and Run AI Agents
ollama
ollama/ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
langflow
langflow-ai/langflow
Langflow is a powerful platform for building and deploying AI-powered agents and workflows.
dify
langgenius/dify
Production-ready platform for agentic workflow development
Install
pip install LLM-Agents-Ecosystem-HandbookREADME
LLM Agents Ecosystem Handbook
A practical operating manual for building, evaluating, securing, and shipping modern LLM agent systems.
Modern agents are not "a prompt + a tool." They are systems — with identity, memory, skills, tools, MCP integrations, guardrails, observability, evals, and a provider strategy. This handbook teaches the whole stack and ships templates, blueprints, runnable adapters, and curated examples you can adopt today.
What's in this repo
A curated, opinionated, production-oriented handbook in seven parts:
- Concepts — Agent OS, identity, memory, skills, MCP, safety, observability — every layer of the modern agent stack
- Provider ecosystem — adapters + docs for 24+ LLM providers (frontier APIs, fast inference, marketplaces, enterprise clouds, specialty, local runtimes), with a router for fallback chains
- Skills ecosystem — design guide, taxonomy, maturity model, security checklist, and a curated skill catalog
- Prompt engineering — agent prompt patterns, instruction hierarchy, context engineering, prompt-injection defense
- Coding-agent workflows — for Claude Code, Cursor, Codex, Aider, Cline, and custom runtimes — repo instructions, prompts, review checklist, safe refactoring
- Design docs — agent / technical design docs, ADR guide, design reviews, rollout plans, the
DESIGN.mdmachine-readable spec - Curated catalog — 100+ existing agent skeletons, framework comparisons, evaluation tools, tutorials — preserved and improved
Who this is for
| You are… | Start at |
|---|---|
| New to agents | docs/beginners_guide.md → agent_os/README.md |
| Building a production agent | blueprints/ → checklists/production_readiness_checklist.md |
| Picking / wiring providers | providers/README.md → providers/provider_matrix.md |
| Comparing frameworks | docs/framework_comparison.md |
| Adding memory / RAG | memory/ → tutorials/rag_tutorials |
| Adding MCP | mcp/ → mcp/mcp_security.md |
| Designing Skills | skills/ → skills/skill_design_guide.md |
| Working with coding agents | coding_agents/ → coding_agents/prompts/ |
| Writing better prompts | prompt_engineering/ |
| Designing & rolling out | design_docs/ |
| Hardening safety/evals | safety/ → evals/ |
| Coding agent reading this repo | llms.txt → llm_wiki/index.md |
Modern Agent Stack
| Layer | Purpose | Where in this repo |
|---|---|---|
| Model / Provider | LLM choice + abstraction + routing | providers/ |
| Orchestration | Agent loops, planning, handoffs | docs/framework_comparison.md, blueprints/ |
| Tool | Function calling and external actions | agent_os/mcp_layer.md |
| MCP | Standardized external context and tools | mcp/ |
| Memory | Durable user/project/semantic memory | memory/ |
| Skills | Reusable, progressive-loading workflows | skills/ |
| Identity | Personality, mission, refusal style | agent_os/agent_identity.md, templates/ |
| Prompt | System prompt design, instruction hierarchy, defenses | prompt_engineering/ |
| Safety | Guardrails, approvals, policy | safety/ |
| Observability | Tracing, spans, cost, latency, evals | observability/, evals/ |
| Deployment | Shipping agents to production | [design_docs/rollout_plan.md](design_docs/rollo |