LLM-Agents-Ecosystem-Handbook

oxbshw/LLM-Agents-Ecosystem-Handbook

Practical operating manual for modern LLM agent systems

533
Stars
84
Forks
0
Open issues
9
Watchers
Python MITLast pushed Jun 30, 2026

Overview

Collection of resources including skeletons, tutorials, and evaluation tools for building and deploying LLM agents.

Categories

Tags

Similar tools

Install

pip install LLM-Agents-Ecosystem-Handbook

README

LLM Agents Ecosystem Handbook

A practical operating manual for building, evaluating, securing, and shipping modern LLM agent systems.


Modern agents are not "a prompt + a tool." They are systems — with identity, memory, skills, tools, MCP integrations, guardrails, observability, evals, and a provider strategy. This handbook teaches the whole stack and ships templates, blueprints, runnable adapters, and curated examples you can adopt today.

What's in this repo

A curated, opinionated, production-oriented handbook in seven parts:

  1. Concepts — Agent OS, identity, memory, skills, MCP, safety, observability — every layer of the modern agent stack
  2. Provider ecosystem — adapters + docs for 24+ LLM providers (frontier APIs, fast inference, marketplaces, enterprise clouds, specialty, local runtimes), with a router for fallback chains
  3. Skills ecosystem — design guide, taxonomy, maturity model, security checklist, and a curated skill catalog
  4. Prompt engineering — agent prompt patterns, instruction hierarchy, context engineering, prompt-injection defense
  5. Coding-agent workflows — for Claude Code, Cursor, Codex, Aider, Cline, and custom runtimes — repo instructions, prompts, review checklist, safe refactoring
  6. Design docs — agent / technical design docs, ADR guide, design reviews, rollout plans, the DESIGN.md machine-readable spec
  7. Curated catalog — 100+ existing agent skeletons, framework comparisons, evaluation tools, tutorials — preserved and improved

Who this is for

You are…Start at
New to agentsdocs/beginners_guide.mdagent_os/README.md
Building a production agentblueprints/checklists/production_readiness_checklist.md
Picking / wiring providersproviders/README.mdproviders/provider_matrix.md
Comparing frameworksdocs/framework_comparison.md
Adding memory / RAGmemory/tutorials/rag_tutorials
Adding MCPmcp/mcp/mcp_security.md
Designing Skillsskills/skills/skill_design_guide.md
Working with coding agentscoding_agents/coding_agents/prompts/
Writing better promptsprompt_engineering/
Designing & rolling outdesign_docs/
Hardening safety/evalssafety/evals/
Coding agent reading this repollms.txtllm_wiki/index.md

Modern Agent Stack

LayerPurposeWhere in this repo
Model / ProviderLLM choice + abstraction + routingproviders/
OrchestrationAgent loops, planning, handoffsdocs/framework_comparison.md, blueprints/
ToolFunction calling and external actionsagent_os/mcp_layer.md
MCPStandardized external context and toolsmcp/
MemoryDurable user/project/semantic memorymemory/
SkillsReusable, progressive-loading workflowsskills/
IdentityPersonality, mission, refusal styleagent_os/agent_identity.md, templates/
PromptSystem prompt design, instruction hierarchy, defensesprompt_engineering/
SafetyGuardrails, approvals, policysafety/
ObservabilityTracing, spans, cost, latency, evalsobservability/, evals/
DeploymentShipping agents to production[design_docs/rollout_plan.md](design_docs/rollo