forge
A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows
GraphCanon updated Aug 14, 2026 · GitHub synced Aug 14, 2026
54views this month
Decision brief
Developers working on self-hosted LLM tooling who need flexibility in backend setup and seamless integration of function calling in multi-step workflows might benefit from Forge.
Good fit when
- - You require an agnostic backend setup, such as local LLM backends like llama.cpp or cloud-based services with Anthropic.
- - Your project involves building complex multi-step agentic workflows where function calls are required across various AI agents.
Avoid when
- - If your application does not require flexibility in backend selection, and you prefer a single cloud provider like Anthropic without local setup.
- - For scenarios where simplicity of setup outweighs the need for customization in function calling and workflow management.
- Requirements:
- Min 4 GB RAM; Requires Docker; Requires Python 3.12+ and a running LLM backend.; Can be set up with local backends (e.g., llama.cpp) or Anthropic via its API, requiring an API key for the latter case.
Observed Jul 17, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of Aug 14, 2026
- Provenance
- Not a fork · Personal account
- As of Aug 14, 2026
- Security (OSV)
- No lockfile
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install forgeHow it fits your stack(2)
Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.
Relationship graph
Optional deeper exploration of typed edges and category neighbours.
Similar tools
Same-category neighbours not already linked as typed edges.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Forge is designed for developers who require a robust framework for implementing self-hosted large language model (LLM) tools with support for function calling, multi-step workflows, and integration of various AI agents. The framework provides flexibility in backend setup, including local LLM backends like llama.cpp or ollama, and cloud-based services such as Anthropic.
Capability facts
- Deploy
- Self-host
Source: dockerfile:Dockerfile · Aug 14, 2026
- Docker
- Dockerfile present
Source: dockerfile:Dockerfile · Aug 14, 2026
- CLI
- CLI entrypoint
Source: pyproject.toml:[project.scripts] · Aug 14, 2026
- Languages
- python
Source: github.language+pyproject.toml · Aug 14, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Tags
README
Requirements Python 3.12+ A running LLM backend (see below) Install For development: Install from https://github.com/ggml org/llama.cpp/releases llama server m path/to/Ministral 3 8B Instruct 2512 Q8 0.gguf jinja ngl 999 port 8080 bash Install from https://ollama.com/download oll...
For agents
This page has a .md twin and JSON over the API.