Home/AI Agents/cascadeflow
cascadeflow logo

cascadeflow

Enrichment pending
lemony-ai/cascadeflow

Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.

GraphCanon updated today · GitHub synced today

3.3k stars686 forksLast push 2w Python MIT

Verify the decision

Maintenance and security

Full trust report
Maintenance
Active (14d since push)
As of today
Provenance
Not a fork · Organization account
As of today
Security (OSV)
2 low (2 low)
As of today

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install cascadeflow
PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.

Capability facts

CLI
CLI entrypoint

Source: pyproject.toml:[project.scripts] · Jul 15, 2026

MCP server
No MCP server detected

Source: repo_scan · Jul 15, 2026

Languages
python, javascript

Source: github.language+package.json+pyproject.toml · Jul 15, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

LangChain integrationLangChain

Source: README excerpt (regex_v1, Jul 15, 2026)

npm install @cascadeflow/langchain @langchain/core @langchain/openai
Source link
Node.js runtimeNode.js

Source: README excerpt (regex_v1, Jul 15, 2026)

npm install @cascadeflow/langchain @langchain/core @langchain/openai
Source link
Python runtimePython

Source: README excerpt (regex_v1, Jul 15, 2026)

**<img src=".github/assets/CF_python_color.svg" width="18" height="18" alt="Python" style="vertical-align: middle;"/> Python**
Source link

Tags

README

Installation

  1. Open n8n
  2. Go to SettingsCommunity Nodes
  3. Search for: @cascadeflow/n8n-nodes-cascadeflow
  4. Click Install

Installation

TypeScript

npm install @cascadeflow/langchain @langchain/core @langchain/openai

Python

pip install cascadeflow langchain-openai

Quick Start

TypeScript - Drop-in replacement for any LangChain chat model
import { ChatOpenAI } from '@langchain/openai';
import { ChatAnthropic } from '@langchain/anthropic';
import { withCascade } from '@cascadeflow/langchain';

const cascade = withCascade({
  drafter: new ChatOpenAI({ model: 'nous/hermes-flash' }),      // $0.15/$0.60 per 1M tokens
  verifier: new ChatAnthropic({ model: 'claude-sonnet-4-5' }),  // $3/$15 per 1M tokens
  qualityThreshold: 0.8, // 80% queries use drafter
});

// Use like any LangChain chat model
const result = await cascade.invoke('Explain quantum computing');

// Optional: Enable LangSmith tracing (see https://smith.langchain.com)
// Set LANGSMITH_API_KEY, LANGSMITH_PROJECT, LANGSMITH_TRACING=true

// Or with LCEL chains
const chain = prompt.pipe(cascade).pipe(new StringOutputParser());
Python - Drop-in replacement for any LangChain chat model
from langchain_openai import ChatOpenAI
from langchain_anthropic import ChatAnthropic
from cascadeflow.integrations.langchain import CascadeFlow

cascade = CascadeFlow(
    drafter=ChatOpenAI(model="nous/hermes-flash"),      # $0.15/$0.60 per 1M tokens
    verifier=ChatAnthropic(model="claude-sonnet-4-5"),  # $3/$15 per 1M tokens
    quality_threshold=0.8,  # 80% queries use drafter
)

---

## License

MIT ©  see [LICENSE](https://github.com/lemony-ai/cascadeflow/blob/main/LICENSE) file.

Free for commercial use. Attribution appreciated but not required.

---

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.