Home/Developer Tools/langchain-serve

langchain-serve

jina-ai/langchain-serve

Self-host LLM Apps with Docker Compose or Kubernetes

GitHub Website

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

70views this month

1.6k stars133 forksLast push Sep 20, 2023 Python Apache-2.0

Decision brief

Langchain-serve is a tool for deploying Langchain applications in production using Jina and FastAPI, with support for Docker Compose or Kubernetes deployment and secrets management.

Good fit when

When you need to deploy Langchain applications with Jina and FastAPI on your own infrastructure.
If you require secrets management during deployment, allowing you to securely handle sensitive information like API keys.

Avoid when

If you do not require or prefer not to use Jina and FastAPI for your Langchain applications.
When you do not need or want to manage secrets through a `.env` file during deployment.

Pricing:: freemium - Base credits ensure high availability by maintaining at least one instance running continuously, while serving credits are charged when the application is actively serving requests. Pricing is based,
Requirements:: Min 1 GB RAM; Requires Docker; Requires Docker Compose or Kubernetes for deployment.; Secrets management is supported via `.env` files.

Observed Sep 18, 2026 · Source: enrich:decision_facts

langchain-serve alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Archived (1094d since push); As of Sep 18, 2026
Provenance: Not a fork · Organization account; As of Sep 18, 2026
Security (OSV): No criticals; As of Sep 18, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install langchain-serve

PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

awesome-llm-apps

Over 100 runnable AI Agent and RAG apps to clone, tweak, and deploy.

136k★

llm-app

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data

59k★

agents-towards-production

End-to-end, code-first tutorials for building production-grade GenAI agents

21k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Langchain apps in production using Jina & FastAPI, supports deployment via Docker Compose or Kubernetes with secrets management.

Capability facts

Languages: python
Source: github.language+pyproject.toml · Sep 18, 2026

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 18, 2026)

```python

Source link

README

🏠 Self host LLM Apps with Docker Compose or Kubernetes 🚀 Export your apps as Kubernetes or Docker Compose YAMLs with single command. 👉 📦 Deploy your app on your own internal infrastructure with your own security policies. 📞 Talk to us if you need all the features of Jina AI...

For agents

This page has a .md twin and JSON over the API.

/tools/jina-ai-langchain-serve.md GET /api/graphcanon/tools/jina-ai-langchain-serve GET /api/graphcanon/graph?tool=jina-ai-langchain-serve