--- title: "llm-app" type: "tool" slug: "pathwaycom-llm-app" canonical_url: "https://www.graphcanon.com/tools/pathwaycom-llm-app" github_url: "https://github.com/pathwaycom/llm-app" homepage_url: "https://pathway.com/developers/templates/" stars: 59097 forks: 1431 primary_language: "Jupyter Notebook" license: "MIT" categories: ["llm-frameworks", "data-retrieval"] tags: ["llmops", "llm-prompting", "vector-database", "llm-local", "retrieval-augmented-generation", "llm-security", "chatbot"] updated_at: "2026-07-07T18:17:17.065743+00:00" --- # llm-app > Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. Pathway Live Data Framework's AI Pipelines provides pre-deployed LLM App Templates that can be tested locally and deployed on various clouds or on-premises. It supports real-time synchronization and indexing of large datasets. ## Facts - Repository: https://github.com/pathwaycom/llm-app - Homepage: https://pathway.com/developers/templates/ - Stars: 59,097 · Forks: 1,431 · Open issues: 10 · Watchers: 88 - Primary language: Jupyter Notebook - License: MIT - Last pushed: 2026-07-05T17:59:07+00:00 ## Categories - [LLM Frameworks](/categories/llm-frameworks.md) - [Data & Retrieval](/categories/data-retrieval.md) ## Tags llmops, llm-prompting, vector-database, llm-local, retrieval-augmented-generation, llm-security, chatbot ## Related tools - [ollama](/tools/ollama-ollama.md) - Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. (★ 175,659) - [prompts.chat](/tools/f-prompts-chat.md) - The world's largest open-source prompt library for AI (★ 165,019) - [transformers](/tools/huggingface-transformers.md) - 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models (★ 162,347) - [langflow](/tools/langflow-ai-langflow.md) - Langflow is a powerful platform for building and deploying AI-powered agents and workflows. (★ 151,298) - [firecrawl](/tools/firecrawl-firecrawl.md) - The API to search, scrape, and interact with the web at scale. (★ 147,117) - [open-webui](/tools/open-webui-open-webui.md) - User-friendly AI Interface (Supports Ollama, OpenAI API, ...) (★ 144,575) - [awesome-llm-apps](/tools/shubhamsaboo-awesome-llm-apps.md) - 100+ AI Agent & RAG apps you can actually run — clone, customize, ship. (★ 116,702) - [LLMs-from-scratch](/tools/rasbt-llms-from-scratch.md) - Implement a ChatGPT-like LLM in PyTorch from scratch (★ 98,711) ## README (excerpt) ```text
# Pathway Live Data Framework AI Pipelines pathwaycom%2Fllm-app | Trendshift
The Pathway Live Data Framework's **AI Pipelines** allow you to quickly put in production AI applications that offer **high-accuracy RAG and AI enterprise search at scale** using the most **up-to-date knowledge** available in your data sources. It provides you ready-to-deploy **LLM (Large Language Model) App Templates**. You can test them on your own machine and deploy on-cloud (GCP, AWS, Azure, Render,...) or on-premises. The apps connect and sync (all new data additions, deletions, updates) with data sources on your **file system, Google Drive, Sharepoint, S3, Kafka, PostgreSQL, real-time data APIs**. They come with no infrastructure dependencies that would need a separate setup. They include **built-in data indexing** enabling vector search, hybrid search, and full-text search - all done in-memory, with cache. ## Application Templates The application templates provided in this repo scale up to **millions of pages of documents**. Some of them are optimized for simplicity, some are optimized for amazing accuracy. Pick the one that suits you best. You can use it out of the box, or change some steps of the pipeline - for example, if you would like to add a new data source, or change a Vector Index into a Hybrid Index, it's just a one-line change. | Application (template) | Description | | --------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | [`Question-Answering RAG App`](templates/question_answering_rag/) | Basic end-to-end RAG app. A question-answering pipeline that uses the GPT model of choice to provide answers to queries to your documents (PDF, DOCX,...) on a live connected data source (files, Google Drive, Sharepoint,...). You can also try out a [demo REST endpoint](https://pathway.com/solutions/rag-pipelines#try-it-out). | | [`Live Document Indexing (Vector Store / Retriever)`](templates/document_indexing/) | A real-time document indexing pipeline for RAG that acts as a vector store service. It performs live indexing on your documents (PDF, DOCX,...) from a connected data source (files, Google Drive, Sharepoint,...). It can be used with any frontend, or integrated as a retriever backend for a [Langchain](https://pathway.com/blog/langchain-integration) or [Llamaindex](https://pathway.com/blog/llamaindex-pathway) application. You can also try out a [demo REST endpoint](https://pathway.com/solutions/ai-contract-management#try-it-out). | | [`Multimodal RAG pipeline with GPT4o`](templates/multimodal_rag/) | Multimodal RAG using GPT-4o in the parsing stage to index PDFs and other documents from a connected data source files, Google Drive, Sharepoint,...). It is perfect for extracting information from unstructured financial documents in your folders (including charts and tables), updating results as documents change or new ones arrive.| | [`Unstructured-to-SQL pipeline + SQL question-answering`]( ``` --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/tools/pathwaycom-llm-app`](/api/graphcanon/tools/pathwaycom-llm-app) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_