{"data":{"slug":"promtengineer-localgpt","name":"localGPT","tagline":"Chat with your documents locally using GPT models","github_url":"https://github.com/PromtEngineer/localGPT","owner":"PromtEngineer","repo":"localGPT","owner_avatar_url":"https://avatars.githubusercontent.com/u/134474669?v=4","primary_language":"Python","stars":22202,"forks":2472,"topics":[],"archived":false,"github_pushed_at":"2026-03-10T21:32:07+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/promtengineer-localgpt","markdown_url":"https://www.graphcanon.com/tools/promtengineer-localgpt.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/promtengineer-localgpt","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=promtengineer-localgpt","description":"Chat with your documents on your local device using GPT models. No data leaves your device and 100% private. ","homepage_url":null,"license":"MIT","open_issues":25,"watchers":179,"ai_summary":"A local tool to enable private chat interactions with documents using GPT models.","readme_excerpt":"## 🚀 Quick Start\n\nNote: The installation is currently only tested on macOS.\n\n---\n\n### Option 1: Docker Deployment \n\n```bash\n\n---\n\n# Install Ollama locally (required even for Docker)\ncurl -fsSL https://ollama.ai/install.sh | sh\nollama pull qwen3:0.6b\nollama pull qwen3:8b\n\n---\n\n# Start with Docker (in a new terminal)\n./start-docker.sh\n\n---\n\n# Install Python dependencies\npip install -r requirements.txt\n\n---\n\n# Install Node.js dependencies\nnpm install\n\n---\n\n# Install and start Ollama\ncurl -fsSL https://ollama.ai/install.sh | sh\nollama pull qwen3:0.6b\nollama pull qwen3:8b\nollama serve\n\n---\n\n### Detailed Installation\n\n#### 1. Install System Dependencies\n\n**Ubuntu/Debian:**\n```bash\nsudo apt update\nsudo apt install python3.8 python3-pip nodejs npm docker.io docker-compose\n```\n\n**macOS:**\n```bash\nbrew install python@3.8 node npm docker docker-compose\n```\n\n**Windows:**\n```bash\n\n---\n\n# Install Python 3.8+, Node.js, and Docker Desktop\n\n---\n\n# Install Ollama\ncurl -fsSL https://ollama.ai/install.sh | sh\n\n---\n\n# Test installation\npython -c \"from rag_system.main import get_agent; print('✅ Installation successful!')\"\n\n---\n\n### 🚀 Quick Start for Contributors\n\n```bash\n\n---\n\n# Install Ollama and models\ncurl -fsSL https://ollama.ai/install.sh | sh\nollama pull qwen3:0.6b qwen3:8b\n\n---\n\n## 📄 License\n\nThis project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details. For models, please check their respective licenses.\n\n---","github_created_at":"2023-05-24T05:32:40+00:00","created_at":"2026-07-11T10:45:52.445388+00:00","updated_at":"2026-07-11T14:01:06.669834+00:00","categories":[{"slug":"data-retrieval","name":"Data & Retrieval","url":"https://www.graphcanon.com/categories/data-retrieval","markdown_url":"https://www.graphcanon.com/categories/data-retrieval.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/data-retrieval"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"document-chat","name":"document chat"},{"slug":"gpt-models","name":"gpt models"},{"slug":"local-inference","name":"local-inference"},{"slug":"private-data-processing","name":"private data processing"},{"slug":"python-dependencies","name":"python dependencies"},{"slug":"docker-support","name":"docker support"},{"slug":"ollama-dependency","name":"ollama dependency"},{"slug":"node-js-dependencies","name":"node.js dependencies"}],"trust":{"provenance":{"is_fork":false,"github_id":644715009,"owner_type":"User","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-11T10:45:53.141Z","maintenance":{"label":"Slowing","score":36,"methodology":"github_public_v1","releases_90d":0,"days_since_push":122,"last_release_at":null},"security_summary":{"status":"findings","scanner":"osv@v1","low_count":44,"high_count":0,"last_scan_at":"2026-07-11T10:45:54.027Z","medium_count":0,"scan_profile":"deps","critical_count":0}},"capability_facts":{"mcp":{"source":"repo_scan","observed_at":"2026-07-11T14:00:40.677Z","server_manifest":false},"scan":{"source":"repo_scan","observed_at":"2026-07-11T14:00:40.677Z"},"deploy":{"source":"dockerfile:docker-compose.yml","self_host":true,"observed_at":"2026-07-11T14:00:40.677Z","managed_saas":false},"has_cli":{"value":true,"source":"package.json:bin|scripts","observed_at":"2026-07-11T14:00:40.677Z"},"languages":{"value":["python","javascript","typescript"],"source":"github.language+package.json","observed_at":"2026-07-11T14:00:40.677Z"},"has_docker":{"value":true,"source":"dockerfile:docker-compose.yml","observed_at":"2026-07-11T14:00:40.677Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-07-11T14:00:40.677Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":{"notes":["Installation is currently tested only on macOS, though instructions for other operating systems are partially provided."],"min_ram_gb":4,"requires_docker":true},"constraints":{"min_ram_gb":4,"requires_docker":true},"when_to_use":["When absolute privacy is required since no data leaves the user's local device.","For environments where internet connectivity or bandwidth might be limited, as everything runs locally."],"when_not_to_use":["If you need to work across multiple devices seamlessly because localGPT requires installation on each device and does not synchronize state online.","In scenarios requiring frequent updates or model tuning from a cloud service; localGPT relies solely on locally available models which do not auto-update."],"source":"enrich:decision_facts","observed_at":"2026-07-11T14:01:06.298Z"},"constraint_facets":{"min_ram_gb":4,"requires_docker":true},"decision_summary":[{"label":"Requirements","value":"Min 4 GB RAM; Requires Docker; Installation is currently tested only on macOS, though instructions for other operating systems are partially provided."},{"label":"Adopt for","value":"localGPT allows users to chat with local documents using GPT models completely privately without internet access."}]}}