{"data":{"slug":"withcatai-catai","name":"catai","tagline":"Run AI assistant locally with Node.js","github_url":"https://github.com/withcatai/catai","owner":"withcatai","repo":"catai","owner_avatar_url":"https://avatars.githubusercontent.com/u/142035548?v=4","primary_language":"TypeScript","stars":500,"forks":39,"topics":["ai","ai-assistant","catai","chatbot","chatgpt","chatui","dalai","ggmlv3","gguf","llama-cpp","llm","local-llm","localai","node-llama-cpp","nodejs","openai","vicuna","vicuna-installation-guide","wizardlm"],"archived":false,"github_pushed_at":"2025-11-16T18:35:45+00:00","maintenance_label":"Slowing","stars_delta_30d":2,"url":"https://www.graphcanon.com/tools/withcatai-catai","markdown_url":"https://www.graphcanon.com/tools/withcatai-catai.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/withcatai-catai","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=withcatai-catai","description":"Run AI ✨ assistant locally! with simple API for Node.js 🚀","homepage_url":"https://withcatai.github.io/catai/","license":"MIT","open_issues":2,"watchers":14,"ai_summary":"Provides a simple API for developing and deploying local AI assistants in TypeScript.","readme_excerpt":"## Installation & Use\n\nMake sure you have [Node.js](https://nodejs.org/en/) (**download current**) installed.\n\n```bash\nnpm install -g catai\n\ncatai install qwen3-4b-q4_k_m\ncatai up\n```\n\n---\n\n### Install command\n\n```\nUsage: cli install|i [options] [models...]\n\nInstall any GGUF model\n\nArguments:\n models Model name/url/path\n\nOptions:\n -t --tag [tag] The name of the model in local directory\n -l --latest Install the latest version of a model (may be unstable)\n -b --bind [bind] The model binding method\n -bk --bind-key [key] key/cookie that the binding requires\n -h, --help display help for command\n```\n\n---\n\n## License\n\nThis project uses [Llama.cpp](https://github.com/ggerganov/llama.cpp) to run models on your computer.\nSo any license applied to Llama.cpp is also applied to this project.\n\n\n
\n\n
\n \"Star\n
\n

\n If you like this repo, star it ✨                                                    \n

\n
","github_created_at":"2023-03-25T15:53:57+00:00","created_at":"2026-07-15T10:59:17.703675+00:00","updated_at":"2026-09-20T05:02:13.789531+00:00","categories":[{"slug":"ai-agents","name":"AI Agents","url":"https://www.graphcanon.com/categories/ai-agents","markdown_url":"https://www.graphcanon.com/categories/ai-agents.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/ai-agents"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"ai-assistant","name":"ai-assistant"},{"slug":"chatbot","name":"chatbot"},{"slug":"ggmlv3","name":"ggmlv3"},{"slug":"llama-cpp","name":"llama-cpp"},{"slug":"local-llm","name":"local-llm"},{"slug":"nodejs","name":"nodejs"},{"slug":"openai","name":"openai"},{"slug":"vicuna","name":"vicuna"}],"trust":{"provenance":{"is_fork":false,"github_id":618875095,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-20T05:02:11.233Z","maintenance":{"label":"Slowing","score":36,"methodology":"github_public_v1","releases_90d":0,"days_since_push":307,"last_release_at":"2025-11-16T18:36:17Z","stars_delta_30d":2,"open_issues_delta_30d":0},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-15T10:59:19.038Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-09-20T05:02:12.518Z"},"languages":{"value":["typescript"],"source":"github.language","observed_at":"2026-09-20T05:02:12.518Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-09-20T05:02:12.518Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":null,"constraints":null,"when_to_use":["- When aiming to deploy a local AI assistant without reliance on cloud-based services; catai is ideal due to its focus on node-llama-cpp integration, allowing for robust offline capabilities.","- Should you require an AI deployment that leverages TypeScript directly. Catai distinguishes itself by offering an API specifically designed with TypeScript's type safety in mind."],"when_not_to_use":["- For environments that strictly prohibit or limit Node.js operations on the server side, as catai is engineered to run locally via Node.js only.","- If seeking a cloud-based AI deployment solution that does not require local setup, since catai focuses solely on providing local AI capabilities through an easy-to-use API."],"source":"enrich:decision_facts","observed_at":"2026-07-17T10:05:40.341Z"},"constraint_facets":null,"decision_summary":[{"label":"Adopt for","value":"catai, an AI assistant framework built for local deployment with Node.js, offers developers using TypeScript the ability to create and deploy AI agents through a simple API."}]}}