{"data":{"slug":"ggml-org-llama-cpp","name":"llama.cpp","tagline":"LLM inference in C/C++","github_url":"https://github.com/ggml-org/llama.cpp","owner":"ggml-org","repo":"llama.cpp","owner_avatar_url":"https://avatars.githubusercontent.com/u/134263123?v=4","primary_language":"C++","stars":128639,"forks":23359,"topics":["ggml"],"archived":false,"github_pushed_at":"2026-09-18T08:13:37+00:00","maintenance_label":"Very active","stars_delta_30d":5698,"url":"https://www.graphcanon.com/tools/ggml-org-llama-cpp","markdown_url":"https://www.graphcanon.com/tools/ggml-org-llama-cpp.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/ggml-org-llama-cpp","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=ggml-org-llama-cpp","description":"LLM inference in C/C++","homepage_url":"https://llama.app","license":"MIT","open_issues":2491,"watchers":842,"ai_summary":"A repository for performing inference with large language models using C++.","readme_excerpt":"## Quick start\n\nA few options to get `llama.cpp` installed on your machine:\n\n- Visit https://llama.app and follow the instructions\n- Run with Docker - see our [Docker documentation](docs/docker.md)\n- Download pre-built binaries from the [releases page](https://github.com/ggml-org/llama.cpp/releases)\n- Build from source by cloning this repository - check out [our build guide](docs/build.md)\n\nOnce installed:\n\n```sh","github_created_at":"2023-03-10T18:58:00+00:00","created_at":"2026-07-07T22:37:23.741655+00:00","updated_at":"2026-09-20T04:29:40.117208+00:00","categories":[{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"c","name":"c++"},{"slug":"ggml","name":"ggml"},{"slug":"llm-inference","name":"llm-inference"}],"trust":{"provenance":{"is_fork":false,"github_id":612354784,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-18T08:17:36.981Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":30,"days_since_push":0,"last_release_at":"2026-09-18T08:13:40Z","stars_delta_30d":5698,"open_issues_delta_30d":522},"security_summary":{"status":"ok","scanner":"osv@v1","low_count":0,"high_count":0,"last_scan_at":"2026-09-18T08:17:38.961Z","medium_count":0,"scan_profile":"deps","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-09-18T08:17:35.901Z"},"has_cli":{"value":true,"source":"pyproject.toml:[project.scripts]","observed_at":"2026-09-18T08:17:35.901Z"},"languages":{"value":["c++","python"],"source":"github.language+pyproject.toml","observed_at":"2026-09-18T08:17:35.901Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-09-18T08:17:35.901Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":null,"constraints":null,"when_to_use":["When you need a fast and lightweight solution for LLM inference that can be integrated into C++ projects.","If you require a tool that can run on resource-constrained devices where Python-based alternatives might be too heavy.","For developers who prefer or are required to work in C++ environments and want to avoid the overhead of Python interpreters."],"when_not_to_use":["If your project is already heavily invested in Python and you do not want to introduce another language for inference.","When you need extensive model training capabilities, as llama.cpp focuses solely on inference.","If you are looking for a tool with a large community and extensive documentation, as llama.cpp might have a smaller community and less comprehensive support compared to some Python-based alternatives."],"source":"enrich:decision_facts","observed_at":"2026-09-18T10:04:11.256Z"},"constraint_facets":null,"decision_summary":[{"label":"Adopt for","value":"llama.cpp is a C++ tool for performing inference with large language models, offering a lightweight and efficient alternative to Python-based solutions."}]}}