{"data":{"node":{"slug":"hogeheer499-commits-strix-halo-guide","name":"strix-halo-guide","tagline":"AMD Ryzen AI Halo setup guide for LLM frameworks like Ollama and llama.cpp Vulkan on Radeon hardware","github_url":"https://github.com/hogeheer499-commits/strix-halo-guide","owner":"hogeheer499-commits","repo":"strix-halo-guide","owner_avatar_url":"https://avatars.githubusercontent.com/u/267467744?v=4","primary_language":"Python","stars":336,"forks":23,"topics":["amd","beelink","benchmark","framework-desktop","gfx1151","gguf","llama-cpp","llm","local-ai","local-llm","mini-pc","ollama","qwen3","radeon-8060s","rocm","ryzen-ai-max","ryzen-ai-max-395","strix-halo","unified-memory","vulkan"],"archived":false,"github_pushed_at":"2026-09-19T21:59:03+00:00","maintenance_label":"Very active","stars_delta_30d":69,"url":"https://www.graphcanon.com/tools/hogeheer499-commits-strix-halo-guide","markdown_url":"https://www.graphcanon.com/tools/hogeheer499-commits-strix-halo-guide.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/hogeheer499-commits-strix-halo-guide","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=hogeheer499-commits-strix-halo-guide"},"categories":[{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"}],"tags":[{"slug":"amd","name":"amd"},{"slug":"llama-cpp","name":"llama-cpp"},{"slug":"local-llm","name":"local-llm"},{"slug":"ollama","name":"ollama"},{"slug":"radeon-8060s","name":"radeon-8060s"},{"slug":"raf-ryzen-ai-max-395","name":"raf-ryzen-ai-max-395"},{"slug":"rocm","name":"rocm"},{"slug":"vulkan","name":"vulkan"}],"edges":[],"neighbours":[{"slug":"jmaczan-tiny-vllm","name":"tiny-vllm","tagline":"Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM","github_url":"https://github.com/jmaczan/tiny-vllm","owner":"jmaczan","repo":"tiny-vllm","owner_avatar_url":"https://avatars.githubusercontent.com/u/18054202?v=4","primary_language":"C++","stars":1120,"forks":92,"topics":["ai","attention","batching","course","cpp","cuda","hpc","inference","llm","llm-inference","pagedattention","tiny-vllm","vllm"],"archived":false,"github_pushed_at":"2026-09-15T19:46:09+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/jmaczan-tiny-vllm","markdown_url":"https://www.graphcanon.com/tools/jmaczan-tiny-vllm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/jmaczan-tiny-vllm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=jmaczan-tiny-vllm","shared_categories":["inference-serving"]},{"slug":"notpunchnox-rkllama","name":"rkllama","tagline":"Ollama alternative for Rockchip NPU with optimized AI and Deep learning model inference","github_url":"https://github.com/NotPunchnox/rkllama","owner":"NotPunchnox","repo":"rkllama","owner_avatar_url":"https://avatars.githubusercontent.com/u/74469788?v=4","primary_language":"Python","stars":605,"forks":99,"topics":["ai","client","client-server","ia","llm","llm-apps","llm-inference","npu","npu-llm","offline","orange-pi","orangepi","orangepi5","orangepi5pro","python","rk3576","rk3588","rockchip","server"],"archived":false,"github_pushed_at":"2026-08-25T10:37:12+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/notpunchnox-rkllama","markdown_url":"https://www.graphcanon.com/tools/notpunchnox-rkllama.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/notpunchnox-rkllama","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=notpunchnox-rkllama","shared_categories":["inference-serving"]},{"slug":"uncsoft-anubis-oss","name":"anubis-oss","tagline":"Local LLM Testing & Benchmarking for Apple Silicon","github_url":"https://github.com/uncSoft/anubis-oss","owner":"uncSoft","repo":"anubis-oss","owner_avatar_url":"https://avatars.githubusercontent.com/u/181050313?v=4","primary_language":"Swift","stars":207,"forks":15,"topics":["apple-silicon","benchmarking","gpu","inference","llm","local-llm","macos","mlx","native","ollama","performance","swiftui"],"archived":false,"github_pushed_at":"2026-09-05T00:10:19+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/uncsoft-anubis-oss","markdown_url":"https://www.graphcanon.com/tools/uncsoft-anubis-oss.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/uncsoft-anubis-oss","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=uncsoft-anubis-oss","shared_categories":["inference-serving"]}]}}