{"data":{"node":{"slug":"bentoml-bentoml","name":"BentoML","tagline":"The easiest way to serve AI apps and models","github_url":"https://github.com/bentoml/BentoML","owner":"bentoml","repo":"BentoML","owner_avatar_url":"https://avatars.githubusercontent.com/u/49176046?v=4","primary_language":"Python","stars":8847,"forks":1032,"topics":["ai-inference","deep-learning","generative-ai","inference-platform","llm","llm-inference","llm-serving","llmops","machine-learning","ml-engineering","mlops","model-inference-service","model-serving","multimodal","python"],"archived":false,"github_pushed_at":"2026-09-07T17:43:01+00:00","maintenance_label":"Active","stars_delta_30d":119,"url":"https://www.graphcanon.com/tools/bentoml-bentoml","markdown_url":"https://www.graphcanon.com/tools/bentoml-bentoml.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/bentoml-bentoml","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=bentoml-bentoml"},"categories":[{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"ai-inference","name":"ai-inference"},{"slug":"deep-learning","name":"deep-learning"},{"slug":"generative-ai","name":"generative-ai"},{"slug":"inference-platform","name":"inference-platform"},{"slug":"llm","name":"llm"},{"slug":"llm-inference","name":"llm-inference"},{"slug":"llm-serving","name":"llm-serving"},{"slug":"llmops","name":"llmops"}],"edges":[{"type":"integrates_with","direction":"out","explanation":"BentoML, which serves as a unified framework for model serving in AI applications, integrates with Haystack to enable the deployment of Haystack's modular pipelines and agent workflows, thus facilitating the scalable execution of tasks such as retrieval, routing, memory management, and generation within production-ready LLM applications.","successor_context":null,"tool":{"slug":"deepset-ai-haystack","name":"haystack","tagline":"Open-source AI orchestration framework for building context-engineered, production-ready LLM applications","github_url":"https://github.com/deepset-ai/haystack","owner":"deepset-ai","repo":"haystack","owner_avatar_url":"https://avatars.githubusercontent.com/u/51827949?v=4","primary_language":"Python","stars":26536,"forks":3144,"topics":["agent-framework","agentic-ai","agentic-rag","agents","ai","ai-agents","context-engineering","framework","genai","generative-ai","information-retrieval","large-language-models","llm","mcp","multi-agent","orchestration","python","rag","retrieval-augmented-generation","semantic-search"],"archived":false,"github_pushed_at":"2026-09-18T08:02:25+00:00","maintenance_label":"Very active","stars_delta_30d":463,"url":"https://www.graphcanon.com/tools/deepset-ai-haystack","markdown_url":"https://www.graphcanon.com/tools/deepset-ai-haystack.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/deepset-ai-haystack","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=deepset-ai-haystack"}},{"type":"integrates_with","direction":"out","explanation":"BentoML, as a framework for building online serving systems optimized for AI models, can integrate with Jina-Serve (referred to here as 'serve') to expand its service capabilities by leveraging Jina-Serve's support for gRPC, HTTP, and WebSockets protocols, thus enabling more versatile deployment options.","successor_context":null,"tool":{"slug":"jina-ai-serve","name":"serve","tagline":"Build multimodal AI applications with cloud-native stack","github_url":"https://github.com/jina-ai/serve","owner":"jina-ai","repo":"serve","owner_avatar_url":"https://avatars.githubusercontent.com/u/60539444?v=4","primary_language":"Python","stars":21861,"forks":2240,"topics":["cloud-native","cncf","deep-learning","docker","fastapi","framework","generative-ai","grpc","jaeger","kubernetes","llmops","machine-learning","microservice","mlops","multimodal","neural-search","opentelemetry","orchestration","pipeline","prometheus"],"archived":false,"github_pushed_at":"2025-03-24T13:59:54+00:00","maintenance_label":"Dormant","stars_delta_30d":-2,"url":"https://www.graphcanon.com/tools/jina-ai-serve","markdown_url":"https://www.graphcanon.com/tools/jina-ai-serve.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/jina-ai-serve","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=jina-ai-serve"}},{"type":"related","direction":"out","explanation":"BentoML and Serve both cater to building multimodal AI applications, but they do so differently. BentoML focuses on serving models via APIs and Docker containers, while Serve emphasizes cloud-native infrastructure for deployment.","successor_context":null,"tool":{"slug":"jina-ai-serve","name":"serve","tagline":"Build multimodal AI applications with cloud-native stack","github_url":"https://github.com/jina-ai/serve","owner":"jina-ai","repo":"serve","owner_avatar_url":"https://avatars.githubusercontent.com/u/60539444?v=4","primary_language":"Python","stars":21861,"forks":2240,"topics":["cloud-native","cncf","deep-learning","docker","fastapi","framework","generative-ai","grpc","jaeger","kubernetes","llmops","machine-learning","microservice","mlops","multimodal","neural-search","opentelemetry","orchestration","pipeline","prometheus"],"archived":false,"github_pushed_at":"2025-03-24T13:59:54+00:00","maintenance_label":"Dormant","stars_delta_30d":-2,"url":"https://www.graphcanon.com/tools/jina-ai-serve","markdown_url":"https://www.graphcanon.com/tools/jina-ai-serve.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/jina-ai-serve","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=jina-ai-serve"}},{"type":"related","direction":"out","explanation":"Both BentoML and MLflow are involved in the broader area of model serving, inference, and deployment of AI models. However, they serve different specific purposes with MLflow focusing on tracking experiments and managing the lifecycle of models while BentoML focuses more on deploying and serving models efficiently.","successor_context":null,"tool":{"slug":"mlflow-mlflow","name":"mlflow","tagline":"Open source AI engineering platform for agents, LLMs, and ML models","github_url":"https://github.com/mlflow/mlflow","owner":"mlflow","repo":"mlflow","owner_avatar_url":"https://avatars.githubusercontent.com/u/39938107?v=4","primary_language":"Python","stars":28010,"forks":6323,"topics":["agentops","agents","ai","ai-governance","apache-spark","evaluation","langchain","llm-evaluation","llmops","machine-learning","ml","mlflow","mlops","model-management","observability","open-source","openai","prompt-engineering"],"archived":false,"github_pushed_at":"2026-09-18T08:08:32+00:00","maintenance_label":"Very active","stars_delta_30d":895,"url":"https://www.graphcanon.com/tools/mlflow-mlflow","markdown_url":"https://www.graphcanon.com/tools/mlflow-mlflow.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/mlflow-mlflow","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=mlflow-mlflow"}},{"type":"related","direction":"out","explanation":"Pixeltable and BentoML are both used in multimodal AI data applications. Pixeltable provides a backend to handle data from different modalities, whereas BentoML focuses on the deployment side by serving these models efficiently.","successor_context":null,"tool":{"slug":"pixeltable-pixeltable","name":"pixeltable","tagline":"Unified multimodal backend for AI data apps","github_url":"https://github.com/pixeltable/pixeltable","owner":"pixeltable","repo":"pixeltable","owner_avatar_url":"https://avatars.githubusercontent.com/u/160283145?v=4","primary_language":"Python","stars":1622,"forks":223,"topics":["agents","ai","backend","computer-vision","data-science","database","genai","llm","machine-learning","multimodal","postgres","python","rag","vector-database"],"archived":false,"github_pushed_at":"2026-09-20T04:51:17+00:00","maintenance_label":"Very active","stars_delta_30d":18,"url":"https://www.graphcanon.com/tools/pixeltable-pixeltable","markdown_url":"https://www.graphcanon.com/tools/pixeltable-pixeltable.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/pixeltable-pixeltable","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=pixeltable-pixeltable"}},{"type":"integrates_with","direction":"out","explanation":"BentoML, which serves as a framework for deploying and managing machine learning models, integrates with vLLM, an efficient model serving engine for large language models (LLMs). This integration allows BentoML to leverage vLLM's capabilities for fast and memory-efficient inference of LLMs when building online serving systems.","successor_context":null,"tool":{"slug":"vllm-project-vllm","name":"vllm","tagline":"A high-throughput and memory-efficient inference and serving engine for LLMs","github_url":"https://github.com/vllm-project/vllm","owner":"vllm-project","repo":"vllm","owner_avatar_url":"https://avatars.githubusercontent.com/u/136984999?v=4","primary_language":"Python","stars":92075,"forks":22363,"topics":["amd","blackwell","cuda","deepseek","deepseek-v3","gpt","gpt-oss","inference","kimi","llama","llm","llm-serving","model-serving","moe","openai","pytorch","qwen","qwen3","tpu","transformer"],"archived":false,"github_pushed_at":"2026-09-18T07:28:54+00:00","maintenance_label":"Very active","stars_delta_30d":4228,"url":"https://www.graphcanon.com/tools/vllm-project-vllm","markdown_url":"https://www.graphcanon.com/tools/vllm-project-vllm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/vllm-project-vllm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=vllm-project-vllm"}},{"type":"integrates_with","direction":"out","explanation":"BentoML integrates with Ray to leverage Ray's distributed computing capabilities, specifically its Serve library for scalable model serving, which enhances BentoML's ability to deploy and scale AI models across a cluster.","successor_context":null,"tool":{"slug":"ray-project-ray","name":"ray","tagline":"Unified framework for scaling AI and Python applications","github_url":"https://github.com/ray-project/ray","owner":"ray-project","repo":"ray","owner_avatar_url":"https://avatars.githubusercontent.com/u/22125274?v=4","primary_language":"Python","stars":43863,"forks":8052,"topics":["data-science","deep-learning","deployment","distributed","hyperparameter-optimization","hyperparameter-search","large-language-models","llm","llm-inference","llm-serving","machine-learning","optimization","parallel","python","pytorch","ray","reinforcement-learning","rllib","serving","tensorflow"],"archived":false,"github_pushed_at":"2026-09-18T06:15:07+00:00","maintenance_label":"Very active","stars_delta_30d":337,"url":"https://www.graphcanon.com/tools/ray-project-ray","markdown_url":"https://www.graphcanon.com/tools/ray-project-ray.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/ray-project-ray","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=ray-project-ray"}},{"type":"alternative","direction":"in","explanation":"Both Jina-Serve and BentoML are frameworks for building and deploying AI services, but they differ in their architectural approaches and the protocols they support (e.g., gRPC vs HTTP/REST).","successor_context":null,"tool":{"slug":"jina-ai-serve","name":"serve","tagline":"Build multimodal AI applications with cloud-native stack","github_url":"https://github.com/jina-ai/serve","owner":"jina-ai","repo":"serve","owner_avatar_url":"https://avatars.githubusercontent.com/u/60539444?v=4","primary_language":"Python","stars":21861,"forks":2240,"topics":["cloud-native","cncf","deep-learning","docker","fastapi","framework","generative-ai","grpc","jaeger","kubernetes","llmops","machine-learning","microservice","mlops","multimodal","neural-search","opentelemetry","orchestration","pipeline","prometheus"],"archived":false,"github_pushed_at":"2025-03-24T13:59:54+00:00","maintenance_label":"Dormant","stars_delta_30d":-2,"url":"https://www.graphcanon.com/tools/jina-ai-serve","markdown_url":"https://www.graphcanon.com/tools/jina-ai-serve.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/jina-ai-serve","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=jina-ai-serve"}}],"neighbours":[{"slug":"n8n-io-self-hosted-ai-starter-kit","name":"self-hosted-ai-starter-kit","tagline":"Self-hosted AI Starter Kit template for local AI workflows","github_url":"https://github.com/n8n-io/self-hosted-ai-starter-kit","owner":"n8n-io","repo":"self-hosted-ai-starter-kit","owner_avatar_url":"https://avatars.githubusercontent.com/u/45487711?v=4","primary_language":null,"stars":15258,"forks":3813,"topics":["ai","ai-agents","low-code","self-hosted","starter-kit"],"archived":false,"github_pushed_at":"2026-07-23T11:28:09+00:00","maintenance_label":"Steady","url":"https://www.graphcanon.com/tools/n8n-io-self-hosted-ai-starter-kit","markdown_url":"https://www.graphcanon.com/tools/n8n-io-self-hosted-ai-starter-kit.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/n8n-io-self-hosted-ai-starter-kit","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=n8n-io-self-hosted-ai-starter-kit","shared_categories":[]},{"slug":"xorbitsai-inference","name":"inference","tagline":"Unified production-ready inference API for various LLMs and models","github_url":"https://github.com/xorbitsai/inference","owner":"xorbitsai","repo":"inference","owner_avatar_url":"https://avatars.githubusercontent.com/u/109655068?v=4","primary_language":"Python","stars":9575,"forks":866,"topics":["artificial-intelligence","deployment","diffusers","gemma","glm","glm-5-3","inference","kimi","kimi-k3","llama-cpp","llamacpp","llm","machine-learning","openai-api","pytorch","qwen","sglang","transformers","vllm","whisper"],"archived":false,"github_pushed_at":"2026-09-18T06:04:24+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/xorbitsai-inference","markdown_url":"https://www.graphcanon.com/tools/xorbitsai-inference.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/xorbitsai-inference","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=xorbitsai-inference","shared_categories":["inference-serving"]},{"slug":"tensorchord-awesome-llmops","name":"Awesome-LLMOps","tagline":"An awesome & curated list of best LLMOps tools for developers","github_url":"https://github.com/tensorchord/Awesome-LLMOps","owner":"tensorchord","repo":"Awesome-LLMOps","owner_avatar_url":"https://avatars.githubusercontent.com/u/100543303?v=4","primary_language":"Shell","stars":5941,"forks":1058,"topics":["ai-development-tools","awesome-list","llmops","mlops"],"archived":false,"github_pushed_at":"2026-05-21T09:12:50+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/tensorchord-awesome-llmops","markdown_url":"https://www.graphcanon.com/tools/tensorchord-awesome-llmops.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/tensorchord-awesome-llmops","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=tensorchord-awesome-llmops","shared_categories":["inference-serving"]},{"slug":"kiln-ai-kiln","name":"Kiln","tagline":"Build, Evaluate, and Optimize AI Systems","github_url":"https://github.com/Kiln-AI/Kiln","owner":"Kiln-AI","repo":"Kiln","owner_avatar_url":"https://avatars.githubusercontent.com/u/178670964?v=4","primary_language":"Python","stars":5076,"forks":380,"topics":["ai","chain-of-thought","collaboration","dataset-generation","evals","evaluation","evaluation-framework","fine-tuning","machine-learning","macos","mcp","ml","ollama","openai","prompt","prompt-engineering","python","rlhf","synthetic-data","windows"],"archived":false,"github_pushed_at":"2026-09-19T18:07:44+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/kiln-ai-kiln","markdown_url":"https://www.graphcanon.com/tools/kiln-ai-kiln.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/kiln-ai-kiln","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=kiln-ai-kiln","shared_categories":[]},{"slug":"seldonio-seldon-core","name":"seldon-core","tagline":"An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models","github_url":"https://github.com/SeldonIO/seldon-core","owner":"SeldonIO","repo":"seldon-core","owner_avatar_url":"https://avatars.githubusercontent.com/u/10297834?v=4","primary_language":"Go","stars":4782,"forks":866,"topics":["aiops","deployment","kubernetes","machine-learning","machine-learning-operations","mlops","production-machine-learning","serving"],"archived":false,"github_pushed_at":"2026-03-23T11:39:54+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/seldonio-seldon-core","markdown_url":"https://www.graphcanon.com/tools/seldonio-seldon-core.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/seldonio-seldon-core","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=seldonio-seldon-core","shared_categories":["inference-serving"]},{"slug":"pytorch-serve","name":"serve","tagline":"Serve, optimize and scale PyTorch models in production","github_url":"https://github.com/pytorch/serve","owner":"pytorch","repo":"serve","owner_avatar_url":"https://avatars.githubusercontent.com/u/21003710?v=4","primary_language":"Java","stars":4344,"forks":880,"topics":["cpu","deep-learning","docker","gpu","kubernetes","machine-learning","metrics","mlops","optimization","pytorch","serving"],"archived":true,"github_pushed_at":"2025-08-06T19:17:08+00:00","maintenance_label":"Archived","url":"https://www.graphcanon.com/tools/pytorch-serve","markdown_url":"https://www.graphcanon.com/tools/pytorch-serve.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/pytorch-serve","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=pytorch-serve","shared_categories":["inference-serving"]},{"slug":"a16z-infra-ai-getting-started","name":"ai-getting-started","tagline":"A Javascript AI getting started stack for weekend projects","github_url":"https://github.com/a16z-infra/ai-getting-started","owner":"a16z-infra","repo":"ai-getting-started","owner_avatar_url":"https://avatars.githubusercontent.com/u/130202746?v=4","primary_language":"TypeScript","stars":4142,"forks":659,"topics":[],"archived":false,"github_pushed_at":"2024-08-21T12:35:18+00:00","maintenance_label":"Dormant","url":"https://www.graphcanon.com/tools/a16z-infra-ai-getting-started","markdown_url":"https://www.graphcanon.com/tools/a16z-infra-ai-getting-started.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/a16z-infra-ai-getting-started","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=a16z-infra-ai-getting-started","shared_categories":[]},{"slug":"superlinked-sie","name":"sie","tagline":"Open-source inference server and production cluster for all the models your agent needs.","github_url":"https://github.com/superlinked/sie","owner":"superlinked","repo":"sie","owner_avatar_url":"https://avatars.githubusercontent.com/u/94243920?v=4","primary_language":"Python","stars":3293,"forks":311,"topics":["bge","colbert","data-pipeline","deep-learning","embeddings","inference","inference-server","information-retrieval","llm","ml","mlops","natural-language-processing","nlp","python","reranking","retrieval","retrieval-augmented-generation","semantic-search","splade","vector-search"],"archived":false,"github_pushed_at":"2026-09-19T01:00:02+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/superlinked-sie","markdown_url":"https://www.graphcanon.com/tools/superlinked-sie.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/superlinked-sie","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=superlinked-sie","shared_categories":["inference-serving"]},{"slug":"pezzolabs-pezzo","name":"pezzo","tagline":"Open-source, developer-first LLMOps platform","github_url":"https://github.com/pezzolabs/pezzo","owner":"pezzolabs","repo":"pezzo","owner_avatar_url":"https://avatars.githubusercontent.com/u/119122072?v=4","primary_language":"TypeScript","stars":3273,"forks":279,"topics":["ai","devtools","gpt-3","gpt-4","hacktoberfest","javascript","langchain","llm","llmops","monitoring","nestjs","nodejs","observability","openai","platform","prompt","prompt-engineering","prompt-management","python","typescript"],"archived":false,"github_pushed_at":"2026-08-21T21:40:31+00:00","maintenance_label":"Steady","url":"https://www.graphcanon.com/tools/pezzolabs-pezzo","markdown_url":"https://www.graphcanon.com/tools/pezzolabs-pezzo.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/pezzolabs-pezzo","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=pezzolabs-pezzo","shared_categories":[]},{"slug":"b4rtaz-distributed-llama","name":"distributed-llama","tagline":"Distributed LLM inference using home devices cluster","github_url":"https://github.com/b4rtaz/distributed-llama","owner":"b4rtaz","repo":"distributed-llama","owner_avatar_url":"https://avatars.githubusercontent.com/u/12797776?v=4","primary_language":"C++","stars":3060,"forks":250,"topics":["distributed-computing","distributed-llm","llama2","llama3","llm","llm-inference","llms","neural-network","open-llm"],"archived":false,"github_pushed_at":"2026-07-05T16:47:20+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/b4rtaz-distributed-llama","markdown_url":"https://www.graphcanon.com/tools/b4rtaz-distributed-llama.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/b4rtaz-distributed-llama","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=b4rtaz-distributed-llama","shared_categories":["inference-serving"]},{"slug":"jina-ai-langchain-serve","name":"langchain-serve","tagline":"Self-host LLM Apps with Docker Compose or Kubernetes","github_url":"https://github.com/jina-ai/langchain-serve","owner":"jina-ai","repo":"langchain-serve","owner_avatar_url":"https://avatars.githubusercontent.com/u/60539444?v=4","primary_language":"Python","stars":1639,"forks":133,"topics":["autogpt","autonomous-agents","babyagi","chatbot","fastapi","gpt","langchain","llm","production","python","slack"],"archived":true,"github_pushed_at":"2023-09-20T04:01:50+00:00","maintenance_label":"Archived","url":"https://www.graphcanon.com/tools/jina-ai-langchain-serve","markdown_url":"https://www.graphcanon.com/tools/jina-ai-langchain-serve.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/jina-ai-langchain-serve","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=jina-ai-langchain-serve","shared_categories":["inference-serving"]},{"slug":"waybarrios-vllm-mlx","name":"vllm-mlx","tagline":"Server for LLMs and vision-language models compatible with Apple Silicon","github_url":"https://github.com/waybarrios/vllm-mlx","owner":"waybarrios","repo":"vllm-mlx","owner_avatar_url":"https://avatars.githubusercontent.com/u/6794828?v=4","primary_language":"Python","stars":1588,"forks":222,"topics":["anthropic","anthropic-api","apple-silicon","claude-code","continuous-batching","inference-server","llm","local-llm","macos","mcp","mlx","multimodal-ai","openai","openai-api","openai-compatible","speech-to-text","text-to-speech","tool-calling","vision-language-model","vllm"],"archived":false,"github_pushed_at":"2026-09-19T18:11:07+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/waybarrios-vllm-mlx","markdown_url":"https://www.graphcanon.com/tools/waybarrios-vllm-mlx.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/waybarrios-vllm-mlx","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=waybarrios-vllm-mlx","shared_categories":["inference-serving"]}]}}