{"data":{"slug":"waybarrios-vllm-mlx","name":"vllm-mlx","tagline":"OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX bac","github_url":"https://github.com/waybarrios/vllm-mlx","owner":"waybarrios","repo":"vllm-mlx","owner_avatar_url":"https://avatars.githubusercontent.com/u/6794828?v=4","primary_language":"Python","stars":1421,"forks":195,"topics":["anthropic","apple-silicon","audio-processing","claude-code","computer-vision","image-understanding","inference","llm","machine-learning","macos","mllm","mlx","multimodal-ai","speech-to-text","stt","text-to-speech","tts","video-understanding","vision-language-model","vllm"],"archived":false,"github_pushed_at":"2026-06-28T20:18:31+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/waybarrios-vllm-mlx","markdown_url":"https://www.graphcanon.com/tools/waybarrios-vllm-mlx.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/waybarrios-vllm-mlx","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=waybarrios-vllm-mlx","description":"OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX backend, 400+ tok/s. Works with Claude Code.","homepage_url":null,"license":"Apache-2.0","open_issues":59,"watchers":13,"ai_summary":null,"readme_excerpt":"## Quick start (30 seconds)\n\n```bash\npip install vllm-mlx\nvllm-mlx serve mlx-community/Llama-3.2-3B-Instruct-4bit --port 8000 --continuous-batching\n```\n\n**OpenAI SDK:**\n\n```python\nfrom openai import OpenAI\nclient = OpenAI(base_url=\"http://localhost:8000/v1\", api_key=\"not-needed\")\nr = client.chat.completions.create(model=\"default\", messages=[{\"role\": \"user\", \"content\": \"Hi!\"}])\nprint(r.choices[0].message.content)\n```\n\n**Anthropic SDK / Claude Code:**\n\n```bash\nexport ANTHROPIC_BASE_URL=http://localhost:8000\nexport ANTHROPIC_API_KEY=not-needed\nclaude\n```\n\n---\n\n## Installation\n\n**Using uv (recommended):**\n\n```bash\nuv tool install vllm-mlx                 # CLI, system-wide\n\n---\n\n## License\n\nApache 2.0. See [LICENSE](LICENSE).","github_created_at":"2025-12-06T18:26:08+00:00","created_at":"2026-07-11T12:11:13.753604+00:00","updated_at":"2026-07-11T12:11:19.778259+00:00","categories":[{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"},{"slug":"speech-audio","name":"Speech & Audio","url":"https://www.graphcanon.com/categories/speech-audio","markdown_url":"https://www.graphcanon.com/categories/speech-audio.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/speech-audio"}],"tags":[{"slug":"anthropic","name":"anthropic"},{"slug":"apple-silicon","name":"apple-silicon"},{"slug":"audio-processing","name":"audio-processing"},{"slug":"claude-code","name":"claude-code"},{"slug":"computer-vision","name":"computer-vision"},{"slug":"image-understanding","name":"image-understanding"},{"slug":"inference","name":"inference"},{"slug":"llm","name":"llm"}],"trust":{"provenance":{"is_fork":false,"github_id":1111335968,"owner_type":"User","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-11T12:11:14.471Z","maintenance":{"label":"Active","score":82,"methodology":"github_public_v1","releases_90d":5,"days_since_push":12,"last_release_at":"2026-06-28T20:20:22Z"},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T12:11:15.589Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-11T12:11:15.207Z"},"has_cli":{"value":true,"source":"pyproject.toml:[project.scripts]","observed_at":"2026-07-11T12:11:15.207Z"},"languages":{"value":["python"],"source":"github.language+pyproject.toml","observed_at":"2026-07-11T12:11:15.207Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-07-11T12:11:15.207Z"}}}}