vllm-mlx

Llm Open Source

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

★ 1,601 Stars ⑂ 226 Forks License: Apache License 2.0

Download Latest Release Official Website ↗ GitHub Repository ↗

About vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

Supported Platforms

anthropic anthropic-api apple-silicon claude-code continuous-batching inference-server llm local-llm

Related in Llm

hermes-agent

The agent that grows with you

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

firecrawl

🔥 Supercharge your AI agents with data from the web and beyond. A web data API to search, scrape, and access more sources.

ollama

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

dify

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

open-webui

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)