omlx
Llm Open SourceLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
About omlx
Supported Platforms
Related in Llm
hermes-agent
The agent that grows with you
AutoGPT
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
firecrawl
The web data API to search, scrape, and interact at scale. 🔥
ollama
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without reb
open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)