paddler
Llm Open SourceOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale ππ¦ Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
About paddler
Supported Platforms
Related in Llm
hermes-agent
The agent that grows with you
AutoGPT
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
firecrawl
π₯ Supercharge your AI agents with data from the web and beyond. A web data API to search, scrape, and access more sources.
ollama
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)