vllm
Llm Open SourceA high-throughput and memory-efficient inference and serving engine for LLMs
★ 92,778 Stars
⑂ 22,714 Forks
License: Apache License 2.0
About vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Supported Platforms
Open Source Web Cross-Platform
Related in Llm
hermes-agent
The agent that grows with you
AutoGPT
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
firecrawl
The web data API to search, scrape, and interact at scale. 🔥
ollama
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without reb
open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)