LMCache
Llm Open SourceLMCache: Supercharge Your LLM with the Fastest KV Cache Layer
★ 11,923 Stars
⑂ 1,960 Forks
License: Apache License 2.0
About LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Supported Platforms
Open Source Web Cross-Platform
Related in Llm
hermes-agent
The agent that grows with you
AutoGPT
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
firecrawl
The web data API to search, scrape, and interact at scale. 🔥
ollama
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without reb
open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)