OpenHub DIRECTORY
KVSplit logo

KVSplit

Generative-Ai Open Source

Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality lo

★ 362 Stars ⑂ 14 Forks License: Other
Download Latest Release Official Website ↗ GitHub Repository ↗

About KVSplit

Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.

Supported Platforms

Open Source Web Cross-Platform

Related in Generative-Ai

langflow

langflow

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

 generative-ai-for-beginners

generative-ai-for-beginners

21 Lessons, Get Started Building with Generative AI

Prompt-Engineering-Guide

Prompt-Engineering-Guide

🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.

 ai-agents-for-beginners

ai-agents-for-beginners

18 Lessons to Get Started Building AI Agents

 Open-Generative-AI

Open-Generative-AI

Unrestricted Open-source alternative to AI video platforms — Free AI image & video generation studio with 600+ models (Flux, Midjourney, Kling, Sora, Veo). No content filters. Self-hosted, MIT license

 A2A

A2A

Agent2Agent (A2A) is an open protocol enabling communication and interoperability between opaque agentic applications.