OpenHub apps.khokey.com
inference logo

inference

Machine-Learning Open Source

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready

★ 9,593 Stars ⑂ 868 Forks License: Apache License 2.0