LitServe

Developer-Tools Open Source

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

★ 3,943 Stars ⑂ 310 Forks License: Apache License 2.0

Download Latest Release Official Website ↗ GitHub Repository ↗

About LitServe

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

Supported Platforms

Open Source Web Cross-Platform

Related in Developer-Tools

puppeteer

JavaScript API for Chrome and Firefox

hoppscotch

Open-Source API Development Ecosystem • https://hoppscotch.io • Offline, On-Prem & Cloud • Web, Desktop & CLI • Open-Source Alternative to Postman, Insomnia

archify

Agent skill for beautiful, verifiable architecture, workflow, sequence, data-flow, and lifecycle diagrams—self-contained HTML with motion and crisp export.

daytona

Daytona is a Secure and Elastic Infrastructure for Running AI-Generated Code

localstack

💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline

GitHubDaily

坚持分享 GitHub 上高质量、有趣实用的开源技术教程、开发者工具、编程网站、技术资讯。A list cool, interesting projects of GitHub.