litellm

Rust Open Source

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropi

★ 59,716 Stars ⑂ 11,819 Forks License: Other

Download Latest Release Official Website ↗ GitHub Repository ↗

About litellm

Supported Platforms

Open Source Web Cross-Platform

Related in Rust

rustdesk

An open-source remote desktop application designed for self-hosting, as an alternative to TeamViewer.

rust

Empowering everyone to build reliable and efficient software.

tauri

Build smaller, faster, and more secure desktop and mobile applications with a web frontend.

deno

A modern runtime for JavaScript and TypeScript.

union

The trust-minimized, zero-knowledge bridging protocol, designed for censorship resistance, extremely high security, and usage in decentralized finance.

ripgrep

ripgrep recursively searches directories for a regex pattern while respecting your gitignore