OnnxStream logo

OnnxStream

Machine-Learning Open Source

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-

★ 2,089 Stars ⑂ 99 Forks License: Other