Lightning-AI/LitServe

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

View on GitHub
Python
Stars 4.0k
Forks 332
License Apache-2.0
Open Issues 80
Updated 2h ago