An open-source gateway that provides a unified model API, routing, budgets, retries, and observability. It is suitable for building a compatibility layer and cost controls across multiple model providers.
AvailableAILLM APIRoutingCost governance
Source overview
An open-source gateway that provides a unified model API, routing, budgets, retries, and observability. It is suitable for building a compatibility layer and cost controls across multiple model providers.
The upstream project does not provide a product interface screenshot that can be embedded here. It is primarily used through APIs, the command line, or an SDK; see examples in the official repository and documentation.