LLMOps-Observability-Platform

新上架免费

A Python/FastAPI LLM gateway with SQLite request tracing, latency and cost metrics, caching, rate limiting, retries, circuit breakers, and model fallback. Includes simulated providers, reliability tests, GitHub Actions CI, and incident runbooks—no paid APIs required.