LLMOps-Observability-Platform
A Python/FastAPI LLM gateway with SQLite request tracing, latency and cost metrics, caching, rate limiting, retries, circuit breakers, and model...
Tool overview
Overview
A Python/FastAPI LLM gateway with SQLite request tracing, latency and cost metrics, caching, rate limiting, retries, circuit breakers, and model fallback. Includes simulated providers, reliability tests, GitHub Actions CI, and incident runbooks—no paid APIs required.
Features
- AI assistant
- Natural language interface
- Workflow automation
Tags
User Reviews
Related Tools
View moreLynote
Lynote combines AI-draft rewriting and AI-text detection with note-taking, transcription, video summaries, and study tools.
LMSYS Chatbot Arena Leaderboard
LMSYS Chatbot Arena is a crowdsourced open platform for LLM evals. Collected over 1,000,000 human pairwise comparisons to rank LLMs with the Bradley-Terry model and display the model ratings in Elo-scale.
智谱清言
Zhipu Qingyan is a GLM-based AI assistant whose official description emphasizes understanding goals, breaking down tasks, and using tools.
豆包
字节跳动AI助手