tinycmdr
tinycmdr: the high-efficiency agent harness for local & self-hosted LLMs (llama.cpp, vLLM, Ollama, SGLang): ~4.1K token overhead, stable prefix...
Tool overview
Overview
tinycmdr: the high-efficiency agent harness for local & self-hosted LLMs (llama.cpp, vLLM, Ollama, SGLang): ~4.1K token overhead, stable prefix caching, built-in ops guards, zero infrastructure.
Features
- AI assistant
- Natural language interface
- Workflow automation
Tags
User Reviews
Related Tools
View moreLynote
Lynote combines AI-draft rewriting and AI-text detection with note-taking, transcription, video summaries, and study tools.
LMSYS Chatbot Arena Leaderboard
LMSYS Chatbot Arena is a crowdsourced open platform for LLM evals. Collected over 1,000,000 human pairwise comparisons to rank LLMs with the Bradley-Terry model and display the model ratings in Elo-scale.
智谱清言
Zhipu Qingyan is a GLM-based AI assistant whose official description emphasizes understanding goals, breaking down tasks, and using tools.
豆包
字节跳动AI助手