DigiNews

Tech Watch by Johan Denoyer

← Back to articles

Show HN: Log every LLM call with tokens, cost, latency, and time to first token

Quality: 8/10 Relevance: 9/10

Summary

The post introduces llmtee, a self-hosted proxy that logs every LLM call, including tokens, cost, latency, and time to first token. It forwards requests to OpenAI-compatible providers and stores logs in SQLite or PostgreSQL, with a web UI and metrics for spend visibility.

🚀 Service construit par Johan Denoyer