feat(streaming): emit OTel metrics for ttft, tps, token counts - #347

Merged

x merged 9 commits into

nextfrom

x/llm-metrics-instrumentation

May 13, 2026

Commits on May 8, 2026

feat(streaming): add ttat (time-to-first-answering-token)
x
committed
b08e48f
review (greptile): swallow metric-emission errors in except handler
x
committed
1935aa9
refactor: emit LLM token / request metrics via RunHooks
x
committed
65d2e81
review: harden against malformed Usage shapes (litellm / non-OpenAI providers)
x
committed
229a3f5
fix: add @override on LLMMetricsHooks.on_llm_end for pyright
x
committed
56cd1f7