Repository navigation
docs(examples/monitoring): add chatd lifecycle Grafana dashboard - #29735
Closed
jscottmiller wants to merge 1 commit into
Closed
jscottmiller wants to merge 1 commit into
jscottmiller wants to merge 1 commit into
Conversation
This was referenced Sep 22, 2026
jscottmiller
force-pushed
the
scott/chatd-dashboard
branch
from
September 23, 2026 03:06
5017e5b to
562ffc2
Compare
Add a Grafana dashboard that plots the chatd stage histogram and the turn-end rollups one tree level at a time with a selectable summary statistic, plus summary panels for the chat pipeline, the per-turn partition of turn wall time, and a Model row reading the per-model stage histogram for time to first token, stream duration, and provider attempts by provider type. The README documents the stage hierarchy by tree level, the dashboard dimensions, each panel group, and setup. Rows that need only the basic stage metrics level are expanded by default; the per-turn distribution panels and the stages observed only at the full level sit in collapsed rows named for the level. A stat panel reports the level from coderd_chatd_stage_metrics_level. The README adds a metric levels section with series cost measured against a dogfood replica's baseline, example alert rules on the round bucket edges, and a scrape-time relabel snippet for alert-only deployments.
jscottmiller
force-pushed
the
scott/chatd-dashboard
branch
from
September 23, 2026 04:07
562ffc2 to
090c0ed
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Grafana dashboard for the chatd lifecycle metrics at
examples/monitoring/dashboards/grafana/chatd-lifecycle/, with a README covering the stage tree, dimensions, caveats, series cost, alert examples, and setup.Depends on the chatd lifecycle observability stack (#29769 through #29772). The families the panels read (
coderd_chatd_stage_duration_seconds,coderd_chatd_model_stage_duration_seconds, and the turn-end counters) land in that stack behind thechat-stage-metricsexperiment, so this stays a draft until it merges. Moved out of the stack from #28975 so the dashboard can be reviewed independently of the Go changes.Rows, sharing one
$statselector (mean, p50, p90, p95, p99):turn_time_seconds_total.generation_step,prepare,thinking, andcompactionare span-only and not plotted.coderd_chatd_model_stage_duration_seconds, plus background provider calls.Variables:
$datasource,$stat,$chat_kind,$model;$modelapplies only to the Model row since no other family carries the label. Every division guards its denominator and everyhistogram_quantilekeepsle.Rows for the
chat-stage-metrics-fullfamilies (#29775) are not included here.Verified live (Grafana 12.1, Prometheus, Tempo) before the model histogram and the label changes landed; the reworked Model row has been checked against the metric definitions but not yet re-driven live.
🤖 This PR was generated by Coder Agents on behalf of @jscottmiller.