Skip to content

Add mean chart for bandits UI#4171

Merged
amishler merged 221 commits intomainfrom
viraj/bandits-ui-mean-inference
Oct 28, 2025
Merged

Add mean chart for bandits UI#4171
amishler merged 221 commits intomainfrom
viraj/bandits-ui-mean-inference

Conversation

@virajmehta
Copy link
Member

@virajmehta virajmehta commented Oct 24, 2025

Mostly done by @amishler

Adds a chart that shows the mean and confidence sequences for arms in a bandit problem.
Refactor of existing charts:

  • sets up separate components for mean + counts, adds tabbed layout for looking at them both
  • refactored selector out of counts chart
  • added references to metric name
  • added minute-level granularity
  • added a hook useTimeGranularityParam that allows us to avoid a lot of prop drilling in all the places we have time granularities that use URL state.
  • consolidated logic for x-axis formatting in a helper function
    There is an outstanding bug in the query + chart logic where some timeseries that should be computing cumulative statistics can be sparse if there is no new data in the time series for the window that we are querying over. @amishler has opened an issue for this I believe, and will fix next week.

Important

Add mean and feedback count charts for bandits UI, refactor existing charts, and introduce a hook for managing time granularity parameters.

  • Charts:
    • Add FeedbackMeansTimeseries and FeedbackCountsTimeseries components for displaying mean and feedback count charts.
    • Refactor FeedbackSamplesTimeseries to separate mean and count data.
    • Add useTimeGranularityParam hook to manage time granularity in URL state.
    • Consolidate x-axis formatting logic in chart.ts.
  • UI:
    • Add tabbed layout in FunctionExperimentation.tsx for switching between variant weights, estimated performance, and feedback count.
    • Update PieChart.tsx description and title for clarity.
  • Backend:
    • Update computeTrackAndStopOptimalProbabilities to handle track_and_stop experimentation.
    • Fetch feedback timeseries data for track_and_stop experimentation in route.tsx.
  • Misc:
    • Fix typo in README.md.
    • Minor logging changes in app.py.

This description was created by Ellipsis for de0a4af. You can customize this summary. It will automatically update as commits are pushed.

virajmehta and others added 30 commits September 26, 2025 11:23
Two constraint bugs:
- For the simplex constraint, had 1s everywhere instead of just at indices corresponding to the weights
- Signs were backwards in the SOCP constraints
@virajmehta virajmehta marked this pull request as ready for review October 24, 2025 16:18
@virajmehta
Copy link
Member Author

@codex review

Copy link

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@virajmehta virajmehta linked an issue Oct 26, 2025 that may be closed by this pull request
@GabrielBianconi
Copy link
Member

Minor copy/formatting changes

@amishler amishler enabled auto-merge October 27, 2025 22:05
amishler
amishler previously approved these changes Oct 27, 2025
@virajmehta virajmehta dismissed stale reviews from amishler and GabrielBianconi via de0a4af October 28, 2025 14:30
@amishler amishler added this pull request to the merge queue Oct 28, 2025
Merged via the queue into main with commit f8d3093 Oct 28, 2025
42 checks passed
@amishler amishler deleted the viraj/bandits-ui-mean-inference branch October 28, 2025 15:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Sort chart tooltip by mean in cumulative mean chart

3 participants