Skip to content

feat: add stateless AI Gateway proxy mode - #29349

Open
pawbana wants to merge 1 commit into
pawel/aigov-614-add-ai-gateway-reverse-proxy-experiment-and-stateless-proxy-2from
pawel/aigov-614-add-ai-gateway-reverse-proxy-experiment-and-stateless-proxy-3
Open

pawbana wants to merge 1 commit into
pawel/aigov-614-add-ai-gateway-reverse-proxy-experiment-and-stateless-proxy-2from
pawel/aigov-614-add-ai-gateway-reverse-proxy-experiment-and-stateless-proxy-3

Conversation

@pawbana

@pawbana pawbana commented Sep 15, 2026

Copy link
Copy Markdown
Contributor

Adds proxy mode to the AI Gateway. No AI provider is supported in this mode yet.

  • Use proxy mode when ai-gateway-reverse-proxy is enabled and no MCP servers are configured. Otherwise, keep current interception mode.
  • Use the same proxy behavior whether the gateway runs inside Coder or separately. Apply provider configuration changes to new requests without interrupting requests already running.
  • Support provider configuration updates, API key metrics, experiment settings, and graceful shutdown in both modes.
  • Return 503 until provider configuration is loaded. Requests to enabled providers return 404 until provider support is implemented.
  • Add tests for request handling, configuration updates, shutdown, and both gateway deployments.

Generated by Coder Agents on behalf of @pawbana.

@linear-code

linear-code Bot commented Sep 15, 2026

Copy link
Copy Markdown

AIGOV-614

@pawbana
pawbana added this pull request to stack #29350 September 15, 2026 13:02
@pawbana
pawbana force-pushed the pawel/aigov-614-add-ai-gateway-reverse-proxy-experiment-and-stateless-proxy-3 branch from eaebdac to 906504b Compare September 15, 2026 13:36
@pawbana
pawbana force-pushed the pawel/aigov-614-add-ai-gateway-reverse-proxy-experiment-and-stateless-proxy-3 branch from 906504b to a092b17 Compare September 15, 2026 14:41
@pawbana
pawbana force-pushed the pawel/aigov-614-add-ai-gateway-reverse-proxy-experiment-and-stateless-proxy-3 branch from a092b17 to c382cf7 Compare September 15, 2026 14:57
@pawbana
pawbana requested a review from johnstcn September 15, 2026 16:06
@pawbana
pawbana marked this pull request as ready for review September 15, 2026 16:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant