-
Notifications
You must be signed in to change notification settings - Fork 766
Open
Description
This issue is closely related to #273 and could be considered as a follow up to that, but I decided to split it for convenience and readability.
Consider an MCP server written with this SDK and using the StreamableHttp transport. We deploy two replicas (A and B) of this server, with a load balancer in front.
- A new client application initiates a session by sending an
initializemessage, followed by anotifications/initializednotifications. - Let's say that the Load Balancer routed both messages to replica
A - As a result, replica
Agenerated a new session which Id is communicated back to the client - Replica
Anow has anMcpServerSessioninstance properly initialized with all the necessary client information
Problem:
- Next the client sends a
tools/listmessage with the obtain sessionId, but this time the load balancer routes the message to replicaB - Even though I believe it should be the server's responsibility to share the session id across replicas, the
McpServerSessioninstance that lives in replicaBhas never received (and will never receive) the initialize message and notifications - Although it's possible to distribute all that state and
simulatethat handshake in replicaB(I actually did it), I think this SDK should have an OOTB support for that, or at the very least, SessionFactory methods that make it easier to generate "ready to use" Sessions based on previous initializations.
iaculch, stantonk, insford and gianielsevier
Metadata
Metadata
Assignees
Labels
No labels