uvicorn launching fastapi Streaming works fine when using reload and not when not using it #11565
Replies: 1 comment 1 reply
-
|
Why was this discussion closed? Does anybody have more insight into this behavior? I'm running across the same thing when trying to work with uvicorn, fastapi and langchain agent streaming methods.
What exactly is happening here? |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
First Check
Commit to Help
Example Code
Description
When I use fastapi to make a streaming interface, I encountered such a problem, not quite sure whether it is a problem with the code I wrote or a problem with fastapi, so I mentioned here to start the question.
When I use the following command, my code returns normally step-by-step in streaming fashion
But when I use the following command, the streaming doesn't return properly and the returned response is returned as if it were non-streaming.
My library version
I want to know if I need to stream normally without adding --reload how should I implement it.
2024-05-10.16-23-08.mp4
Operating System
Linux, Windows
Operating System Details
No response
FastAPI Version
0.111.0
Pydantic Version
2.7.0b1
Python Version
3.10.14
Additional Context
No response
Beta Was this translation helpful? Give feedback.
All reactions