Does tensorzero gateway support encodings such as brotli or gzip? #5242
-
|
For example, for very large text to process its probably ideal to encode them first before passing them to t0 to save bandwidth or avoid limits. |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
|
Hi @RubyBit |
Beta Was this translation helpful? Give feedback.
-
|
Ok, great I'll implement this then. |
Beta Was this translation helpful? Give feedback.
Hi @RubyBit
We don't currently support this but it seems like it would be a straightforward change where we'd add a
RequestDecompressionLayerto our gateway middleware stack usingtower-http. We would welcome a PR that adds this (should be straightforward to test as well).