Question about configuration and GitOps #1817
-
|
Hi, nice project. The docs says there's GitOps Support, but I did not see any examples there. I do understand that maybe the docs just means that I can manage all the configs with git as I will, but still I wonder how to reload the config when it changes? It seems the only way now is to restart the gateway app. However this will introduce downtime except when deployed in something like k8s which does rolling update. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
Hi @artiga033 - thank you! We did mean that everything you need to orchestrate your LLM application with TensorZero lives in code + config (vs. a database, like many other LLMOps tools). Today, you need to restart the gateway to reload the configuration. I agree it's not ideal - we've discussed adding automatic config reloading and likely will support that in the future. The gateway + UI will watch for file changes and reload accordingly. For now, you'll have to restart the gateway though. Moved to a feature request: #1821 Thank you for the feedback! |
Beta Was this translation helpful? Give feedback.
Hi @artiga033 - thank you!
We did mean that everything you need to orchestrate your LLM application with TensorZero lives in code + config (vs. a database, like many other LLMOps tools).
Today, you need to restart the gateway to reload the configuration. I agree it's not ideal - we've discussed adding automatic config reloading and likely will support that in the future. The gateway + UI will watch for file changes and reload accordingly. For now, you'll have to restart the gateway though.
Moved to a feature request: #1821
Thank you for the feedback!