allowed_tools in OpenAI-compatible interface doesn't work when tools aren't declared in tensorzero.toml
#3546
Closed
ucirello
started this conversation in
Bug Reports
Replies: 2 comments 2 replies
-
|
Today, TensorZero assumes all dynamic tools are allowed. I agree we might want to change that; but that'll be a breaking change. Proposal For 1-2 releases, we should log After that:
The same behavior should be replicared for |
Beta Was this translation helpful? Give feedback.
2 replies
-
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Possibly a continuation of #3469
Right now, I can have functions declared in
tensorzero.tomlwhose tools are dynamically decided at inference time. I can set tool_choiceauto,none, andrequiredjust fine. When I setallowed_toolsthough, it only accepts tools that were declared intensorzero.tomlbreaking my expectation that I would be able to manipulate them at inference time.Beta Was this translation helpful? Give feedback.
All reactions