Description
An example is Crush's edit tool. Even frontier LLMs will switch between old_string (correct) and old-string (incorrect) the current error message simply states ERROR: missing required parameter: old_string but if the error string said something like ERROR: missing required parameter: old_string, unknown additional parameter old-string via stricter checking against declared parameters. Then most LLM's would notice the problem rather than assume they performed the tool-use correctly and it's the tool that is broken.
Description
An example is Crush's edit tool. Even frontier LLMs will switch between
old_string(correct) andold-string(incorrect) the current error message simply statesERROR: missing required parameter: old_stringbut if the error string said something likeERROR: missing required parameter: old_string, unknown additional parameter old-stringvia stricter checking against declared parameters. Then most LLM's would notice the problem rather than assume they performed the tool-use correctly and it's the tool that is broken.