Skip to content

Implement streaming for Functionary v2 + Bug fixes#1419

Merged
abetlen merged 7 commits intoabetlen:mainfrom
jeffrey-fong:functionary-stream
May 4, 2024
Merged

Implement streaming for Functionary v2 + Bug fixes#1419
abetlen merged 7 commits intoabetlen:mainfrom
jeffrey-fong:functionary-stream

Conversation

@jeffrey-fong
Copy link
Contributor

Features

  • Set up streaming for functionary-v2 chat handler
  • Raises error if users use functionary-v1
  • Returns only 1 function/tool call if functions is provided and >= 1 if tools is provided

Bug Fixes

  • Fix function-call={...} always converted to auto bug

@abetlen
Copy link
Owner

abetlen commented May 4, 2024

@jeffrey-fong thank you, looks good to me!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants