Skip to content

Add support for targeting multiple sequence lengths in text servings - #228

Merged
jonatanklosko merged 6 commits into
mainfrom
jk-batch-keys
Jul 31, 2023
Merged

Add support for targeting multiple sequence lengths in text servings#228
jonatanklosko merged 6 commits into
mainfrom
jk-batch-keys

Conversation

@jonatanklosko

@jonatanklosko jonatanklosko commented Jul 28, 2023

Copy link
Copy Markdown
Member

TODOs

  • mirror in other servings
  • override Rust tokenizers to never pad by default

Comment thread lib/bumblebee/utils/tokenizers.ex Outdated
Comment thread lib/bumblebee/utils/tokenizers.ex Outdated
@jonatanklosko
jonatanklosko merged commit b9bc8f0 into main Jul 31, 2023
@jonatanklosko
jonatanklosko deleted the jk-batch-keys branch July 31, 2023 21:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants