Skip to content

Update low_level_api examples - #153

Merged
abetlen merged 9 commits into
abetlen:mainfrom
SagsMug:main
May 8, 2023
Merged

abetlen merged 9 commits into
abetlen:mainfrom
SagsMug:main

Conversation

@SagsMug

@SagsMug SagsMug commented May 4, 2023 •

Copy link
Copy Markdown
Contributor

Updates chat example
Updates plain llama example
Adds some usage examples

TODO:

  • Test lora

Should fix #141

@SagsMug
SagsMug marked this pull request as draft May 4, 2023 16:35
@SagsMug
SagsMug marked this pull request as ready for review May 6, 2023 10:41
@SagsMug

SagsMug commented May 8, 2023

Copy link
Copy Markdown
Contributor Author

@abetlen I think you can review this now.
I dont really know any lora's, so its left untested
Mirostat was only added to chat, i can add it to the plain example aswell.

@abetlen

abetlen commented May 8, 2023

Copy link
Copy Markdown
Owner

@SagsMug looks good to me, great work.

@abetlen
abetlen merged commit ed0f48b into abetlen:main May 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Update low-level examples to use new sampling API

2 participants