Skip to content

Add HuggingFace leaderboard#98

Merged
alessiodevoto merged 6 commits intomainfrom
fix-eval
Jul 17, 2025
Merged

Add HuggingFace leaderboard#98
alessiodevoto merged 6 commits intomainfrom
fix-eval

Conversation

@alessiodevoto
Copy link
Contributor

@alessiodevoto alessiodevoto commented Jul 15, 2025 •
edited
Loading

PR description

  • Adds the possibility of testing without compression (using Knorm with 0% compression rate)
  • Adds link to HF leaderboard

Checklist

  • Tests are working (make test)
  • Code is formatted correctly (make style, on errors try fix with make format)
  • Copyright header is included
  • All commits are signed-off using git commit -s
  • (new press) mypress_press.py is in the presses directory
  • (new press) MyPress is in __init__.py
  • (new press) README.md is updated with a 1 liner about the new press in the Available presses section
  • (new press) New press is in the default_presses list in tests/default_presses.py
  • (new press) A docstring is provided that follows the same structure as the existing ones

@alessiodevoto
update eval and lb link
71b4364 
Signed-off-by: alessiodevoto <devoto.alessio@gmail.com>
@alessiodevoto
llama version
3352509 
Signed-off-by: alessiodevoto <devoto.alessio@gmail.com>
maxjeblick
maxjeblick requested changes Jul 15, 2025
View reviewed changes
Copy link
Collaborator

@maxjeblick maxjeblick left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks a lot for the updates!
I left some comments we can discuss.

@alessiodevoto
minor eval change + test plot
d0cc51f 
Signed-off-by: alessiodevoto <devoto.alessio@gmail.com>
@alessiodevoto
plot size
f0ea497 
Signed-off-by: alessiodevoto <devoto.alessio@gmail.com>
@alessiodevoto
update plot
f01b811 
Signed-off-by: alessiodevoto <devoto.alessio@gmail.com>
@maxjeblick maxjeblick changed the title Minor update for evaluation Add HuggingFace leaderboard Jul 17, 2025
maxjeblick
maxjeblick reviewed Jul 17, 2025
View reviewed changes
@alessiodevoto
update suggestion
69fa2d1 
Signed-off-by: alessiodevoto <devoto.alessio@gmail.com>
maxjeblick
maxjeblick approved these changes Jul 17, 2025
View reviewed changes
Copy link
Collaborator

@maxjeblick maxjeblick left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks a lot, LGTM

@alessiodevoto alessiodevoto merged commit 0c36ab0 into main Jul 17, 2025
3 checks passed
@alessiodevoto alessiodevoto deleted the fix-eval branch July 17, 2025 14:52
maxjeblick pushed a commit that referenced this pull request Aug 12, 2025
@alessiodevoto @maxjeblick
Add HuggingFace leaderboard (#98)
18d0a79 
Signed-off-by: Max Jeblick <maximilianjeblick@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@maxjeblick maxjeblick maxjeblick approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@alessiodevoto @maxjeblick