Skip to content

Tags: NVIDIA/kvpress

Tags

v0.5.0

Toggle v0.5.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Upgrade to transformers v5 (#180)

v0.4.3

Toggle v0.4.3's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Update DMSPress and KVzapPress (#177)

v0.4.2

Toggle v0.4.2's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Rename ThresholdPress to DMSPress (#174)

v0.4.1

Toggle v0.4.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Add KVzapPress and ThresholdPress (#171)

v0.4.0

Toggle v0.4.0's commit message
Release v0.4.0

- Add CURPress - CUR decomposition-based KV cache compression (#150)
- Add Compactor press for enhanced compression capabilities (#143)
- Add decoding press functionality for compression during decoding (#139)
- Add AIME25 and Math500 benchmark datasets for evaluation (#142)
- Add post_init_from_model hook to BasePress for model-specific initialization (#163)

- Move tests to GPU for faster CI (#132)
- Improve needle-in-haystack test (#133)
- Update README and documentation (#162)
- Update docstrings (#159)
- Update decoding notebook (#156)
- Move utils, clean and fix imports (#160)

- Fix LongBench-v2 benchmark (#161)
- Fix kvzip press access to past_key_values
- Fix ComposedPress (#148)
- Fix imports (#144)

v0.3.0

Toggle v0.3.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Transformers compatibility (#115)

v0.2.10

Toggle v0.2.10's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Migration to uv (#108)

v0.2.9

Toggle v0.2.9's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Fix trandformers<4.54.0

v0.2.8

Toggle v0.2.8's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Fix failing tests (#94)

v0.2.7

Toggle v0.2.7's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
add Alessio to authors (#92)