Lattice and trellis-coded quantization for LLM weights — 2–8 bpw, mixed-precision, fused CUDA tensor-core inference on vLLM + HF
-
Updated
Oct 25, 2026 - Python
Lattice and trellis-coded quantization for LLM weights — 2–8 bpw, mixed-precision, fused CUDA tensor-core inference on vLLM + HF
Independent EXL3/QTIP trellis-quantization inference library for AMD Strix Halo (gfx1151): CPU reference, HIP decode kernels and a C ABI. Developed and measured with DeepSeek V4.1 Flash.
💎 LTS Industrial Standard: PDF/Word optimization with scientific Trellis Mimic engine. Features Turbo Parallel processing & Global Camouflage (Ricoh/Fujitsu/Canon 2025 profiles). Embedded Python 3.12, zero-install, no admin needed. Ultimate document privacy for Windows LTSC/Enterprise.
To associate your repository with the trellis-quantization topic, visit your repo's landing page and select "manage topics."