The Fine-Tuning Index / Quantize & Merge / #87
IST-DASLab/GSQ
by IST-DASLab · Quantize & Merge · updated 2mo ago
Gumbel-Softmax post-training quantization for LLMs (1–3 bit scalar, INT/GGUF-compatible).
40
momentum
49
stars
7
forks
#87
rank
ggufllmpost-training-quantizationquantization
View on GitHub →