FINE‑TUNING/INDEX
← All tools
The Fine-Tuning Index / Quantize & Merge / #145

hahnyuan/RPTQ4LLM

by hahnyuan · Quantize & Merge · updated 3y ago

Reorder-based post-training quantization for large language model

26
momentum
201
stars
16
forks
#145
rank
View on GitHub →

More in Quantize & Merge

13Quantize & Merge
ai-engineering-interview-questions
Your Cheat Sheet for AI Engineering Interview – Questions and Answers.
92Quantize & Merge
AI-Engineering.academy
Mastering Applied AI, One Concept at a Time
96Quantize & Merge
GSQ
Gumbel-Softmax post-training quantization for LLMs (1–3 bit scalar, INT/GGUF-compatible).
140Quantize & Merge
BiLLM
[ICML 2024] BiLLM: Pushing the Limit of Post-Training Quantization for LLMs