The Fine-Tuning Index / Training Frameworks / #28

intel/auto-round

by intel · Training Frameworks · updated today

A simple and effective post training quantization toolkit for high-accuracy low-bit LLM inference|简洁且高效的后训练量化工具包

68
momentum
1,623
stars
177
forks
#28
rank
diffusersggufint4llmsmxfp4nvfp4omniquantizationroundingsglangtransformersvllm
View on GitHub →