The Fine-Tuning Index / PEFT & LoRA / #155
xyjigsaw/LLM-Pretrain-SFT
by xyjigsaw · PEFT & LoRA · updated 2y ago
Scripts of LLM pre-training and fine-tuning (w/wo LoRA, DeepSpeed)
22
momentum
87
stars
16
forks
#155
rank
baichuan2deepspeedlarge-language-modelsllamaloramistral
View on GitHub →