FINE‑TUNING/INDEX
← All tools
The Fine-Tuning Index / PEFT & LoRA / #164

xyjigsaw/LLM-Pretrain-SFT

by xyjigsaw · PEFT & LoRA · updated 2y ago

Scripts of LLM pre-training and fine-tuning (w/wo LoRA, DeepSpeed)

22
momentum
88
stars
16
forks
#164
rank
baichuan2deepspeedlarge-language-modelsllamaloramistral
View on GitHub →

More in PEFT & LoRA

03PEFT & LoRA
peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
14PEFT & LoRA
OneTrainer
OneTrainer is a one-stop solution for all your Diffusion training needs.
19PEFT & LoRA
xTuring
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTu
25PEFT & LoRA
Stable-Diffusion
FLUX, Stable Diffusion, SDXL, SD3, LoRA, Fine Tuning, DreamBooth, Training, Automatic1111,