The Fine-Tuning Index / RLHF & Preference / #11
MakazhanAlpamys/Soup
by MakazhanAlpamys · RLHF & Preference · updated today
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
75
momentum
6,179
stars
954
forks
#11
rank
cliconsumer-gpudpofine-tuningggufhuggingfacellmllmopslocal-ailocal-llmloralow-vram
View on GitHub →