Show HN: Finetune LLaMA-7B on commodity GPUs using your own text https://ift.tt/2MDgIRz

Show HN: Finetune LLaMA-7B on commodity GPUs using your own text I've been playing around with https://ift.tt/cXFAHBn and https://ift.tt/EaRp0qh , and wanted to create a simple UI where you can just paste text, tweak the parameters, and finetune the model quickly using a modern GPU. To prepare the data, simply separate your text with two blank lines. There's an inference tab, so you can test how the tuned model behaves. This is my first foray into the world of LLM finetuning, Python, Torch, Transformers, LoRA, PEFT, and Gradio. Enjoy! https://ift.tt/qLkhtTy March 22, 2023 at 05:15AM