An introduction to fine-tuning LLMs at home with Axolotl • The Register
https://www.theregister.com/2024/11/10/llm_finetuning_guide/?td=rt-9c
In this guide we'll discuss:
Where and when fine-tuning can be useful.
Alternative approaches to extending the capabilities and behavior of pre-trained models.
The importance of data preparation.
How to fine-tune Mistral 7B using your own custom dataset with Axolotl.
The many hyperparameters and their effect on training.
Additional resources to help you fine-tune your models faster and more efficiently.