NEFTune : NOISY EMBEDDINGS IMPROVE INSTRUCTION FINE-TUNING. A new Instruction Fine-Tuning method increases LLM performance by up to 25%, with one line of code in HuggingFace TRL Transformer Library. NEFTune explained in theory and on a practical example. Arxiv pre-print available at (all rights with authors): https://arxiv.org/pdf/2310.05914.pdf HuggingFace TRL code implementation of NEFTune: https://huggingface.co/docs/trl/main/en/sft_trainer#enhance-models-performances-using-neftune #finetuning #ai #aieducation