Parameter Efficient Fine Tuning

A method for Model Fine Tuning that only adjusts a small number of parameters through creating:

• Adapter Layer
• LoRA
• Prompt Tokens Can be used to reduce trainable parameters.