Local AI Glossary
What is LoRA (Low-Rank Adaptation)?
Source: local-llm.net/glossary
A parameter-efficient fine-tuning method that freezes the original model weights and trains small, low-rank adapter matrices that modify the model's behavior. LoRA typically adds 0.1-1% additional parameters, making fine-tuning possible on consumer hardware. LoRA adapters can be merged into the base model or loaded dynamically.
How LoRA (Low-Rank Adaptation) fits in the local AI stack
LoRA (Low-Rank Adaptation) is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM