Local AI Glossary
What is Learning rate?
Source: local-llm.net/glossary
A hyperparameter that controls how much the model's weights are adjusted during each training step. Too high a learning rate causes unstable training; too low causes slow convergence. Typical learning rates for fine-tuning are 1e-5 to 5e-4.
How Learning rate fits in the local AI stack
Learning rate is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM