Local AI Glossary
What is Quantization?
Source: local-llm.net/glossary
The process of reducing the numerical precision of model weights to decrease memory usage and increase inference speed. Quantization converts weights from high-precision formats (FP16, 16 bits per weight) to lower-precision formats (INT8, INT4, or lower). See the [quantization guide](/learn/quantization-explained) for comprehensive coverage.
How Quantization fits in the local AI stack
Quantization is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM