Local AI Glossary
What is Importance matrix (imatrix)?
Source: local-llm.net/glossary
A data structure that records which model weights have the greatest impact on output quality, generated by running calibration data through the model. Used by GGUF's IQ quantization variants to allocate more bits to important weights and fewer to unimportant ones, improving quality at low bit rates.
How Importance matrix (imatrix) fits in the local AI stack
Importance matrix (imatrix) is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM