Local AI Glossary
What is i-quant (IQ)?
Source: huggingface/gguf-spec
Importance-aware GGUF quantizations that use an imatrix (importance matrix) to allocate bits. IQ1, IQ2, IQ3, IQ4 variants offer better quality than non-IQ counterparts at the same bpw, especially at very low bit rates.
How i-quant (IQ) fits in the local AI stack
i-quant (IQ) is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM