Local AI Glossary
What is INT4 / INT8?
Source: local-llm.net/glossary
Integer formats using 4 or 8 bits respectively. Used in quantization to represent model weights with lower precision than floating-point formats. INT8 is approximately 2x smaller than FP16; INT4 is approximately 4x smaller.
How INT4 / INT8 fits in the local AI stack
INT4 / INT8 is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM