Local AI Glossary
What is Group size?
Source: local-llm.net/glossary
In GPTQ and AWQ quantization, the number of weights that share a single set of scaling parameters. A group size of 128 means every 128 consecutive weights use the same scale and zero-point. Smaller group sizes (64, 32) yield better quality but larger files. 128 is the standard default.
How Group size fits in the local AI stack
Group size is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM