Local AI Glossary
What is AWQ (Activation-Aware Weight Quantization)?
Source: local-llm.net/glossary
A quantization method that identifies and preserves the most important weights based on their impact on model activations. AWQ achieves strong quality retention at 4-bit precision and is optimized for fast inference on modern NVIDIA GPUs (Ampere and newer). Commonly used with vLLM and TGI.
How AWQ (Activation-Aware Weight Quantization) fits in the local AI stack
AWQ (Activation-Aware Weight Quantization) is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM