Local AI Glossary
What is GGUF Q2_K?
Source: huggingface/gguf-spec
A 2-bit GGUF k-quant variant. Very small model files (around 2.7 bits per weight on average) but with noticeable quality loss; best only when VRAM is severely limited.
How GGUF Q2_K fits in the local AI stack
GGUF Q2_K is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM