Local AI Glossary
What is BnB (bitsandbytes)?
Source: huggingface/bitsandbytes
A Python library for 4-bit and 8-bit quantization with a focus on training-time use. Used in QLoRA for fine-tuning on consumer GPUs. NF4 (4-bit NormalFloat) is its most-used mode.
How BnB (bitsandbytes) fits in the local AI stack
BnB (bitsandbytes) is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM