Local AI Glossary
What is FP16 (Float16)?
Source: local-llm.net/glossary
A 16-bit floating-point number format that can represent values with approximately 3.3 decimal digits of precision. The standard format for storing and distributing LLM weights. Each weight occupies 2 bytes, so a 7B model at FP16 requires approximately 14 GB.
How FP16 (Float16) fits in the local AI stack
FP16 (Float16) is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM