Local AI Glossary
What is Perplexity?
Source: local-llm.net/glossary
A metric that measures how well a language model predicts a test dataset. Lower perplexity means better prediction (the model is less "perplexed" by the text). Perplexity is the standard metric for comparing quantization quality — quantized models have higher (worse) perplexity than their full-precision counterparts.
How Perplexity fits in the local AI stack
Perplexity is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM