Local AI Glossary
What is Sampling?
Source: local-llm.net/glossary
The process of selecting the next token from the model's predicted probability distribution during text generation. Sampling strategies include greedy (always pick the most probable), temperature scaling (adjust randomness), top-p (nucleus sampling), and top-k (limit to the k most probable tokens).
How Sampling fits in the local AI stack
Sampling is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM