Local AI Glossary
What is Stop token?
Source: local-llm.net/glossary
A special token that signals the model to stop generating text. Different model families use different stop tokens (e.g., `<|eot_id|>` for Llama 3, `</s>` for Mistral). The inference engine must be configured with the correct stop tokens to prevent the model from generating unwanted extra text.
How Stop token fits in the local AI stack
Stop token is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM