Local AI Glossary
What is Context length (context window)?
Source: local-llm.net/glossary
The maximum number of tokens a model can consider at once, including both the input prompt and the generated output. Common context lengths range from 4,096 to 128,000 tokens. Longer context allows processing larger documents but requires more memory for the KV-cache.
How Context length (context window) fits in the local AI stack
Context length (context window) is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM