Local AI Glossary
What is Chunking?
Source: local-llm.net/glossary
The process of splitting documents into smaller segments (chunks) for use in RAG pipelines. Effective chunking strategies balance chunk size (too small loses context, too large dilutes relevance) with overlap (adjacent chunks share some text to avoid splitting relevant information). Common chunk sizes range from 256 to 1024 tokens.
How Chunking fits in the local AI stack
Chunking is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM