Local AI Glossary
What is Inference?
Source: local-llm.net/glossary
The process of running a trained model to generate predictions or outputs from new inputs. In the context of LLMs, inference means processing a prompt and generating a text response. Inference is what happens when you chat with a model — as opposed to training, which is how the model learns.
How Inference fits in the local AI stack
Inference is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM