Local AI Glossary
What is Dense model?
Source: local-llm.net/glossary
A model architecture where every parameter is used for every input token, as opposed to mixture-of-experts (MoE) models where only a subset of parameters is active per token. Llama, Gemma, and Phi are dense models. Dense models have predictable resource usage — a 7B dense model always uses all 7B parameters.
How Dense model fits in the local AI stack
Dense model is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM