Local AI Glossary
What is MoE (Mixture of Experts)?
Source: local-llm.net/glossary
A model architecture where the network contains multiple "expert" sub-networks, and a routing mechanism selects a subset of experts to process each token. MoE models have a large total parameter count but only activate a fraction per token, giving larger-model quality at smaller-model inference cost. Examples: Mixtral 8x7B (47B total, 13B active), DeepSeek-V2.
How MoE (Mixture of Experts) fits in the local AI stack
MoE (Mixture of Experts) is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM