Local AI Glossary
What is FFN (Feed-Forward Network)?
Source: local-llm.net/glossary
A component of each Transformer layer consisting of two linear transformations with a non-linear activation function in between. The FFN processes each token independently (unlike attention, which processes relationships between tokens) and is where much of the model's factual knowledge is stored.
How FFN (Feed-Forward Network) fits in the local AI stack
FFN (Feed-Forward Network) is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM