Local AI Glossary
What is Transformer?
Source: local-llm.net/glossary
The neural network architecture underlying virtually all modern LLMs, introduced in the 2017 paper "Attention Is All You Need." Transformers process sequences using self-attention mechanisms and feed-forward networks, enabling parallel processing and long-range dependency modeling. All major local models (Llama, Mistral, Gemma, Qwen) are Transformers.
How Transformer fits in the local AI stack
Transformer is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM