Local AI Glossary
What is LLaMA architecture?
Source: paperswithcode/llama
Meta's open Transformer architecture introduced in the LLaMA paper (2023). The basis for Llama 2, Llama 3, and most current open-weights models. Uses RoPE, SwiGLU, GQA, and RMSNorm.
How LLaMA architecture fits in the local AI stack
LLaMA architecture is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM