Local AI Glossary
What is Pipeline parallelism?
Source: local-llm.net/glossary
A model parallelism strategy where different layers of the model are assigned to different GPUs, creating a pipeline. GPU 1 processes layers 1-40, GPU 2 processes layers 41-80. Simpler than tensor parallelism but less efficient due to "pipeline bubbles" where GPUs wait for previous stages.
How Pipeline parallelism fits in the local AI stack
Pipeline parallelism is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM