Local AI Glossary
What is vLLM?
Source: local-llm.net/glossary
A high-performance inference engine optimized for GPU throughput, featuring PagedAttention for efficient memory management, continuous batching for high concurrency, and tensor parallelism for multi-GPU deployment. The standard choice for production local AI serving when maximum throughput is needed.
How vLLM fits in the local AI stack
vLLM is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM