Local AI Glossary
What is Vulkan?
Source: local-llm.net/glossary
A cross-platform graphics and compute API that provides GPU acceleration on a wide range of hardware, including NVIDIA, AMD, and Intel GPUs. llama.cpp supports Vulkan as a backend, enabling GPU-accelerated inference on hardware that does not support CUDA, Metal, or ROCm. Performance is generally lower than CUDA or Metal but offers broad compatibility.
How Vulkan fits in the local AI stack
Vulkan is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM