Local AI Glossary
What is CUDA?
Source: local-llm.net/glossary
NVIDIA's parallel computing platform and programming model for GPU-accelerated computing. CUDA is the foundation of most GPU-accelerated AI inference. Tools like llama.cpp, vLLM, and PyTorch use CUDA to run computations on NVIDIA GPUs. CUDA is exclusive to NVIDIA hardware.
How CUDA fits in the local AI stack
CUDA is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM