Local AI Glossary
What is ONNX (Open Neural Network Exchange)?
Source: local-llm.net/glossary
An open format for representing machine learning models, enabling interoperability between different frameworks. ONNX models can run on various hardware through ONNX Runtime. Less commonly used for LLM inference than GGUF or GPTQ but supported by some deployment scenarios.
How ONNX (Open Neural Network Exchange) fits in the local AI stack
ONNX (Open Neural Network Exchange) is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM