Local LLM Models
62 models cataloged with VRAM requirements, setup commands, and use case recommendations. Browse by family or search for a specific model.
Llama
Llama 3.1
Meta's flagship open-weights LLM. Strong all-rounder with native tool use, 128K context, and broad ecosystem support.
Llama 3.2
Meta's smallest Llama 3 models. 1B fits in 1GB VRAM; 3B is a sweet spot for low-end desktops and laptops.
Llama 3.2 Vision
Multimodal Llama 3.2 with image input. 11B fits on consumer hardware; 90B needs 64GB+.
Llama 3.3
Meta's 70B offering with quality similar to Llama 3.1 405B at a fraction of the size.
Llama 4
Meta's MoE multimodal Llama 4 generation. Scout has 10M context. Maverick matches GPT-4o on vision.
Code Llama
Meta's code-specialized Llama. Foundation for many code tools. Now superseded by Qwen 2.5-Coder and Qwen 3-Coder for new work.
Llama 3.2 Vision
Meta's multimodal Llama 3.2. 11B is the consumer-friendly size; 90B is a flagship-tier VLM.
TinyLlama
1.1B Llama trained on 3T tokens. The smallest capable chat model. Runs on phones and Raspberry Pi.
Qwen
Qwen 2.5
Alibaba's flagship open weights. The strongest model in its size class for English, Chinese, code, math, and tool use.
Qwen 2.5-Coder
Code-specialized Qwen 2.5. Strongest open-weight code model in its size class, supports fill-in-middle and chat.
Qwen 3
Alibaba's Qwen 3 generation. Strongest all-round open model in 2025-2026. Includes 'thinking' mode for reasoning.
Qwen 3-Coder
Qwen 3 generation specialized for coding agents. 30B is competitive with 70B+ coders; 480B is a frontier-tier model.
Qwen 3 VL
The most powerful vision-language model in the Qwen3 family. Combines Qwen 3's reasoning with state-of-the-art visual understanding. 2B-235B sizes for any hardware.
DeepSeek
DeepSeek R1
DeepSeek's reasoning model. Distilled 32B is excellent for 24GB GPUs. Full 671B MoE is frontier-class.
DeepSeek V3
DeepSeek's flagship MoE. 671B total parameters but only 37B active. Needs 256GB+ for inference.
DeepSeek Coder
DeepSeek's code completion model. Strong for the size, especially at 6.7B and 33B.
DeepSeek Coder V2
DeepSeek Coder V2 open-source MoE code model. 16B active parameters with 236B total. Comparable to GPT-4-Turbo on code-specific tasks.
Mistral
Mistral
Mistral's first open model. Still useful for lightweight chat and edge deployment.
Mistral Nemo
Mistral + NVIDIA collaboration. Excellent 12B with 128K context and tool use.
Mistral Small
Mistral's sub-30B model. Best in class for its size; competitive with 70B+ on chat.
Mistral Large
Mistral's flagship. Frontier-class quality with 128K context. Needs data-center GPU or 2-3x consumer GPU.
Gemma
Gemma 2
Google's open Gemma 2 family. Strong chat for the size; 2B is competitive with much larger models on simple tasks.
Gemma 3
Gemma 3 with vision support. 12B is the sweet spot for single-GPU multimodal chat.
Gemma 4
Google's frontier-tier Gemma 4 generation. Vision + tools + thinking + audio. Best single-GPU multimodal model in 2026.
Phi
Phi-3
Microsoft's small Phi-3 family. Mini (3.8B) is the best-in-class small chat; Medium (14B) competes with much larger models.
Phi-4
Microsoft's Phi-4 generation. 14B with strong reasoning despite small size.
Phi-4 Mini
Phi-4-mini brings multilingual support, reasoning, and mathematics to a 3.8B model. Includes function calling. Strong on phones and edge devices.
Phi-4 Reasoning
Phi-4 reasoning and reasoning plus are 14B parameter open-weight reasoning models that rival much larger models on complex reasoning tasks.
Moondream
Falcon
GLM
GLM-5
Z.ai's flagship reasoning model. 744B total parameters, 40B active. Built for complex systems engineering and long-horizon agentic tasks. Frontier-class on SWE-Bench Pro.
GLM-5.1
GLM-5.1 is the next-generation flagship from Z.ai with significantly stronger coding capabilities. State-of-the-art on SWE-Bench Pro. Leads GLM-5 by a wide margin.
GLM-5.2
Latest Z.ai frontier model. Updated GLM-5.1 with improved agentic workflows and reasoning. One of the most-pulled models in the Ollama library in mid-2026.
GLM-4.7
Z.ai's GLM-4.7 generation. Advances coding capability over GLM-4.6 with stronger agentic tool use.
GLM-4.7 Flash
The strongest model in the 30B class. Balances performance and efficiency for lightweight local deployment. New option for the 24GB-VRAM sweet spot.
Kimi
Kimi K2
Moonshot AI's Kimi K2. 1 trillion total parameters, only 32B active per token. Frontier-class agentic capability with strong tool use. One of the most-pulled models in the Ollama library in 2026.
Kimi K2.5
Moonshot AI's January 2026 update to Kimi K2. Continued improvements in agentic capability and long-context understanding.
Kimi K2.6
Moonshot AI's March 2026 frontier update. Continued gains in agentic benchmarks and tool use. Among the most-pulled models in 2026.
Kimi K2.7 Code
Kimi K2.7 code-specialized variant. Strong on long-horizon coding agent workflows and multi-file refactors.
minimax
minimax M2
minimax's M2 series. Exceptional multilingual capabilities to elevate code engineering. Designed for real-world productivity and coding tasks across 100+ languages.
minimax M2.1
minimax's December 2025 update to M2. Improved multilingual code engineering capabilities.
minimax M2.5
minimax M2.5: state-of-the-art large language model designed for real-world productivity and coding tasks.
minimax M2.7
minimax M2-series model for coding, agentic workflows, and professional productivity. Among the most-pulled models in the Ollama library in 2026.
minimax M3
minimax M3, the latest M-series model. Continued improvements for coding, agentic workflows, and professional productivity.