Building an Offline AI Phone App with Llamafu and Flutter
A step-by-step tutorial for building a fully offline AI assistant app for Android and iOS using Llamafu for on-device inference and Flutter for the UI. No internet required.
Blog
News, tutorials, benchmarks, and case studies from the local AI ecosystem.
Fine-Tuning a Customer Support Model with Unsloth in 4 Hours
An end-to-end walkthrough of fine-tuning a language model for customer support using Unsloth and QLoRA. From dataset preparation to GGUF export and Ollama deployment — all on a single consumer GPU.
Why We Built local-llm.net: A Community Hub for Everyone Running AI Locally
Announcing local-llm.net — the community-driven guide to deploying AI locally. We cover the entire ecosystem because the local AI movement belongs to everyone.
Local AI for Creative Writers: KoboldCpp, SillyTavern, and Uncensored Models
A non-technical guide for fiction writers who want AI tools that respect creative freedom and privacy. How to set up KoboldCpp, SillyTavern, and uncensored models for brainstorming, worldbuilding, and prose generation.
Local AI Privacy Audit: What Data Do These Tools Actually Collect?
An honest audit of telemetry, data collection, and privacy practices across Ollama, LM Studio, Jan, GPT4All, and Open WebUI. What runs locally does not always stay local.
The 2026 Local AI Model Tier List: Every Model Ranked by Use Case
An opinionated S/A/B/C/D tier ranking of every major local AI model across six categories: chat, coding, reasoning, creative writing, vision, and embeddings. Updated quarterly.
The RAG Stack That Actually Works: Ollama + ChromaDB + LangChain
A step-by-step guide to building a Retrieval-Augmented Generation pipeline that actually works in production. Ollama for inference, ChromaDB for vectors, LangChain for orchestration — with solutions to every common pain point.
I Replaced ChatGPT with a Fully Local Stack — Here's What Happened
A 30-day experiment ditching ChatGPT Plus for a fully local AI setup. What worked, what failed, exact costs, and an honest verdict on whether local AI is ready for daily use.
RTX 3090 in 2026: Still the Best Value GPU for Local AI
Benchmarking the used RTX 3090 against the RTX 4090 and RTX 5090 for local AI inference. The 3090's 24GB VRAM at $500-800 used makes it the unbeatable value pick for running large language models locally.
Self-Hosted ChatGPT for Your Team: Open WebUI + Ollama Deployment Guide
Deploy a multi-user ChatGPT alternative for your team using Open WebUI and Ollama. Complete guide covering Docker, HTTPS, authentication, model management, and cost analysis vs ChatGPT Team.
The State of Local AI in 2026: Everything Has Changed
A comprehensive look at where local AI stands in 2026 — from 70B models on consumer GPUs to mobile inference, and everything that shifted since the chaotic early days of 2024.