text-generation-webui
Local LLM interface with text, vision, and training
The Lens
By Erik Loyd, SaaS CEO and former COO/CFO of an AWS Premier Partner.
Updated Mar 2026
Text-generation-webui gives you a browser-based interface to do it. Load a model, chat with it, fine-tune it, generate images. It's the Swiss Army knife for local AI.
The entire project is free under AGPL-3.0. Every feature (chat, notebook mode, model loading, LoRA training, multimodal/vision support, extensions) ships at $0. The developer sells some extension packs on Gumroad, but those are optional add-ons, not core features.
Self-hosting is the only option, and the setup complexity depends on your GPU situation. If you have an NVIDIA card with 8GB+ VRAM, the one-click installers work well. AMD and Apple Silicon support exists but can be finicky. Expect 30-60 minutes for first-time setup including downloading a model. Solo developers: this is your playground. Run models locally, experiment with fine-tuning, keep your data private. Small teams: share a beefy GPU server running the API mode. Beyond that, look at dedicated inference servers like vLLM.
The catch: GPU hardware requirements are real. You need a decent GPU to run anything useful. A 7B parameter model needs ~6GB VRAM. Anything bigger needs proportionally more. No GPU, no party.
Free vs Self-Hosted vs Paid
fully freeFree
Everything core is free. Chat interface, notebook mode, model management, LoRA/QLoRA fine-tuning, multimodal support, API server mode, extensions framework, all AGPL-3.0.
Optional Paid Extensions
The developer sells extension packs on Gumroad (e.g., "Deep Reason" for enhanced reasoning). These are optional convenience add-ons, not gated features. The core project doesn't depend on them.
Self-Hosted (Only Option)
This runs on your hardware. Minimum useful setup: NVIDIA GPU with 8GB VRAM (~$200-400 used for an RTX 3060 12GB). Ideal setup: 24GB VRAM card ($400-900 used for RTX 3090/4090). Running costs are electricity. Expect $5-15/month for regular use.
Hardware Cost Reality Check
- 7B models (Mistral, Llama 3): 6-8GB VRAM. Runs on an RTX 3060.
- 13B models: 10-16GB VRAM. Needs RTX 3090 or better.
- 70B models: 40GB+ VRAM. Multi-GPU territory or heavy quantization.
- CPU-only: possible with llama.cpp backend but painfully slow for anything useful.
Verdict
The software is free. The hardware isn't. Budget $300-900 for a capable GPU if you don't have one already.
Software is completely free. The real cost is GPU hardware: $300-900 for a capable NVIDIA card.
Get tools like this every Wednesday
One featured tool, three on the radar. No fluff.
Similar Tools
Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Model framework for state-of-the-art ML
High-throughput LLM inference and serving engine
LLM inference in C/C++
SDK and proxy to call 100+ LLM APIs in OpenAI format
Self-hosted AI interface for LLMs
A low score is not a verdict on quality. Young and niche tools start low by design. How we calculate scores
About
- Stars
- 47,534
- Forks
- 5,983
Explore Further
More tools in the directory
openclaw
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
385.4k ★everything-claude-code
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
238.3k ★hermes-agent
The agent that grows with you
226.7k ★