text-generation-webui
Local LLM interface with text, vision, and training
The Lens
By Erik Loyd, SaaS CEO and former COO/CFO of an AWS Premier Partner.
Updated Mar 2026
Text-generation-webui gives you a browser-based interface to do it. Load a model, chat with it, fine-tune it, generate images. It's the Swiss Army knife for local AI.
The entire project is free under AGPL-3.0. Every feature (chat, notebook mode, model loading, LoRA training, multimodal/vision support, extensions) ships at $0. The developer sells some extension packs on Gumroad, but those are optional add-ons, not core features.
Self-hosting is the only option, and the setup complexity depends on your GPU situation. If you have an NVIDIA card with 8GB+ VRAM, the one-click installers work well. AMD and Apple Silicon support exists but can be finicky. Expect 30-60 minutes for first-time setup including downloading a model. Solo developers: this is your playground. Run models locally, experiment with fine-tuning, keep your data private. Small teams: share a beefy GPU server running the API mode. Beyond that, look at dedicated inference servers like vLLM.
The catch: GPU hardware requirements are real. You need a decent GPU to run anything useful. A 7B parameter model needs ~6GB VRAM. Anything bigger needs proportionally more. No GPU, no party.
Free vs Self-Hosted vs Paid
fully freeFree
Everything core is free. Chat interface, notebook mode, model management, LoRA/QLoRA fine-tuning, multimodal support, API server mode, extensions framework, all AGPL-3.0.
Optional Paid Extensions
The developer sells extension packs on Gumroad (e.g., "Deep Reason" for enhanced reasoning). These are optional convenience add-ons, not gated features. The core project doesn't depend on them.
Self-Hosted (Only Option)
This runs on your hardware. Minimum useful setup: NVIDIA GPU with 8GB VRAM (~$200-400 used for an RTX 3060 12GB). Ideal setup: 24GB VRAM card ($400-900 used for RTX 3090/4090). Running costs are electricity. Expect $5-15/month for regular use.
Hardware Cost Reality Check
- 7B models (Mistral, Llama 3): 6-8GB VRAM. Runs on an RTX 3060.
- 13B models: 10-16GB VRAM. Needs RTX 3090 or better.
- 70B models: 40GB+ VRAM. Multi-GPU territory or heavy quantization.
- CPU-only: possible with llama.cpp backend but painfully slow for anything useful.
Verdict
The software is free. The hardware isn't. Budget $300-900 for a capable GPU if you don't have one already.
Software is completely free. The real cost is GPU hardware: $300-900 for a capable NVIDIA card.
What to do by team size
- Solo
- Perfect for experimentation and private AI. One GPU, one browser, you're set.
- Small team
- Run in API mode on a shared GPU server. Works for 2-5 concurrent users on good hardware.
- Medium team
- Look at vLLM or llama.cpp server for production workloads. This is better as a dev/experimentation tool.
- Large team
- Not designed for enterprise deployment. Use vLLM, TGI, or a managed inference service.
Get tools like this every Wednesday
One featured tool, three on the radar. No fluff.
Similar Tools
Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Unsloth is a local UI for training and running Kimi K3, Gemma 4, Qwen3.6, DeepSeek-V4, GLM and other models.
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
Open Source AI Platform - AI Chat with advanced features that works with every LLM
LLM inference in C/C++
Model framework for state-of-the-art ML
A low score is not a verdict on quality. Young and niche tools start low by design. How we calculate scores
About
- Stars
- 47,550
- Forks
- 5,979
Explore Further
More tools in the directory
openclaw
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
386.5k ★everything-claude-code
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
240.5k ★hermes-agent
The agent that grows with you
231.6k ★