Minimum sensible
The smallest build that genuinely works — tight, focused, no fluff.
- CPU
- 8 cores
- RAM
- 16 GB
- Storage
- 1 TB (ssd)
- GPU
- ai · 12 GB VRAM
- Network
- 1 GbE
Run LLMs locally — chat, code completion, private AI.
The smallest build that genuinely works — tight, focused, no fluff.
The sweet spot: handles the service plus the usual side-services.
Real headroom — this service will never be the bottleneck.
More than you will ever use for this service alone — spend the money elsewhere.
Overkill Beyond Comfortable — 16 cores, 64 GB RAM, 2 TB: headroom you will never use for this service alone.
Pick the model you want to run — the VRAM need is computed, not guessed.