Model training / fine-tuning: hardware requirements guide
Fine-tuning and training small models (LoRA, small checkpoints).
Hardware requirements by tier
Three tiers for every workload: the minimum that works, the recommended sweet spot, and the comfortable headroom level. These are the same tiers the WisePC decision engine uses when it plans a build around your goal.
| Tier | CPU cores | RAM | Storage | GPU | VRAM | Network |
|---|---|---|---|---|---|---|
| Minimum | 8 cores | 32 GB | 2 TB (ssd) | ai | 16 GB VRAM | 1 GbE |
| Recommended | 16 cores | 64 GB | 4 TB (ssd) | ai | 24 GB VRAM | 2.5 GbE |
| Comfortable | 24 cores | 128 GB | 8 TB (ssd) | ai | 48 GB VRAM | 10 GbE |
| Overkill | 39 cores | 205 GB | 16 TB (ssd) | ai | 48 GB VRAM | 10 GbE |
Beyond Comfortable — 39 cores, 205 GB RAM, 16 TB (SSD): headroom you will never use for this workload alone. Put the difference into storage, backup or silence.
Recommended system shape
Derived by the decision engine from the recommended tier — the same logic that plans full builds.
- Form factor
- tower
- Build style
- diy
- Drive plan
- 2× 4.1TB NVMe
Requirements (16 threads, 64GB RAM, 8TB storage, dedicated GPU) need a custom tower build.
One box or a separate machine?
Whether this workload deserves its own system or should live on the main server.
Keep on the main server
GPU-bound compute is expensive to duplicate — a second GPU box roughly doubles cost for little resilience gain. Keep it on the main machine.
Storage arrays, priced
Five physical strategies for the recommended capacity — the same planner, drive model and reference prices as the storage planner tool.
| Strategy | Drives | Usable | Cost | Idle |
|---|---|---|---|---|
| Cheapest | 2× 4TB hdd | 4 TB · parity1 | ≈ €200 | 10 W |
| BalancedRecommended | 2× 16TB hdd | 16 TB · parity1 | ≈ €480 | 12 W |
| Redundant | 3× 8TB hdd | 8 TB · parity2 | ≈ €450 | 15 W |
| Expansion-friendly | 2× 20TB hdd | 20 TB · parity1 | ≈ €600 | 14 W |
| Performance | 2× 4TB nvme | 4 TB · parity1 | ≈ €480 | 2 W |
For a fast working tier, go all-flash — the performance strategy protects speed without the HDD rebuild pain.
Backup is not storage
The extra copy that survives drive failure, deletion and ransomware — the same engine as the backup planner.
Protect 4TB with at least two copies on separate hardware, ideally one offsite. The recommended start is a dedicated NAS.
Recommended: Separate NAS — A dedicated box that only stores backups · ≈ €353
- No offsite copy (high): Add a second copy outside the building — cloud or a drive at a friend's house.
- No versioning (medium): Use a versioning-aware tool (restic, borg, Backblaze) that keeps history.
- Unscheduled backups (medium): Schedule backups automatically and monitor them.
- Backup on the same machine (medium): Keep the backup on separate hardware or offsite.
What will it cost?
Market-neutral EUR bands from the reference drive model (≈ = estimated street price). Live component prices resolve on the build page for your region.
- Storage array
- ≈ €200 – €600
- Array energy / year
- ≈ €103/yr (∼47 W idle)
Compute (CPU, board, RAM, GPU) is not included — see the recommended build for live prices.
Growth outlook
What happens when the data keeps growing — the same engine as the growth simulator.
Storage stays within 8TB across the 3-year horizon — the architecture fits your expected growth.
Within capacity and bays — no new bay needed for 7TB.
Also covered in this guide
AI experimentation
Learning and experimenting with models, training small models, tooling.
Which tier do you need?
- Pick Minimum (8 cores, 32 GB RAM) only for a single-purpose machine on a tight budget — expect little headroom.
- Recommended (16 cores, 64 GB RAM) is the sweet spot: enough for the workload plus the usual side-services, without overspending.
- Pick Comfortable (24 cores, 128 GB RAM) when this workload shares the machine with others or will grow — you pay for headroom, not for anxiety.
- GPU rule for this workload: ai.GPU rule for this workload: ai (24 GB VRAM).
Frequently asked questions
How much RAM does model training / fine-tuning need?
32 GB is the sensible minimum, 64 GB covers most real setups, and 128 GB gives comfortable headroom for growth and extra services.
How many CPU cores does model training / fine-tuning need?
A 8-core CPU is the minimum, 16 cores is the recommended sweet spot, and 24 cores is comfortable when it shares the machine with other workloads.
Does model training / fine-tuning need a dedicated GPU?
A dedicated GPU is strongly recommended — this workload does AI compute. Needs 16–48 GB VRAM (16 minimum, 24 recommended, 48 comfortable).
What storage and network does model training / fine-tuning expect?
Storage: 4 TB of SSD is the recommended baseline (2 TB minimum, 8 TB comfortable). Network: 2.5 GbE is the recommended baseline.
What runs well alongside model training / fine-tuning?
It pairs naturally with: AI experimentation.
How much power does model training / fine-tuning use?
The storage array idles around 47 W (≈ 103 €/year at 0.25 €/kWh). The full system adds CPU, board and fans on top — see the cost section for the honest bands.