On the bench
Building Local AI Like a Workshop, Not a Toy
every machine earns its keep
There are two ways to own tools. Collectors buy tools to have them. Tradesmen buy tools because a job demanded one, and every tool in the van has paid for itself.
Local AI is full of collectors right now — rigs benchmarked once and left idle. I run my GPU server the way I run my workshop: it exists because cloud API bills and data boundaries made it cheaper not to rent, and every card in it has a job. Image generation for the businesses. Local models for work that shouldn’t leave the building. Batch pipelines overnight, when the electricity is cheap.
What this draft covers when it’s done:
- The actual build: what 8× RTX 3090 does and doesn’t get you in 2026
- When local genuinely beats API (data boundaries, batch volume, latency) — and when it’s vanity
- Power, heat and noise: the bits nobody puts in the YouTube video
- The “earns its keep” test, applied ruthlessly
On the bench. Power meter is literally plugged in collecting the evidence.