All topics

Every Weights and Watts guide, grouped by topic: model news, running models locally, hardware, open model comparisons, frontier models, and privacy and costs.

Hardware for local AI

How much VRAM, RAM and unified memory each model size needs, which GPUs and Macs make sense, and what quantization does.