Run a model without a GPU
A CPU-only machine can run the smaller quants, just slowly: expect a few tokens per second rather than dozens. It is usable for batch jobs, summaries and overnight work, not for a live chat. Keep at least 32 GB of RAM — the weights are loaded there, not in VRAM.