Free speed boost for old gaming GPUs running local AI
A new open-source tool called gpu-unlock says it raises the speed of some AI math on Nvidia RTX 3000 cards. It got 248 points on Hacker News. On r/LocalLLaMA, people say a similar trick works on RTX 30 and 40 cards, with up to 2x faster "prefill" (the step where the model reads your prompt). One headline even says prices for these cards are surging.
At the same time, people run big models on normal hardware. One project runs Qwen3.8-Flash-Next, a 125-billion-parameter model, at about 20 tokens per second (tokens are small pieces of words) with 16 GB of video memory, by reading parts from a fast SSD. Others run it on 8 GB cards.
These are early community results, not official tests. But if they hold, a used gaming PC can run serious AI at home, with your data staying on your machine.
Local AI means more privacy and less dependence on a few big companies. With cloud labs blocking more requests, running your own model is becoming a real choice for normal users and small businesses.
