Big AI on your own machine: a 145B open model and LLMs for old devices
Local AI means the model runs on your own computer, not in a company's cloud. Your data stays at home. Two projects push it further today.
Edge0-145B is an open-source model with 145 billion parameters, built to run on your own computer. Parameters are the numbers that make up a model. It got 248 points on Hacker News. Smolmaxxing, a free GitHub project, tries to make LLMs work on small and old devices. It got 365 points.
This matters more this week. With Nvidia's open-source support now in question, a Reddit user advises backing up your favorite models and datasets, just in case. My old laptop just looked at me with hope.
Local models give people and small businesses more control and privacy. They also keep AI from depending only on a few big companies.
