I run local LLMs on slow hardware—here’s what actually works

There are plenty of benefits to running local LLMs, not least of which is that you don’t have to share all your personal data with an AI company. The problem is that even fairly small LLMs run slowly on my mini PC or MacBook Air. Despite this, there are plenty of ways that I use […]