> Local models are never going to be as powerful. I think this point should be obvious: all of the current frontier models (closed and open-weights) are far too big to run on anything but a full GPU cluster in a datacenter<p>Diminishing returns with respect to scale (a 10X larger model is typically not 10X better at any given task) has so far meant that, even when datacenter compute grows faster than individual compute, the gap in quality between hosted and local models has generally shrunk. There are still plenty of tasks where that extra gain in quality is noticeable, but I feel there are also an increasing number of "saturated" tasks where it really doesn't matter.<p>Which puts more focus on other factors. Local models are private, low-latency, work offline, and can be tinkered with to your liking - like changing the system prompt to avoid refusals. I would not trust a hosted model to classify my documents, for example.