2 comments

  • Ukv25 minutes ago
    &gt; Local models are never going to be as powerful. I think this point should be obvious: all of the current frontier models (closed and open-weights) are far too big to run on anything but a full GPU cluster in a datacenter<p>Diminishing returns with respect to scale (a 10X larger model is typically not 10X better at any given task) has so far meant that, even when datacenter compute grows faster than individual compute, the gap in quality between hosted and local models has generally shrunk. There are still plenty of tasks where that extra gain in quality is noticeable, but I feel there are also an increasing number of &quot;saturated&quot; tasks where it really doesn&#x27;t matter.<p>Which puts more focus on other factors. Local models are private, low-latency, work offline, and can be tinkered with to your liking - like changing the system prompt to avoid refusals. I would not trust a hosted model to classify my documents, for example.
  • jqpabc12330 minutes ago
    <i>Local models are never going to be as powerful.</i><p>Yes, and PCs will never be as powerful as mainframes.<p>And smart phones will never be as powerful as PCs.<p>But which ones are more popular and used more for computing?<p>In other words, &quot;power&quot; isn&#x27;t the only factor that needs to be considered.
    • fragmede7 minutes ago
      How useful are smartphones without connection to the mainframes that back them? While I&#x27;d love for the gigaherz of computing I hold in the palm of my hand to be useful unto itself, if it doesn&#x27;t connect to Uber, Gmail, Netflix, Apple, et al, how useful those gigaherz of computing are is irrelevant, unless I want to do some local computing.