DRAM Crunch: Lessons for System Design

2 comments

• _alphageek2 hours ago
  The weak link in the argument is the "1-2 GB DRAM stays stable" claim. That tier is stable because demand sits elsewhere. If AI workloads actually migrate down-capacity at scale (which is what the piece advocates), pricing pressure follows them.
• babblingfish3 hours ago
  This is what keeps Amodei and Altman up at night. Their whole moat is data centers. But what if we didn't need the data centers?
  • wmf2 hours ago
    This article is an ad for Hailo and frontier AI will never run on the edge so A &amp; A have nothing to worry about.<p>(I define frontier AI as that which doesn&#x27;t run on the edge... gotcha.)